Hugging Face's logo

OpenMol
/
PRESTO-yield

Safetensors
llama-lmm
finetuned
multimodal
Model card Files Community
hcaoaf commited on
Commit
72436ef
·
verified ·
1 Parent(s): 0a77c44

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -459
README.md CHANGED
@@ -16,470 +16,12 @@ These are weights for a version of `checkpoints/stage2/llava-moleculestm-vicuna-
16
 
17
  ### Usage
18
 
19
- GitHub: https://github.com/sshh12/bioagent (includes training scripts and basic inference server)
20
 
21
  ### Dataset
22
 
23
  yield (9515 examples)
24
 
25
- ```
26
- {'molecule_2d': [(tensor([[34, 0],
27
- [ 5, 0],
28
- [ 5, 0],
29
- [ 5, 0],
30
- [ 5, 0],
31
- [ 6, 0],
32
- [ 5, 0]]), tensor([[0, 1, 1, 2, 2, 3, 3, 4, 4, 5, 5, 6, 6, 1],
33
- [1, 0, 2, 1, 3, 2, 4, 3, 5, 4, 6, 5, 1, 6]]), tensor([[0, 0],
34
- [0, 0],
35
- [3, 0],
36
- [3, 0],
37
- [3, 0],
38
- [3, 0],
39
- [3, 0],
40
- [3, 0],
41
- [3, 0],
42
- [3, 0],
43
- [3, 0],
44
- [3, 0],
45
- [3, 0],
46
- [3, 0]])), (tensor([[5, 0],
47
- [5, 0],
48
- [5, 0],
49
- [5, 0],
50
- [5, 0],
51
- [6, 0],
52
- [5, 0],
53
- [5, 0]]), tensor([[0, 1, 1, 2, 2, 3, 3, 4, 4, 5, 4, 6, 6, 7, 7, 1],
54
- [1, 0, 2, 1, 3, 2, 4, 3, 5, 4, 6, 4, 7, 6, 1, 7]]), tensor([[0, 0],
55
- [0, 0],
56
- [3, 0],
57
- [3, 0],
58
- [3, 0],
59
- [3, 0],
60
- [3, 0],
61
- [3, 0],
62
- [0, 0],
63
- [0, 0],
64
- [3, 0],
65
- [3, 0],
66
- [3, 0],
67
- [3, 0],
68
- [3, 0],
69
- [3, 0]])), (tensor([[ 7, 0],
70
- [15, 0],
71
- [ 7, 0],
72
- [ 7, 0],
73
- [45, 0],
74
- [ 6, 0],
75
- [ 5, 0],
76
- [ 5, 0],
77
- [ 5, 0],
78
- [ 5, 0],
79
- [ 5, 0],
80
- [ 5, 0],
81
- [ 5, 0],
82
- [ 5, 0],
83
- [ 5, 0],
84
- [ 5, 0],
85
- [ 5, 0],
86
- [ 5, 0],
87
- [ 5, 0],
88
- [ 8, 0],
89
- [ 8, 0],
90
- [ 8, 0]]), tensor([[ 0, 1, 1, 2, 1, 3, 3, 4, 4, 5, 5, 6, 6, 7, 7, 8, 8, 9,
91
- 9, 10, 10, 11, 11, 12, 12, 13, 13, 14, 14, 15, 15, 16, 16, 17, 1, 18,
92
- 18, 19, 18, 20, 18, 21, 17, 4, 11, 6, 17, 12],
93
- [ 1, 0, 2, 1, 3, 1, 4, 3, 5, 4, 6, 5, 7, 6, 8, 7, 9, 8,
94
- 10, 9, 11, 10, 12, 11, 13, 12, 14, 13, 15, 14, 16, 15, 17, 16, 18, 1,
95
- 19, 18, 20, 18, 21, 18, 4, 17, 6, 11, 12, 17]]), tensor([[1, 0],
96
- [1, 0],
97
- [1, 0],
98
- [1, 0],
99
- [0, 0],
100
- [0, 0],
101
- [0, 0],
102
- [0, 0],
103
- [0, 0],
104
- [0, 0],
105
- [0, 0],
106
- [0, 0],
107
- [3, 0],
108
- [3, 0],
109
- [3, 0],
110
- [3, 0],
111
- [3, 0],
112
- [3, 0],
113
- [3, 0],
114
- [3, 0],
115
- [3, 0],
116
- [3, 0],
117
- [0, 0],
118
- [0, 0],
119
- [3, 0],
120
- [3, 0],
121
- [3, 0],
122
- [3, 0],
123
- [3, 0],
124
- [3, 0],
125
- [3, 0],
126
- [3, 0],
127
- [3, 0],
128
- [3, 0],
129
- [0, 0],
130
- [0, 0],
131
- [0, 0],
132
- [0, 0],
133
- [0, 0],
134
- [0, 0],
135
- [0, 0],
136
- [0, 0],
137
- [0, 0],
138
- [0, 0],
139
- [3, 0],
140
- [3, 0],
141
- [3, 0],
142
- [3, 0]])), (tensor([[ 5, 0],
143
- [ 7, 0],
144
- [ 5, 0],
145
- [ 5, 0],
146
- [ 5, 0],
147
- [ 5, 0],
148
- [ 7, 0],
149
- [ 5, 0],
150
- [ 5, 0],
151
- [14, 0],
152
- [ 5, 0],
153
- [ 5, 0],
154
- [ 5, 0],
155
- [ 5, 0],
156
- [ 5, 0],
157
- [ 5, 0],
158
- [ 5, 0],
159
- [ 5, 0],
160
- [ 5, 0],
161
- [ 5, 0],
162
- [ 5, 0],
163
- [ 5, 0],
164
- [ 5, 0],
165
- [ 5, 0],
166
- [ 5, 0],
167
- [ 5, 0],
168
- [ 5, 0],
169
- [ 5, 0],
170
- [ 5, 0],
171
- [ 5, 0],
172
- [ 5, 0],
173
- [ 5, 0],
174
- [ 5, 0],
175
- [ 5, 0],
176
- [ 5, 0],
177
- [ 5, 0],
178
- [ 5, 0],
179
- [ 5, 0],
180
- [ 5, 0],
181
- [ 5, 0],
182
- [ 5, 0],
183
- [ 5, 0],
184
- [ 5, 0],
185
- [ 5, 0],
186
- [ 5, 0],
187
- [ 5, 0]]), tensor([[ 0, 1, 1, 2, 2, 3, 3, 4, 4, 5, 5, 6, 6, 7, 5, 8, 8, 9,
188
- 9, 10, 10, 11, 11, 12, 12, 13, 13, 14, 14, 15, 15, 16, 16, 17, 16, 18,
189
- 14, 19, 9, 20, 20, 21, 21, 22, 22, 23, 23, 24, 24, 25, 25, 26, 26, 27,
190
- 26, 28, 24, 29, 8, 30, 30, 31, 31, 32, 32, 33, 33, 34, 33, 35, 32, 36,
191
- 36, 37, 37, 38, 38, 39, 38, 40, 37, 41, 41, 42, 42, 43, 43, 44, 43, 45,
192
- 30, 2, 42, 31, 18, 10, 28, 20, 19, 10, 29, 20, 17, 12, 27, 22],
193
- [ 1, 0, 2, 1, 3, 2, 4, 3, 5, 4, 6, 5, 7, 6, 8, 5, 9, 8,
194
- 10, 9, 11, 10, 12, 11, 13, 12, 14, 13, 15, 14, 16, 15, 17, 16, 18, 16,
195
- 19, 14, 20, 9, 21, 20, 22, 21, 23, 22, 24, 23, 25, 24, 26, 25, 27, 26,
196
- 28, 26, 29, 24, 30, 8, 31, 30, 32, 31, 33, 32, 34, 33, 35, 33, 36, 32,
197
- 37, 36, 38, 37, 39, 38, 40, 38, 41, 37, 42, 41, 43, 42, 44, 43, 45, 43,
198
- 2, 30, 31, 42, 10, 18, 20, 28, 10, 19, 20, 29, 12, 17, 22, 27]]), tensor([[0, 0],
199
- [0, 0],
200
- [0, 0],
201
- [0, 0],
202
- [3, 0],
203
- [3, 0],
204
- [3, 0],
205
- [3, 0],
206
- [3, 0],
207
- [3, 0],
208
- [0, 0],
209
- [0, 0],
210
- [0, 0],
211
- [0, 0],
212
- [3, 0],
213
- [3, 0],
214
- [0, 0],
215
- [0, 0],
216
- [0, 0],
217
- [0, 0],
218
- [0, 0],
219
- [0, 0],
220
- [0, 0],
221
- [0, 0],
222
- [0, 0],
223
- [0, 0],
224
- [0, 0],
225
- [0, 0],
226
- [0, 0],
227
- [0, 0],
228
- [0, 0],
229
- [0, 0],
230
- [0, 0],
231
- [0, 0],
232
- [0, 0],
233
- [0, 0],
234
- [0, 0],
235
- [0, 0],
236
- [0, 0],
237
- [0, 0],
238
- [0, 0],
239
- [0, 0],
240
- [0, 0],
241
- [0, 0],
242
- [0, 0],
243
- [0, 0],
244
- [0, 0],
245
- [0, 0],
246
- [0, 0],
247
- [0, 0],
248
- [0, 0],
249
- [0, 0],
250
- [0, 0],
251
- [0, 0],
252
- [0, 0],
253
- [0, 0],
254
- [0, 0],
255
- [0, 0],
256
- [3, 0],
257
- [3, 0],
258
- [0, 0],
259
- [0, 0],
260
- [3, 0],
261
- [3, 0],
262
- [0, 0],
263
- [0, 0],
264
- [0, 0],
265
- [0, 0],
266
- [0, 0],
267
- [0, 0],
268
- [3, 0],
269
- [3, 0],
270
- [3, 0],
271
- [3, 0],
272
- [0, 0],
273
- [0, 0],
274
- [0, 0],
275
- [0, 0],
276
- [0, 0],
277
- [0, 0],
278
- [3, 0],
279
- [3, 0],
280
- [3, 0],
281
- [3, 0],
282
- [0, 0],
283
- [0, 0],
284
- [0, 0],
285
- [0, 0],
286
- [0, 0],
287
- [0, 0],
288
- [3, 0],
289
- [3, 0],
290
- [3, 0],
291
- [3, 0],
292
- [0, 0],
293
- [0, 0],
294
- [0, 0],
295
- [0, 0],
296
- [0, 0],
297
- [0, 0],
298
- [0, 0],
299
- [0, 0],
300
- [0, 0],
301
- [0, 0],
302
- [0, 0],
303
- [0, 0]])), (tensor([[ 5, 0],
304
- [ 5, 0],
305
- [ 6, 0],
306
- [14, 0],
307
- [ 6, 0],
308
- [14, 0],
309
- [ 6, 0],
310
- [ 5, 0],
311
- [ 5, 0],
312
- [ 6, 0],
313
- [ 5, 0],
314
- [ 5, 0],
315
- [ 6, 0],
316
- [ 5, 0],
317
- [ 5, 0],
318
- [ 6, 0],
319
- [ 5, 0],
320
- [ 5, 0],
321
- [ 6, 0],
322
- [ 5, 0],
323
- [ 5, 0]]), tensor([[ 0, 1, 1, 2, 2, 3, 3, 4, 4, 5, 5, 6, 6, 7, 6, 8, 5, 9,
324
- 9, 10, 9, 11, 5, 12, 12, 13, 12, 14, 3, 15, 15, 16, 15, 17, 3, 18,
325
- 18, 19, 18, 20],
326
- [ 1, 0, 2, 1, 3, 2, 4, 3, 5, 4, 6, 5, 7, 6, 8, 6, 9, 5,
327
- 10, 9, 11, 9, 12, 5, 13, 12, 14, 12, 15, 3, 16, 15, 17, 15, 18, 3,
328
- 19, 18, 20, 18]]), tensor([[0, 0],
329
- [0, 0],
330
- [0, 0],
331
- [0, 0],
332
- [1, 0],
333
- [1, 0],
334
- [0, 0],
335
- [0, 0],
336
- [1, 0],
337
- [1, 0],
338
- [0, 0],
339
- [0, 0],
340
- [0, 0],
341
- [0, 0],
342
- [0, 0],
343
- [0, 0],
344
- [0, 0],
345
- [0, 0],
346
- [0, 0],
347
- [0, 0],
348
- [0, 0],
349
- [0, 0],
350
- [0, 0],
351
- [0, 0],
352
- [0, 0],
353
- [0, 0],
354
- [0, 0],
355
- [0, 0],
356
- [0, 0],
357
- [0, 0],
358
- [0, 0],
359
- [0, 0],
360
- [0, 0],
361
- [0, 0],
362
- [0, 0],
363
- [0, 0],
364
- [0, 0],
365
- [0, 0],
366
- [0, 0],
367
- [0, 0]])), (tensor([[5, 0],
368
- [5, 0],
369
- [5, 0],
370
- [5, 0],
371
- [6, 0],
372
- [7, 0]]), tensor([[0, 1, 1, 2, 2, 3, 3, 4, 4, 5, 5, 1],
373
- [1, 0, 2, 1, 3, 2, 4, 3, 5, 4, 1, 5]]), tensor([[0, 0],
374
- [0, 0],
375
- [3, 0],
376
- [3, 0],
377
- [3, 0],
378
- [3, 0],
379
- [3, 0],
380
- [3, 0],
381
- [3, 0],
382
- [3, 0],
383
- [3, 0],
384
- [3, 0]])), (tensor([[5, 0],
385
- [5, 0],
386
- [5, 0],
387
- [5, 0],
388
- [5, 0],
389
- [6, 0],
390
- [5, 0],
391
- [5, 0],
392
- [5, 0],
393
- [5, 0],
394
- [6, 0],
395
- [5, 0],
396
- [5, 0],
397
- [5, 0]]), tensor([[ 0, 1, 1, 2, 2, 3, 3, 4, 4, 5, 5, 6, 6, 7, 7, 8, 8, 9,
398
- 9, 10, 10, 11, 4, 12, 12, 13, 13, 1, 11, 6],
399
- [ 1, 0, 2, 1, 3, 2, 4, 3, 5, 4, 6, 5, 7, 6, 8, 7, 9, 8,
400
- 10, 9, 11, 10, 12, 4, 13, 12, 1, 13, 6, 11]]), tensor([[0, 0],
401
- [0, 0],
402
- [3, 0],
403
- [3, 0],
404
- [3, 0],
405
- [3, 0],
406
- [3, 0],
407
- [3, 0],
408
- [0, 0],
409
- [0, 0],
410
- [0, 0],
411
- [0, 0],
412
- [3, 0],
413
- [3, 0],
414
- [3, 0],
415
- [3, 0],
416
- [3, 0],
417
- [3, 0],
418
- [3, 0],
419
- [3, 0],
420
- [3, 0],
421
- [3, 0],
422
- [3, 0],
423
- [3, 0],
424
- [3, 0],
425
- [3, 0],
426
- [3, 0],
427
- [3, 0],
428
- [3, 0],
429
- [3, 0]]))], 'input_ids': tensor([ 1, 518, 25580, 29962, 3532, 14816, 29903, 6778, 13, 3492,
430
- 526, 263, 8950, 391, 29889, 2567, 366, 526, 2183, 263,
431
- 19848, 6306, 29889, 3529, 8500, 278, 1950, 337, 351, 1237,
432
- 310, 278, 19848, 29889, 450, 19848, 6306, 756, 278, 1494,
433
- 3402, 29901, 13, 28956, 13, 8423, 424, 29896, 29889, 8423,
434
- 424, 29906, 29889, 2023, 869, 8423, 424, 29940, 6778, 4704,
435
- 13, 28956, 13, 1576, 736, 995, 881, 367, 297, 3464,
436
- 310, 29871, 29900, 29899, 29896, 29889, 450, 6133, 278, 995,
437
- 29892, 278, 901, 5517, 278, 19848, 338, 304, 6403, 29889,
438
- 29871, 13, 4806, 3867, 278, 3829, 310, 278, 337, 7387,
439
- 29889, 13, 29966, 829, 14816, 29903, 6778, 13, 13, -3996,
440
- -3996, -3996, -3996, -3996, -3996, -3996, 869, -3996, -3996, -3996,
441
- -3996, -3996, -3996, -3996, -3996, 869, -3996, -3996, -3996, -3996,
442
- -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996,
443
- -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, 869, -3996,
444
- -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996,
445
- -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996,
446
- -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996,
447
- -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996,
448
- -3996, -3996, -3996, -3996, -3996, 869, -3996, -3996, -3996, -3996,
449
- -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996,
450
- -3996, -3996, -3996, -3996, -3996, -3996, -3996, 869, -3996, -3996,
451
- -3996, -3996, -3996, -3996, 5099, -3996, -3996, -3996, -3996, -3996,
452
- -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, -3996, 29871,
453
- 5293, 278, 22233, 19848, 2472, 29892, 825, 338, 278, 11959,
454
- 310, 278, 19848, 29915, 29879, 7709, 29973, 518, 29914, 25580,
455
- 29962, 259, 29900, 29889, 29900, 29941, 29953, 29947, 29871, 2]), 'labels': tensor([ 1, -100, -100, -100, -100, -100, -100, -100, -100, -100,
456
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
457
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
458
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
459
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
460
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
461
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
462
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
463
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
464
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
465
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
466
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
467
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
468
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
469
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
470
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
471
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
472
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
473
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
474
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
475
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
476
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
477
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
478
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
479
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
480
- -100, -100, -100, -100, -100, -100, -100, -100, -100, -100,
481
- -100, 259, 29900, 29889, 29900, 29941, 29953, 29947, 29871, 2])}
482
- ```
483
 
484
  ### Training Device(s)
485
 
 
16
 
17
  ### Usage
18
 
19
+ GitHub: https://github.com/IDEA-XL/PRESTO (includes training scripts and basic inference server)
20
 
21
  ### Dataset
22
 
23
  yield (9515 examples)
24
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
25
 
26
  ### Training Device(s)
27