Hugging Face's logo

OpenGVLab
/
InternVL2-8B

Image-Text-to-Text
Transformers
Safetensors
multilingual
internvl_chat
feature-extraction
internvl
custom_code
conversational
Model card Files Community
22
InternVL2-8B / eval_llm_benchmark.log
czczup's picture
czczup
fix compatibility issue for transformers 4.46+
94d38c0 verified
raw
history blame
33.1 kB
/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl_eval/lib/python3.10/site-packages/bitsandbytes/cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
warn("The installed version of bitsandbytes was compiled without GPU support. "
/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl_eval/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cadam32bit_grad_fp32
model path is /mnt/petrelfs/wangweiyun/workspace_cz/InternVL/internvl_chat_dev/share_internvl/InternVL2-8B
09/30 19:08:03 - OpenCompass - WARNING - No previous results to reuse!
09/30 19:08:03 - OpenCompass - INFO - Reusing experiements from 20240930_190803
09/30 19:08:03 - OpenCompass - INFO - Current exp folder: /mnt/petrelfs/wangweiyun/workspace_cz/InternVL/internvl_chat_dev/share_internvl/InternVL2-8B/20240930_190803
09/30 19:08:06 - OpenCompass - INFO - Partitioned into 64 tasks.
[ ] 0/64, elapsed: 0s, ETA: [ ] 1/64, 0.0 task/s, elapsed: 911s, ETA: 57413s [ ] 2/64, 0.0 task/s, elapsed: 1067s, ETA: 33069s [> ] 3/64, 0.0 task/s, elapsed: 1079s, ETA: 21947s [> ] 4/64, 0.0 task/s, elapsed: 1083s, ETA: 16242s [>> ] 5/64, 0.0 task/s, elapsed: 1087s, ETA: 12827s [>> ] 6/64, 0.0 task/s, elapsed: 1112s, ETA: 10746s [>>> ] 7/64, 0.0 task/s, elapsed: 1147s, ETA: 9336s [>>> ] 8/64, 0.0 task/s, elapsed: 1147s, ETA: 8028s [>>>> ] 9/64, 0.0 task/s, elapsed: 1194s, ETA: 7298s [>>>> ] 10/64, 0.0 task/s, elapsed: 1197s, ETA: 6465s [>>>>> ] 11/64, 0.0 task/s, elapsed: 1208s, ETA: 5819s [>>>>> ] 12/64, 0.0 task/s, elapsed: 1218s, ETA: 5278s [>>>>>> ] 13/64, 0.0 task/s, elapsed: 1229s, ETA: 4823s [>>>>>> ] 14/64, 0.0 task/s, elapsed: 1233s, ETA: 4403s [>>>>>>> ] 15/64, 0.0 task/s, elapsed: 1251s, ETA: 4086s [>>>>>>> ] 16/64, 0.0 task/s, elapsed: 1252s, ETA: 3755s [>>>>>>> ] 17/64, 0.0 task/s, elapsed: 1261s, ETA: 3485s [>>>>>>>> ] 18/64, 0.0 task/s, elapsed: 1262s, ETA: 3225s [>>>>>>>> ] 19/64, 0.0 task/s, elapsed: 1266s, ETA: 2998s [>>>>>>>>> ] 20/64, 0.0 task/s, elapsed: 1267s, ETA: 2787s [>>>>>>>>> ] 21/64, 0.0 task/s, elapsed: 1272s, ETA: 2604s [>>>>>>>>>> ] 22/64, 0.0 task/s, elapsed: 1275s, ETA: 2433s [>>>>>>>>>> ] 23/64, 0.0 task/s, elapsed: 1288s, ETA: 2296s [>>>>>>>>>>> ] 24/64, 0.0 task/s, elapsed: 1292s, ETA: 2153s [>>>>>>>>>>> ] 25/64, 0.0 task/s, elapsed: 1301s, ETA: 2029s [>>>>>>>>>>>> ] 26/64, 0.0 task/s, elapsed: 1312s, ETA: 1917s [>>>>>>>>>>>> ] 27/64, 0.0 task/s, elapsed: 1312s, ETA: 1798s [>>>>>>>>>>>>> ] 28/64, 0.0 task/s, elapsed: 1317s, ETA: 1694s [>>>>>>>>>>>>> ] 29/64, 0.0 task/s, elapsed: 1333s, ETA: 1608s [>>>>>>>>>>>>>> ] 30/64, 0.0 task/s, elapsed: 1337s, ETA: 1515s [>>>>>>>>>>>>>> ] 31/64, 0.0 task/s, elapsed: 1347s, ETA: 1434s [>>>>>>>>>>>>>>> ] 32/64, 0.0 task/s, elapsed: 1354s, ETA: 1354s [>>>>>>>>>>>>>>> ] 33/64, 0.0 task/s, elapsed: 1365s, ETA: 1282s [>>>>>>>>>>>>>>> ] 34/64, 0.0 task/s, elapsed: 1366s, ETA: 1205s [>>>>>>>>>>>>>>>> ] 35/64, 0.0 task/s, elapsed: 1372s, ETA: 1137s [>>>>>>>>>>>>>>>> ] 36/64, 0.0 task/s, elapsed: 1376s, ETA: 1070s [>>>>>>>>>>>>>>>>> ] 37/64, 0.0 task/s, elapsed: 1397s, ETA: 1019s [>>>>>>>>>>>>>>>>> ] 38/64, 0.0 task/s, elapsed: 1397s, ETA: 956s [>>>>>>>>>>>>>>>>>> ] 39/64, 0.0 task/s, elapsed: 1402s, ETA: 899s [>>>>>>>>>>>>>>>>>> ] 40/64, 0.0 task/s, elapsed: 1416s, ETA: 849s [>>>>>>>>>>>>>>>>>>> ] 41/64, 0.0 task/s, elapsed: 1442s, ETA: 809s [>>>>>>>>>>>>>>>>>>> ] 42/64, 0.0 task/s, elapsed: 1458s, ETA: 764s [>>>>>>>>>>>>>>>>>>>> ] 43/64, 0.0 task/s, elapsed: 1468s, ETA: 717s [>>>>>>>>>>>>>>>>>>>> ] 44/64, 0.0 task/s, elapsed: 1476s, ETA: 671s [>>>>>>>>>>>>>>>>>>>>> ] 45/64, 0.0 task/s, elapsed: 1512s, ETA: 638s [>>>>>>>>>>>>>>>>>>>>> ] 46/64, 0.0 task/s, elapsed: 1550s, ETA: 606s [>>>>>>>>>>>>>>>>>>>>>> ] 47/64, 0.0 task/s, elapsed: 1567s, ETA: 567s [>>>>>>>>>>>>>>>>>>>>>> ] 48/64, 0.0 task/s, elapsed: 1583s, ETA: 528s [>>>>>>>>>>>>>>>>>>>>>> ] 49/64, 0.0 task/s, elapsed: 1607s, ETA: 492s [>>>>>>>>>>>>>>>>>>>>>>> ] 50/64, 0.0 task/s, elapsed: 1635s, ETA: 458s [>>>>>>>>>>>>>>>>>>>>>>> ] 51/64, 0.0 task/s, elapsed: 1637s, ETA: 417s [>>>>>>>>>>>>>>>>>>>>>>>> ] 52/64, 0.0 task/s, elapsed: 1658s, ETA: 383s [>>>>>>>>>>>>>>>>>>>>>>>> ] 53/64, 0.0 task/s, elapsed: 1668s, ETA: 346s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 54/64, 0.0 task/s, elapsed: 1681s, ETA: 311s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 55/64, 0.0 task/s, elapsed: 1762s, ETA: 288s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 56/64, 0.0 task/s, elapsed: 1792s, ETA: 256s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 57/64, 0.0 task/s, elapsed: 2211s, ETA: 271s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 58/64, 0.0 task/s, elapsed: 2216s, ETA: 229s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 59/64, 0.0 task/s, elapsed: 2306s, ETA: 195s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 60/64, 0.0 task/s, elapsed: 2422s, ETA: 161s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 61/64, 0.0 task/s, elapsed: 2551s, ETA: 125s [>>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 62/64, 0.0 task/s, elapsed: 2596s, ETA: 84s [>>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 63/64, 0.0 task/s, elapsed: 2643s, ETA: 42s [>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>] 64/64, 0.0 task/s, elapsed: 2665s, ETA: 0s
09/30 19:52:33 - OpenCompass - INFO - Partitioned into 287 tasks.
[ ] 0/287, elapsed: 0s, ETA: [ ] 1/287, 0.0 task/s, elapsed: 31s, ETA: 8982s [ ] 2/287, 0.1 task/s, elapsed: 31s, ETA: 4487s [ ] 3/287, 0.1 task/s, elapsed: 32s, ETA: 2983s [ ] 4/287, 0.1 task/s, elapsed: 32s, ETA: 2232s [ ] 5/287, 0.2 task/s, elapsed: 32s, ETA: 1780s [ ] 6/287, 0.2 task/s, elapsed: 32s, ETA: 1480s [ ] 7/287, 0.2 task/s, elapsed: 32s, ETA: 1265s [ ] 8/287, 0.3 task/s, elapsed: 32s, ETA: 1103s [> ] 9/287, 0.3 task/s, elapsed: 32s, ETA: 977s [> ] 10/287, 0.3 task/s, elapsed: 32s, ETA: 877s [> ] 11/287, 0.3 task/s, elapsed: 32s, ETA: 794s [> ] 12/287, 0.4 task/s, elapsed: 32s, ETA: 725s [> ] 13/287, 0.4 task/s, elapsed: 32s, ETA: 669s [> ] 14/287, 0.4 task/s, elapsed: 32s, ETA: 619s [> ] 15/287, 0.5 task/s, elapsed: 32s, ETA: 576s [> ] 16/287, 0.5 task/s, elapsed: 32s, ETA: 540s [> ] 17/287, 0.5 task/s, elapsed: 32s, ETA: 506s [> ] 18/287, 0.6 task/s, elapsed: 32s, ETA: 479s [>> ] 19/287, 0.6 task/s, elapsed: 32s, ETA: 453s [>> ] 20/287, 0.6 task/s, elapsed: 32s, ETA: 429s [>> ] 21/287, 0.7 task/s, elapsed: 32s, ETA: 407s [>> ] 22/287, 0.7 task/s, elapsed: 32s, ETA: 388s [>> ] 23/287, 0.7 task/s, elapsed: 32s, ETA: 370s [>> ] 24/287, 0.7 task/s, elapsed: 32s, ETA: 353s [>> ] 25/287, 0.8 task/s, elapsed: 32s, ETA: 338s [>> ] 26/287, 0.8 task/s, elapsed: 32s, ETA: 325s [>> ] 27/287, 0.8 task/s, elapsed: 32s, ETA: 312s [>>> ] 28/287, 0.9 task/s, elapsed: 32s, ETA: 299s [>>> ] 29/287, 0.9 task/s, elapsed: 32s, ETA: 288s [>>> ] 30/287, 0.9 task/s, elapsed: 32s, ETA: 278s [>>> ] 31/287, 1.0 task/s, elapsed: 32s, ETA: 268s [>>> ] 32/287, 1.0 task/s, elapsed: 32s, ETA: 259s [>>> ] 33/287, 1.0 task/s, elapsed: 32s, ETA: 250s [>>> ] 34/287, 1.0 task/s, elapsed: 33s, ETA: 242s [>>> ] 35/287, 1.1 task/s, elapsed: 33s, ETA: 235s [>>> ] 36/287, 1.1 task/s, elapsed: 33s, ETA: 227s [>>> ] 37/287, 1.1 task/s, elapsed: 33s, ETA: 220s [>>>> ] 38/287, 1.2 task/s, elapsed: 33s, ETA: 214s [>>>> ] 39/287, 1.2 task/s, elapsed: 33s, ETA: 207s [>>>> ] 40/287, 1.2 task/s, elapsed: 33s, ETA: 202s [>>>> ] 41/287, 1.3 task/s, elapsed: 33s, ETA: 196s [>>>> ] 42/287, 1.3 task/s, elapsed: 33s, ETA: 191s [>>>> ] 43/287, 1.3 task/s, elapsed: 33s, ETA: 185s [>>>> ] 44/287, 1.3 task/s, elapsed: 33s, ETA: 181s [>>>> ] 45/287, 1.4 task/s, elapsed: 33s, ETA: 176s [>>>> ] 46/287, 1.4 task/s, elapsed: 33s, ETA: 171s [>>>>> ] 47/287, 1.4 task/s, elapsed: 33s, ETA: 167s [>>>>> ] 48/287, 1.5 task/s, elapsed: 33s, ETA: 163s [>>>>> ] 49/287, 1.5 task/s, elapsed: 33s, ETA: 159s [>>>>> ] 50/287, 1.5 task/s, elapsed: 33s, ETA: 155s [>>>>> ] 51/287, 1.6 task/s, elapsed: 33s, ETA: 152s [>>>>> ] 52/287, 1.6 task/s, elapsed: 33s, ETA: 148s [>>>>> ] 53/287, 1.6 task/s, elapsed: 33s, ETA: 145s [>>>>> ] 54/287, 1.6 task/s, elapsed: 33s, ETA: 143s [>>>>> ] 55/287, 1.7 task/s, elapsed: 33s, ETA: 140s [>>>>>> ] 56/287, 1.7 task/s, elapsed: 33s, ETA: 137s [>>>>>> ] 57/287, 1.7 task/s, elapsed: 33s, ETA: 134s [>>>>>> ] 58/287, 1.7 task/s, elapsed: 33s, ETA: 131s [>>>>>> ] 59/287, 1.8 task/s, elapsed: 33s, ETA: 129s [>>>>>> ] 60/287, 1.8 task/s, elapsed: 33s, ETA: 126s [>>>>>> ] 61/287, 1.8 task/s, elapsed: 33s, ETA: 124s [>>>>>> ] 62/287, 1.9 task/s, elapsed: 33s, ETA: 121s [>>>>>> ] 63/287, 1.9 task/s, elapsed: 33s, ETA: 119s [>>>>>> ] 64/287, 1.9 task/s, elapsed: 34s, ETA: 117s [>>>>>>> ] 65/287, 1.1 task/s, elapsed: 58s, ETA: 198s [>>>>>>> ] 66/287, 1.1 task/s, elapsed: 58s, ETA: 194s [>>>>>>> ] 67/287, 1.2 task/s, elapsed: 58s, ETA: 190s [>>>>>>> ] 68/287, 1.2 task/s, elapsed: 58s, ETA: 187s [>>>>>>> ] 69/287, 1.2 task/s, elapsed: 58s, ETA: 183s [>>>>>>> ] 70/287, 1.2 task/s, elapsed: 58s, ETA: 180s [>>>>>>> ] 71/287, 1.2 task/s, elapsed: 58s, ETA: 176s [>>>>>>> ] 72/287, 1.2 task/s, elapsed: 58s, ETA: 173s [>>>>>>> ] 73/287, 1.3 task/s, elapsed: 58s, ETA: 170s [>>>>>>> ] 74/287, 1.3 task/s, elapsed: 58s, ETA: 167s [>>>>>>>> ] 75/287, 1.3 task/s, elapsed: 58s, ETA: 164s [>>>>>>>> ] 76/287, 1.3 task/s, elapsed: 58s, ETA: 161s [>>>>>>>> ] 77/287, 1.3 task/s, elapsed: 58s, ETA: 158s [>>>>>>>> ] 78/287, 1.3 task/s, elapsed: 58s, ETA: 155s [>>>>>>>> ] 79/287, 1.4 task/s, elapsed: 58s, ETA: 153s [>>>>>>>> ] 80/287, 1.4 task/s, elapsed: 58s, ETA: 151s [>>>>>>>> ] 81/287, 1.4 task/s, elapsed: 58s, ETA: 149s [>>>>>>>> ] 82/287, 1.4 task/s, elapsed: 59s, ETA: 149s [>>>>>>>> ] 83/287, 1.4 task/s, elapsed: 59s, ETA: 146s [>>>>>>>>> ] 84/287, 1.4 task/s, elapsed: 59s, ETA: 144s [>>>>>>>>> ] 85/287, 1.4 task/s, elapsed: 60s, ETA: 142s [>>>>>>>>> ] 86/287, 1.4 task/s, elapsed: 62s, ETA: 144s [>>>>>>>>> ] 87/287, 1.4 task/s, elapsed: 62s, ETA: 141s [>>>>>>>>> ] 88/287, 1.4 task/s, elapsed: 62s, ETA: 139s [>>>>>>>>> ] 89/287, 1.4 task/s, elapsed: 62s, ETA: 137s [>>>>>>>>> ] 90/287, 1.5 task/s, elapsed: 62s, ETA: 135s [>>>>>>>>> ] 91/287, 1.5 task/s, elapsed: 62s, ETA: 133s [>>>>>>>>> ] 92/287, 1.5 task/s, elapsed: 62s, ETA: 131s [>>>>>>>>>> ] 93/287, 1.5 task/s, elapsed: 62s, ETA: 129s [>>>>>>>>>> ] 94/287, 1.5 task/s, elapsed: 62s, ETA: 127s [>>>>>>>>>> ] 95/287, 1.5 task/s, elapsed: 62s, ETA: 125s [>>>>>>>>>> ] 96/287, 1.5 task/s, elapsed: 62s, ETA: 123s [>>>>>>>>>> ] 97/287, 1.6 task/s, elapsed: 62s, ETA: 122s [>>>>>>>>>> ] 98/287, 1.6 task/s, elapsed: 62s, ETA: 120s [>>>>>>>>>> ] 99/287, 1.6 task/s, elapsed: 62s, ETA: 118s [>>>>>>>>>> ] 100/287, 1.6 task/s, elapsed: 62s, ETA: 117s [>>>>>>>>>> ] 101/287, 1.6 task/s, elapsed: 63s, ETA: 116s [>>>>>>>>>> ] 102/287, 1.6 task/s, elapsed: 63s, ETA: 115s [>>>>>>>>>> ] 103/287, 1.6 task/s, elapsed: 63s, ETA: 113s [>>>>>>>>>> ] 104/287, 1.6 task/s, elapsed: 63s, ETA: 112s [>>>>>>>>>> ] 105/287, 1.7 task/s, elapsed: 64s, ETA: 110s [>>>>>>>>>>> ] 106/287, 1.7 task/s, elapsed: 64s, ETA: 108s [>>>>>>>>>>> ] 107/287, 1.7 task/s, elapsed: 64s, ETA: 107s [>>>>>>>>>>> ] 108/287, 1.7 task/s, elapsed: 64s, ETA: 106s [>>>>>>>>>>> ] 109/287, 1.7 task/s, elapsed: 64s, ETA: 104s [>>>>>>>>>>> ] 110/287, 1.7 task/s, elapsed: 64s, ETA: 103s [>>>>>>>>>>> ] 111/287, 1.7 task/s, elapsed: 64s, ETA: 101s [>>>>>>>>>>> ] 112/287, 1.7 task/s, elapsed: 64s, ETA: 100s [>>>>>>>>>>> ] 113/287, 1.8 task/s, elapsed: 64s, ETA: 99s [>>>>>>>>>>> ] 114/287, 1.8 task/s, elapsed: 64s, ETA: 97s [>>>>>>>>>>>> ] 115/287, 1.8 task/s, elapsed: 65s, ETA: 97s [>>>>>>>>>>>> ] 116/287, 1.8 task/s, elapsed: 65s, ETA: 95s [>>>>>>>>>>>> ] 117/287, 1.8 task/s, elapsed: 65s, ETA: 94s [>>>>>>>>>>>> ] 118/287, 1.8 task/s, elapsed: 65s, ETA: 93s [>>>>>>>>>>>> ] 119/287, 1.8 task/s, elapsed: 65s, ETA: 92s [>>>>>>>>>>>> ] 120/287, 1.8 task/s, elapsed: 65s, ETA: 91s [>>>>>>>>>>>> ] 121/287, 1.9 task/s, elapsed: 65s, ETA: 90s [>>>>>>>>>>>> ] 122/287, 1.9 task/s, elapsed: 65s, ETA: 88s [>>>>>>>>>>>> ] 123/287, 1.9 task/s, elapsed: 66s, ETA: 87s [>>>>>>>>>>>> ] 124/287, 1.9 task/s, elapsed: 66s, ETA: 86s [>>>>>>>>>>>>> ] 125/287, 1.9 task/s, elapsed: 66s, ETA: 85s [>>>>>>>>>>>>> ] 126/287, 1.9 task/s, elapsed: 66s, ETA: 84s [>>>>>>>>>>>>> ] 127/287, 1.9 task/s, elapsed: 66s, ETA: 83s [>>>>>>>>>>>>> ] 128/287, 1.9 task/s, elapsed: 66s, ETA: 82s [>>>>>>>>>>>>> ] 129/287, 1.7 task/s, elapsed: 78s, ETA: 96s [>>>>>>>>>>>>> ] 130/287, 1.6 task/s, elapsed: 81s, ETA: 98s [>>>>>>>>>>>>> ] 131/287, 1.6 task/s, elapsed: 82s, ETA: 97s [>>>>>>>>>>>>> ] 132/287, 1.6 task/s, elapsed: 83s, ETA: 97s [>>>>>>>>>>>>> ] 133/287, 1.6 task/s, elapsed: 83s, ETA: 96s [>>>>>>>>>>>>>> ] 134/287, 1.6 task/s, elapsed: 86s, ETA: 98s [>>>>>>>>>>>>>> ] 135/287, 1.6 task/s, elapsed: 86s, ETA: 97s [>>>>>>>>>>>>>> ] 136/287, 1.6 task/s, elapsed: 86s, ETA: 95s [>>>>>>>>>>>>>> ] 137/287, 1.6 task/s, elapsed: 86s, ETA: 94s [>>>>>>>>>>>>>> ] 138/287, 1.6 task/s, elapsed: 86s, ETA: 93s [>>>>>>>>>>>>>> ] 139/287, 1.6 task/s, elapsed: 86s, ETA: 92s [>>>>>>>>>>>>>> ] 140/287, 1.6 task/s, elapsed: 86s, ETA: 91s [>>>>>>>>>>>>>> ] 141/287, 1.6 task/s, elapsed: 87s, ETA: 90s [>>>>>>>>>>>>>> ] 142/287, 1.6 task/s, elapsed: 87s, ETA: 88s [>>>>>>>>>>>>>> ] 143/287, 1.7 task/s, elapsed: 87s, ETA: 87s [>>>>>>>>>>>>>>> ] 144/287, 1.6 task/s, elapsed: 87s, ETA: 87s [>>>>>>>>>>>>>>> ] 145/287, 1.7 task/s, elapsed: 88s, ETA: 86s [>>>>>>>>>>>>>>> ] 146/287, 1.7 task/s, elapsed: 88s, ETA: 85s [>>>>>>>>>>>>>>> ] 147/287, 1.6 task/s, elapsed: 90s, ETA: 85s [>>>>>>>>>>>>>>> ] 148/287, 1.6 task/s, elapsed: 91s, ETA: 85s [>>>>>>>>>>>>>>> ] 149/287, 1.6 task/s, elapsed: 91s, ETA: 84s [>>>>>>>>>>>>>>> ] 150/287, 1.7 task/s, elapsed: 91s, ETA: 83s [>>>>>>>>>>>>>>> ] 151/287, 1.7 task/s, elapsed: 91s, ETA: 82s [>>>>>>>>>>>>>>> ] 152/287, 1.7 task/s, elapsed: 91s, ETA: 81s [>>>>>>>>>>>>>>> ] 153/287, 1.7 task/s, elapsed: 92s, ETA: 80s [>>>>>>>>>>>>>>>> ] 154/287, 1.7 task/s, elapsed: 92s, ETA: 79s [>>>>>>>>>>>>>>>> ] 155/287, 1.7 task/s, elapsed: 92s, ETA: 79s [>>>>>>>>>>>>>>>> ] 156/287, 1.7 task/s, elapsed: 93s, ETA: 78s [>>>>>>>>>>>>>>>> ] 157/287, 1.7 task/s, elapsed: 93s, ETA: 77s [>>>>>>>>>>>>>>>> ] 158/287, 1.7 task/s, elapsed: 93s, ETA: 76s [>>>>>>>>>>>>>>>> ] 159/287, 1.7 task/s, elapsed: 93s, ETA: 75s [>>>>>>>>>>>>>>>> ] 160/287, 1.7 task/s, elapsed: 93s, ETA: 74s [>>>>>>>>>>>>>>>> ] 161/287, 1.7 task/s, elapsed: 93s, ETA: 73s [>>>>>>>>>>>>>>>> ] 162/287, 1.7 task/s, elapsed: 93s, ETA: 72s [>>>>>>>>>>>>>>>>> ] 163/287, 1.7 task/s, elapsed: 93s, ETA: 71s [>>>>>>>>>>>>>>>>> ] 164/287, 1.8 task/s, elapsed: 93s, ETA: 70s [>>>>>>>>>>>>>>>>> ] 165/287, 1.8 task/s, elapsed: 93s, ETA: 69s [>>>>>>>>>>>>>>>>> ] 166/287, 1.8 task/s, elapsed: 93s, ETA: 68s [>>>>>>>>>>>>>>>>> ] 167/287, 1.8 task/s, elapsed: 93s, ETA: 67s [>>>>>>>>>>>>>>>>> ] 168/287, 1.8 task/s, elapsed: 94s, ETA: 66s [>>>>>>>>>>>>>>>>> ] 169/287, 1.8 task/s, elapsed: 94s, ETA: 65s [>>>>>>>>>>>>>>>>> ] 170/287, 1.8 task/s, elapsed: 94s, ETA: 64s [>>>>>>>>>>>>>>>>> ] 171/287, 1.8 task/s, elapsed: 94s, ETA: 64s [>>>>>>>>>>>>>>>>> ] 172/287, 1.8 task/s, elapsed: 94s, ETA: 63s [>>>>>>>>>>>>>>>>>> ] 173/287, 1.8 task/s, elapsed: 94s, ETA: 62s [>>>>>>>>>>>>>>>>>> ] 174/287, 1.9 task/s, elapsed: 94s, ETA: 61s [>>>>>>>>>>>>>>>>>> ] 175/287, 1.9 task/s, elapsed: 94s, ETA: 60s [>>>>>>>>>>>>>>>>>> ] 176/287, 1.9 task/s, elapsed: 94s, ETA: 59s [>>>>>>>>>>>>>>>>>> ] 177/287, 1.9 task/s, elapsed: 94s, ETA: 59s [>>>>>>>>>>>>>>>>>> ] 178/287, 1.9 task/s, elapsed: 95s, ETA: 58s [>>>>>>>>>>>>>>>>>> ] 179/287, 1.9 task/s, elapsed: 95s, ETA: 57s [>>>>>>>>>>>>>>>>>> ] 180/287, 1.9 task/s, elapsed: 95s, ETA: 57s [>>>>>>>>>>>>>>>>>> ] 181/287, 1.9 task/s, elapsed: 95s, ETA: 56s [>>>>>>>>>>>>>>>>>>> ] 182/287, 1.9 task/s, elapsed: 96s, ETA: 55s [>>>>>>>>>>>>>>>>>>> ] 183/287, 1.9 task/s, elapsed: 96s, ETA: 54s [>>>>>>>>>>>>>>>>>>> ] 184/287, 1.9 task/s, elapsed: 96s, ETA: 54s [>>>>>>>>>>>>>>>>>>> ] 185/287, 1.9 task/s, elapsed: 97s, ETA: 53s [>>>>>>>>>>>>>>>>>>> ] 186/287, 1.9 task/s, elapsed: 97s, ETA: 53s [>>>>>>>>>>>>>>>>>>> ] 187/287, 1.9 task/s, elapsed: 97s, ETA: 52s [>>>>>>>>>>>>>>>>>>> ] 188/287, 1.9 task/s, elapsed: 97s, ETA: 51s [>>>>>>>>>>>>>>>>>>> ] 189/287, 1.9 task/s, elapsed: 97s, ETA: 50s [>>>>>>>>>>>>>>>>>>> ] 190/287, 1.9 task/s, elapsed: 98s, ETA: 50s [>>>>>>>>>>>>>>>>>>> ] 191/287, 1.9 task/s, elapsed: 98s, ETA: 49s [>>>>>>>>>>>>>>>>>>>> ] 192/287, 2.0 task/s, elapsed: 98s, ETA: 49s [>>>>>>>>>>>>>>>>>>> ] 193/287, 1.9 task/s, elapsed: 103s, ETA: 50s [>>>>>>>>>>>>>>>>>>> ] 194/287, 1.8 task/s, elapsed: 106s, ETA: 51s [>>>>>>>>>>>>>>>>>>> ] 195/287, 1.8 task/s, elapsed: 109s, ETA: 51s [>>>>>>>>>>>>>>>>>>> ] 196/287, 1.8 task/s, elapsed: 109s, ETA: 51s [>>>>>>>>>>>>>>>>>>> ] 197/287, 1.8 task/s, elapsed: 109s, ETA: 50s [>>>>>>>>>>>>>>>>>>>> ] 198/287, 1.8 task/s, elapsed: 109s, ETA: 49s [>>>>>>>>>>>>>>>>>>>> ] 199/287, 1.8 task/s, elapsed: 109s, ETA: 48s [>>>>>>>>>>>>>>>>>>>> ] 200/287, 1.8 task/s, elapsed: 110s, ETA: 48s [>>>>>>>>>>>>>>>>>>>> ] 201/287, 1.8 task/s, elapsed: 110s, ETA: 47s [>>>>>>>>>>>>>>>>>>>> ] 202/287, 1.8 task/s, elapsed: 111s, ETA: 47s [>>>>>>>>>>>>>>>>>>>> ] 203/287, 1.8 task/s, elapsed: 114s, ETA: 47s [>>>>>>>>>>>>>>>>>>>> ] 204/287, 1.8 task/s, elapsed: 114s, ETA: 46s [>>>>>>>>>>>>>>>>>>>> ] 205/287, 1.8 task/s, elapsed: 114s, ETA: 46s [>>>>>>>>>>>>>>>>>>>> ] 206/287, 1.8 task/s, elapsed: 115s, ETA: 45s [>>>>>>>>>>>>>>>>>>>> ] 207/287, 1.8 task/s, elapsed: 116s, ETA: 45s [>>>>>>>>>>>>>>>>>>>>> ] 208/287, 1.8 task/s, elapsed: 116s, ETA: 44s [>>>>>>>>>>>>>>>>>>>>> ] 209/287, 1.8 task/s, elapsed: 117s, ETA: 43s [>>>>>>>>>>>>>>>>>>>>> ] 210/287, 1.8 task/s, elapsed: 117s, ETA: 43s [>>>>>>>>>>>>>>>>>>>>> ] 211/287, 1.8 task/s, elapsed: 117s, ETA: 42s [>>>>>>>>>>>>>>>>>>>>> ] 212/287, 1.8 task/s, elapsed: 117s, ETA: 41s [>>>>>>>>>>>>>>>>>>>>> ] 213/287, 1.8 task/s, elapsed: 117s, ETA: 41s [>>>>>>>>>>>>>>>>>>>>> ] 214/287, 1.8 task/s, elapsed: 118s, ETA: 40s [>>>>>>>>>>>>>>>>>>>>> ] 215/287, 1.8 task/s, elapsed: 118s, ETA: 39s [>>>>>>>>>>>>>>>>>>>>> ] 216/287, 1.8 task/s, elapsed: 118s, ETA: 39s [>>>>>>>>>>>>>>>>>>>>> ] 217/287, 1.8 task/s, elapsed: 118s, ETA: 38s [>>>>>>>>>>>>>>>>>>>>>> ] 218/287, 1.8 task/s, elapsed: 118s, ETA: 37s [>>>>>>>>>>>>>>>>>>>>>> ] 219/287, 1.9 task/s, elapsed: 118s, ETA: 37s [>>>>>>>>>>>>>>>>>>>>>> ] 220/287, 1.9 task/s, elapsed: 118s, ETA: 36s [>>>>>>>>>>>>>>>>>>>>>> ] 221/287, 1.9 task/s, elapsed: 119s, ETA: 36s [>>>>>>>>>>>>>>>>>>>>>> ] 222/287, 1.9 task/s, elapsed: 119s, ETA: 35s [>>>>>>>>>>>>>>>>>>>>>> ] 223/287, 1.9 task/s, elapsed: 119s, ETA: 34s [>>>>>>>>>>>>>>>>>>>>>> ] 224/287, 1.9 task/s, elapsed: 120s, ETA: 34s [>>>>>>>>>>>>>>>>>>>>>> ] 225/287, 1.9 task/s, elapsed: 120s, ETA: 33s [>>>>>>>>>>>>>>>>>>>>>> ] 226/287, 1.9 task/s, elapsed: 120s, ETA: 32s [>>>>>>>>>>>>>>>>>>>>>> ] 227/287, 1.9 task/s, elapsed: 121s, ETA: 32s [>>>>>>>>>>>>>>>>>>>>>>> ] 228/287, 1.9 task/s, elapsed: 121s, ETA: 31s [>>>>>>>>>>>>>>>>>>>>>>> ] 229/287, 1.9 task/s, elapsed: 122s, ETA: 31s [>>>>>>>>>>>>>>>>>>>>>>> ] 230/287, 1.9 task/s, elapsed: 122s, ETA: 30s [>>>>>>>>>>>>>>>>>>>>>>> ] 231/287, 1.9 task/s, elapsed: 122s, ETA: 30s [>>>>>>>>>>>>>>>>>>>>>>> ] 232/287, 1.9 task/s, elapsed: 122s, ETA: 29s [>>>>>>>>>>>>>>>>>>>>>>> ] 233/287, 1.9 task/s, elapsed: 122s, ETA: 28s [>>>>>>>>>>>>>>>>>>>>>>> ] 234/287, 1.9 task/s, elapsed: 122s, ETA: 28s [>>>>>>>>>>>>>>>>>>>>>>> ] 235/287, 1.9 task/s, elapsed: 123s, ETA: 27s [>>>>>>>>>>>>>>>>>>>>>>> ] 236/287, 1.9 task/s, elapsed: 123s, ETA: 27s [>>>>>>>>>>>>>>>>>>>>>>> ] 237/287, 1.9 task/s, elapsed: 123s, ETA: 26s [>>>>>>>>>>>>>>>>>>>>>>>> ] 238/287, 1.9 task/s, elapsed: 123s, ETA: 25s [>>>>>>>>>>>>>>>>>>>>>>>> ] 239/287, 1.9 task/s, elapsed: 123s, ETA: 25s [>>>>>>>>>>>>>>>>>>>>>>>> ] 240/287, 1.9 task/s, elapsed: 124s, ETA: 24s [>>>>>>>>>>>>>>>>>>>>>>>> ] 241/287, 2.0 task/s, elapsed: 124s, ETA: 24s [>>>>>>>>>>>>>>>>>>>>>>>> ] 242/287, 2.0 task/s, elapsed: 124s, ETA: 23s [>>>>>>>>>>>>>>>>>>>>>>>> ] 243/287, 2.0 task/s, elapsed: 124s, ETA: 23s [>>>>>>>>>>>>>>>>>>>>>>>> ] 244/287, 2.0 task/s, elapsed: 125s, ETA: 22s [>>>>>>>>>>>>>>>>>>>>>>>> ] 245/287, 2.0 task/s, elapsed: 125s, ETA: 21s [>>>>>>>>>>>>>>>>>>>>>>>> ] 246/287, 2.0 task/s, elapsed: 125s, ETA: 21s [>>>>>>>>>>>>>>>>>>>>>>>> ] 247/287, 2.0 task/s, elapsed: 126s, ETA: 20s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 248/287, 2.0 task/s, elapsed: 126s, ETA: 20s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 249/287, 2.0 task/s, elapsed: 126s, ETA: 19s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 250/287, 2.0 task/s, elapsed: 127s, ETA: 19s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 251/287, 2.0 task/s, elapsed: 127s, ETA: 18s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 252/287, 2.0 task/s, elapsed: 127s, ETA: 18s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 253/287, 2.0 task/s, elapsed: 127s, ETA: 17s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 254/287, 2.0 task/s, elapsed: 127s, ETA: 17s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 255/287, 2.0 task/s, elapsed: 128s, ETA: 16s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 256/287, 2.0 task/s, elapsed: 129s, ETA: 16s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 257/287, 2.0 task/s, elapsed: 130s, ETA: 15s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 258/287, 2.0 task/s, elapsed: 131s, ETA: 15s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 259/287, 2.0 task/s, elapsed: 132s, ETA: 14s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 260/287, 2.0 task/s, elapsed: 132s, ETA: 14s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 261/287, 2.0 task/s, elapsed: 132s, ETA: 13s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 262/287, 2.0 task/s, elapsed: 133s, ETA: 13s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 263/287, 2.0 task/s, elapsed: 134s, ETA: 12s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 264/287, 2.0 task/s, elapsed: 134s, ETA: 12s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 265/287, 2.0 task/s, elapsed: 134s, ETA: 11s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 266/287, 2.0 task/s, elapsed: 134s, ETA: 11s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 267/287, 2.0 task/s, elapsed: 134s, ETA: 10s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 268/287, 2.0 task/s, elapsed: 135s, ETA: 10s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 269/287, 2.0 task/s, elapsed: 137s, ETA: 9s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 270/287, 2.0 task/s, elapsed: 137s, ETA: 9s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 271/287, 2.0 task/s, elapsed: 137s, ETA: 8s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 272/287, 2.0 task/s, elapsed: 138s, ETA: 8s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 273/287, 2.0 task/s, elapsed: 138s, ETA: 7s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 274/287, 2.0 task/s, elapsed: 139s, ETA: 7s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 275/287, 2.0 task/s, elapsed: 139s, ETA: 6s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 276/287, 2.0 task/s, elapsed: 140s, ETA: 6s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 277/287, 2.0 task/s, elapsed: 140s, ETA: 5s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 278/287, 2.0 task/s, elapsed: 141s, ETA: 5s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 279/287, 2.0 task/s, elapsed: 141s, ETA: 4s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 280/287, 2.0 task/s, elapsed: 142s, ETA: 4s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 281/287, 2.0 task/s, elapsed: 142s, ETA: 3s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 282/287, 2.0 task/s, elapsed: 143s, ETA: 3s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 283/287, 2.0 task/s, elapsed: 143s, ETA: 2s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 284/287, 2.0 task/s, elapsed: 145s, ETA: 2s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 285/287, 1.9 task/s, elapsed: 147s, ETA: 1s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 286/287, 1.8 task/s, elapsed: 159s, ETA: 1s [>>>>>>>>>>>>>>>>>>>>>>>>>>>>>] 287/287, 1.8 task/s, elapsed: 160s, ETA: 0s
dataset version metric mode internvl-chat-20b
---------------------------- --------- ---------------------------- ------ -------------------
mmlu - naive_average gen 73.17
cmmlu - naive_average gen 79.21
ceval - naive_average gen 80.14
agieval - - - -
GaokaoBench - weighted_average gen 74.99
triviaqa 2121ce score gen 62.03
triviaqa_wiki_1shot - - - -
nq 3dcea1 score gen 28.12
C3 8c358f accuracy gen 94.19
race-high 9a54b6 accuracy gen 90.82
flores_100 - - - -
winogrande b36770 accuracy gen 85.87
hellaswag e42710 accuracy gen 94.91
bbh - naive_average gen 72.67
gsm8k 1d7fe4 accuracy gen 75.59
math 393424 accuracy gen 39.50
TheoremQA 6f0af8 score gen 15.62
MathBench - - - -
openai_humaneval 8e312c humaneval_pass@1 gen 69.51
humanevalx - - - -
sanitized_mbpp a447ff score gen 58.75
mbpp_cn 6fb572 score gen 48.20
leval - - - -
leval_closed - - - -
leval_open - - - -
longbench - - - -
longbench_single-document-qa - - - -
longbench_multi-document-qa - - - -
longbench_summarization - - - -
longbench_few-shot-learning - - - -
longbench_synthetic-tasks - - - -
longbench_code-completion - - - -
teval - - - -
teval_zh - - - -
IFEval 3321a3 Prompt-level-strict-accuracy gen 52.31
IFEval 3321a3 Inst-level-strict-accuracy gen 62.71
IFEval 3321a3 Prompt-level-loose-accuracy gen 54.90
IFEval 3321a3 Inst-level-loose-accuracy gen 64.87
09/30 19:55:16 - OpenCompass - INFO - write summary to /mnt/petrelfs/wangweiyun/workspace_cz/InternVL/internvl_chat_dev/share_internvl/InternVL2-8B/20240930_190803/summary/summary_20240930_190803.txt
09/30 19:55:16 - OpenCompass - INFO - write csv to /mnt/petrelfs/wangweiyun/workspace_cz/InternVL/internvl_chat_dev/share_internvl/InternVL2-8B/20240930_190803/summary/summary_20240930_190803.csv