Upload folder using huggingface_hub

README.md

@@ -37,7 +37,7 @@ InternVL 2.0 is a multimodal large language model series, featuring models of va
 |      MME<sub>sum</sub>       |     2070.2      |     2110.6     |    2260.7     |    2315.0     |
 |         RealWorldQA          |      68.0       |      67.5      |     68.3      |     71.8      |
 |     AI2D<sub>test</sub>      |      89.4       |      80.3      |     84.5      |     87.1      |
-|      MMMU<sub>val</sub>      |      63.1       |      58.5      |     48.3      |     53.9      |
+|      MMMU<sub>val</sub>      |   63.1 / 61.7   |  58.5 / 60.6   |  48.3 / 50.7  |  53.9 / 55.2  |
 |  MMBench-EN<sub>test</sub>   |      81.0       |      73.9      |     83.4      |     86.8      |
 |  MMBench-CN<sub>test</sub>   |      80.2       |      73.8      |     82.0      |     86.5      |
 |    CCBench<sub>dev</sub>     |      57.3       |      28.4      |     73.5      |     80.6      |
@@ -47,7 +47,9 @@ InternVL 2.0 is a multimodal large language model series, featuring models of va
 |   HallBench<sub>avg</sub>    |      43.9       |      45.6      |     50.7      |     56.9      |
 | MathVista<sub>testmini</sub> |      58.1       |      57.7      |     59.4      |     63.7      |
 
-- We simultaneously use InternVL and VLMEvalKit repositories for model evaluation. Specifically, the results reported for DocVQA, ChartQA, InfoVQA, TextVQA, MME, AI2D, MMBench, CCBench, MMVet, and SEED-Image were tested using the InternVL repository. MMMU, OCRBench, RealWorldQA, HallBench, and MathVista were evaluated using the VLMEvalKit.
+- We simultaneously use InternVL and VLMEvalKit repositories for model evaluation. Specifically, the results reported for DocVQA, ChartQA, InfoVQA, TextVQA, MME, AI2D, MMBench, CCBench, MMVet, and SEED-Image were tested using the InternVL repository. OCRBench, RealWorldQA, HallBench, and MathVista were evaluated using the VLMEvalKit.
+
+- For MMMU, we report both the original scores (left side: evaluated using the InternVL codebase for InternVL series models, and sourced from technical reports or webpages for other models) and the VLMEvalKit scores (right side: collected from the OpenCompass leaderboard).
 
 - Please note that evaluating the same model using different testing toolkits like InternVL and VLMEvalKit can result in slight differences, which is normal. Updates to code versions and variations in environment and hardware can also cause minor discrepancies in results.
 
@@ -568,7 +570,7 @@ InternVL 2.0 是一个多模态大语言模型系列，包含各种规模的模
 |      MME<sub>sum</sub>       |     2070.2      |     2110.6     |    2260.7     |    2315.0     |
 |         RealWorldQA          |      68.0       |      67.5      |     68.3      |     71.8      |
 |     AI2D<sub>test</sub>      |      89.4       |      80.3      |     84.5      |     87.1      |
-|      MMMU<sub>val</sub>      |      63.1       |      58.5      |     48.3      |     53.9      |
+|      MMMU<sub>val</sub>      |   63.1 / 61.7   |  58.5 / 60.6   |  48.3 / 50.7  |  53.9 / 55.2  |
 |  MMBench-EN<sub>test</sub>   |      81.0       |      73.9      |     83.4      |     86.8      |
 |  MMBench-CN<sub>test</sub>   |      80.2       |      73.8      |     82.0      |     86.5      |
 |    CCBench<sub>dev</sub>     |      57.3       |      28.4      |     73.5      |     80.6      |
@@ -580,6 +582,8 @@ InternVL 2.0 是一个多模态大语言模型系列，包含各种规模的模
 
 - 我们同时使用 InternVL 和 VLMEvalKit 仓库进行模型评估。具体来说，DocVQA、ChartQA、InfoVQA、TextVQA、MME、AI2D、MMBench、CCBench、MMVet 和 SEED-Image 的结果是使用 InternVL 仓库测试的。MMMU、OCRBench、RealWorldQA、HallBench 和 MathVista 是使用 VLMEvalKit 进行评估的。
 
+- 对于MMMU，我们报告了原始分数（左侧：InternVL系列模型使用InternVL代码库评测，其他模型的分数来自其技术报告或网页）和VLMEvalKit分数（右侧：从OpenCompass排行榜收集）。
+
 - 请注意，使用不同的测试工具包（如 InternVL 和 VLMEvalKit）评估同一模型可能会导致细微差异，这是正常的。代码版本的更新、环境和硬件的变化也可能导致结果的微小差异。
 
 - 需要提到的是，我们报告的 MMVet 分数是使用 GPT-4-0613 作为评判模型评估的。不同版本的 GPT-4 会导致该数据集分数的显著变化。例如，使用 GPT-4-Turbo 会导致分数显著降低。