runninglsy commited on
Commit
f9af26c
·
verified ·
1 Parent(s): d2062de

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -2
README.md CHANGED
@@ -47,10 +47,10 @@ We are pleased to announce the release of **Ovis2**, our latest advancement in m
47
  | Ovis2-34B | aimv2-1B-patch14-448 | Qwen2.5-32B-Instruct | [Huggingface](https://huggingface.co/AIDC-AI/Ovis2-34B) | - |
48
 
49
  ## Performance
50
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6076587d310e510df1db14bc/X1Ccbj48Icun1vATqvE3Z.png)
51
 
52
  ### Image Benchmark
53
- | Benchmark | Qwen2.5-VL-7B | InternVL2.5-8B-MPO | MiniCPM-o-2.6 | Ovis1.6-9B | InternVL2.5-4B-MPO | Ovis2-4B | Ovis2-8B |
54
  |:-----------------------------|:---------------:|:--------------------:|:---------------:|:------------:|:--------------------:|:----------:|:----------:|
55
  | MMBench-V1.1<sub>test</sub> | 82.6 | 82.0 | 80.6 | 80.5 | 77.8 | 81.4 | **83.6** |
56
  | MMStar | 64.1 | **65.2** | 63.3 | 62.9 | 61 | 61.9 | 64.6 |
@@ -69,6 +69,13 @@ We are pleased to announce the release of **Ovis2**, our latest advancement in m
69
  | MTVQA | 28.5 | 27.2 | 23.1 | 19.2 | 28 | 29.4 | **29.7** |
70
 
71
  ### Video Benchmark
 
 
 
 
 
 
 
72
 
73
  ## Usage
74
  Below is a code snippet demonstrating how to run Ovis with various input types. For additional usage instructions, including inference wrapper and Gradio UI, please refer to [Ovis GitHub](https://github.com/AIDC-AI/Ovis?tab=readme-ov-file#inference).
 
47
  | Ovis2-34B | aimv2-1B-patch14-448 | Qwen2.5-32B-Instruct | [Huggingface](https://huggingface.co/AIDC-AI/Ovis2-34B) | - |
48
 
49
  ## Performance
50
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/658a8a837959448ef5500ce5/M1XRFbeNbfe1lEvt9WF-j.png)
51
 
52
  ### Image Benchmark
53
+ | Benchmark | Qwen2.5-VL-7B | InternVL2.5-8B-MPO | MiniCPM-o-2.6 | Ovis1.6-9B | InternVL2.5-4B-MPO | Ovis2-4B | Ovis2-8B |
54
  |:-----------------------------|:---------------:|:--------------------:|:---------------:|:------------:|:--------------------:|:----------:|:----------:|
55
  | MMBench-V1.1<sub>test</sub> | 82.6 | 82.0 | 80.6 | 80.5 | 77.8 | 81.4 | **83.6** |
56
  | MMStar | 64.1 | **65.2** | 63.3 | 62.9 | 61 | 61.9 | 64.6 |
 
69
  | MTVQA | 28.5 | 27.2 | 23.1 | 19.2 | 28 | 29.4 | **29.7** |
70
 
71
  ### Video Benchmark
72
+ | Benchmark | Qwen2.5-VL-7B | InternVL2.5-8B | LLaVA-OV-7B | InternVL2.5-4B | Ovis2-4B | Ovis2-8B |
73
+ |:--------------------|:-------------:|:--------------:|:------------------:|:--------------:|:---------:|:-------------:|
74
+ | VideoMME(wo/w-subs) | 65.1/71.6 | 64.2 / 66.9 | 58.2/61.5 | 62.3 / 63.6 | 64.0/66.3 | **68.0/71.6** |
75
+ | MVBench | 69.6 | **72.0** | 56.7 | 71.6 | 68.45 | 68.15 |
76
+ | MLVU(M-Avg/G-Avg) | 70.2/- | 68.9/- | 64.7/- | 68.3/- | 70.8/4.23 | **76.4**/4.25 |
77
+ | MMBench-Video | 1.79 | 1.68 | - | 1.73 | 1.69 | **1.85** |
78
+ | TempCompass | **71.7** | - | - | - | 67.02 | 69.28 |
79
 
80
  ## Usage
81
  Below is a code snippet demonstrating how to run Ovis with various input types. For additional usage instructions, including inference wrapper and Gradio UI, please refer to [Ovis GitHub](https://github.com/AIDC-AI/Ovis?tab=readme-ov-file#inference).