Update README.md
Browse files
README.md
CHANGED
@@ -23,39 +23,40 @@ This model is ready for commercial/non-commercial use. <br>
|
|
23 |

|
24 |
|
25 |
|
26 |
-
## Results
|
27 |
-
|
28 |
-
Below results are the average of **64 evaluations** on
|
29 |
-
|
30 |
-
| Model
|
31 |
-
|
32 |
-
| DeepSeek-R1
|
33 |
-
| QwQ-32B
|
34 |
-
|
|
35 |
-
| **Distilled 7B+ Models**
|
36 |
-
|
|
37 |
-
| Bespoke-Stratos-7B
|
38 |
-
| OpenThinker-7B
|
39 |
-
| R1-Distill-Qwen-7B
|
40 |
-
| OlympicCoder-7B
|
41 |
-
| **OCR-Qwen-7B**
|
42 |
-
| **OCR-Qwen-7B-Instruct**
|
43 |
-
|
|
44 |
-
| **Distilled 14B+ Models
|
45 |
-
|
|
46 |
-
| R1-Distill-Qwen-14B
|
47 |
-
| **OCR-Qwen-14B**
|
48 |
-
| **OCR-Qwen-14B-Instruct
|
49 |
-
|
|
50 |
-
| **Distilled 32B+ Models
|
51 |
-
|
|
52 |
-
| Bespoke-Stratos-32B
|
53 |
-
| OpenThinker-32B
|
54 |
-
| R1-Distill-Qwen-32B
|
55 |
-
| OlympicCoder-32B
|
56 |
-
| **OCR-Qwen-32B**
|
57 |
-
| **OCR-Qwen-32B-Instruct
|
58 |
-
| **OCR-Qwen-32B-Instruct-v1.1**| **?**
|
|
|
59 |
|
60 |
## Reproducing our results
|
61 |
|
|
|
23 |

|
24 |
|
25 |
|
26 |
+
## Results
|
27 |
+
|
28 |
+
Below results are the average of **64 evaluations** on LiveCodeBench (v5) [2408-2501].
|
29 |
+
|
30 |
+
| Model | LiveCodeBench Avg. |
|
31 |
+
|-------------------------------|--------------------|
|
32 |
+
| DeepSeek-R1 | 65.6 |
|
33 |
+
| QwQ-32B | 61.3 |
|
34 |
+
| | |
|
35 |
+
| **Distilled 7B+ Models** | |
|
36 |
+
| | |
|
37 |
+
| Bespoke-Stratos-7B | 14.7 |
|
38 |
+
| OpenThinker-7B | 25.5 |
|
39 |
+
| R1-Distill-Qwen-7B | 38.0 |
|
40 |
+
| OlympicCoder-7B | 40.9 |
|
41 |
+
| **OCR-Qwen-7B** | **48.5** |
|
42 |
+
| **OCR-Qwen-7B-Instruct** | **51.3** |
|
43 |
+
| | |
|
44 |
+
| **Distilled 14B+ Models** | |
|
45 |
+
| | |
|
46 |
+
| R1-Distill-Qwen-14B | 51.3 |
|
47 |
+
| **OCR-Qwen-14B** | **57.7** |
|
48 |
+
| **OCR-Qwen-14B-Instruct** | **59.4** |
|
49 |
+
| | |
|
50 |
+
| **Distilled 32B+ Models** | |
|
51 |
+
| | |
|
52 |
+
| Bespoke-Stratos-32B | 30.1 |
|
53 |
+
| OpenThinker-32B | 54.1 |
|
54 |
+
| R1-Distill-Qwen-32B | 58.1 |
|
55 |
+
| OlympicCoder-32B | 57.4 |
|
56 |
+
| **OCR-Qwen-32B** | **61.8** |
|
57 |
+
| **OCR-Qwen-32B-Instruct** | **61.7** |
|
58 |
+
| **OCR-Qwen-32B-Instruct-v1.1**| **?** |
|
59 |
+
|
60 |
|
61 |
## Reproducing our results
|
62 |
|