wasiuddina commited on
Commit
e57f687
·
verified ·
1 Parent(s): 9720816

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -33
README.md CHANGED
@@ -23,39 +23,40 @@ This model is ready for commercial/non-commercial use. <br>
23
  ![Evaluation Results](./results.png)
24
 
25
 
26
- ## Results from [OpenCodeReasoning](https://arxiv.org/abs/2504.01943)
27
-
28
- Below results are the average of **64 evaluations** on each benchmark.
29
-
30
- | Model | LiveCodeBench Avg. | CodeContest All |
31
- |------------------------|--------------------|-----------------|
32
- | DeepSeek-R1 | 65.6 | 26.2 |
33
- | QwQ-32B | 61.3 | 20.2 |
34
- | | | |
35
- | **Distilled 7B+ Models** | | |
36
- | | | |
37
- | Bespoke-Stratos-7B | 14.7 | 2.0 |
38
- | OpenThinker-7B | 25.5 | 5.0 |
39
- | R1-Distill-Qwen-7B | 38.0 | 11.1 |
40
- | OlympicCoder-7B | 40.9 | 10.6 |
41
- | **OCR-Qwen-7B** | **48.5** | **16.3** |
42
- | **OCR-Qwen-7B-Instruct** | **51.3** | **18.1** |
43
- | | | |
44
- | **Distilled 14B+ Models**| | |
45
- | | | |
46
- | R1-Distill-Qwen-14B | 51.3 | 17.6 |
47
- | **OCR-Qwen-14B** | **57.7** | **22.6** |
48
- | **OCR-Qwen-14B-Instruct**| **59.4** | **23.6** |
49
- | | | |
50
- | **Distilled 32B+ Models**| | |
51
- | | | |
52
- | Bespoke-Stratos-32B | 30.1 | 6.3 |
53
- | OpenThinker-32B | 54.1 | 16.4 |
54
- | R1-Distill-Qwen-32B | 58.1 | 18.3 |
55
- | OlympicCoder-32B | 57.4 | 18.0 |
56
- | **OCR-Qwen-32B** | **61.8** | **24.6** |
57
- | **OCR-Qwen-32B-Instruct**| **61.7** | **24.4** |
58
- | **OCR-Qwen-32B-Instruct-v1.1**| **?** | **?** |
 
59
 
60
  ## Reproducing our results
61
 
 
23
  ![Evaluation Results](./results.png)
24
 
25
 
26
+ ## Results
27
+
28
+ Below results are the average of **64 evaluations** on LiveCodeBench (v5) [2408-2501].
29
+
30
+ | Model | LiveCodeBench Avg. |
31
+ |-------------------------------|--------------------|
32
+ | DeepSeek-R1 | 65.6 |
33
+ | QwQ-32B | 61.3 |
34
+ | | |
35
+ | **Distilled 7B+ Models** | |
36
+ | | |
37
+ | Bespoke-Stratos-7B | 14.7 |
38
+ | OpenThinker-7B | 25.5 |
39
+ | R1-Distill-Qwen-7B | 38.0 |
40
+ | OlympicCoder-7B | 40.9 |
41
+ | **OCR-Qwen-7B** | **48.5** |
42
+ | **OCR-Qwen-7B-Instruct** | **51.3** |
43
+ | | |
44
+ | **Distilled 14B+ Models** | |
45
+ | | |
46
+ | R1-Distill-Qwen-14B | 51.3 |
47
+ | **OCR-Qwen-14B** | **57.7** |
48
+ | **OCR-Qwen-14B-Instruct** | **59.4** |
49
+ | | |
50
+ | **Distilled 32B+ Models** | |
51
+ | | |
52
+ | Bespoke-Stratos-32B | 30.1 |
53
+ | OpenThinker-32B | 54.1 |
54
+ | R1-Distill-Qwen-32B | 58.1 |
55
+ | OlympicCoder-32B | 57.4 |
56
+ | **OCR-Qwen-32B** | **61.8** |
57
+ | **OCR-Qwen-32B-Instruct** | **61.7** |
58
+ | **OCR-Qwen-32B-Instruct-v1.1**| **?** |
59
+
60
 
61
  ## Reproducing our results
62