add benchmark
Browse files
README.md
CHANGED
@@ -38,8 +38,8 @@ during inference time.
|
|
38 |
| Falcon-180B | 70.4 | 58.0 | 57.8 | 59.0 | 54.0 | 77.3 | 68.8 | 34.0 |
|
39 |
| Yi-6B | 63.2 | 75.5 | 72.0 | 72.2 | 42.8 | 72.3 | 68.7 | 19.8 |
|
40 |
| **Yi-34B** | **76.3** | **83.7** | **81.4** | 82.8 | **54.3** | **80.1** | 76.4 | 37.1 |
|
41 |
-
| Yi-6B-200K | 64.0 | 75.3 |
|
42 |
-
| Yi-34B-200K | 76.1 | 83.6 |
|
43 |
|
44 |
While benchmarking open-source models, we have observed a disparity between the
|
45 |
results generated by our pipeline and those reported in public sources (e.g.
|
@@ -84,6 +84,6 @@ misinformation, as well as any associated data security concerns.
|
|
84 |
|
85 |
The Yi series models are fully open for academic research and free commercial
|
86 |
usage with permission via applications. All usage must adhere to the [Model
|
87 |
-
License Agreement 2.0](https://huggingface.co/01-ai/Yi-
|
88 |
apply for the official commercial license, please contact us
|
89 |
([[email protected]](mailto:[email protected])).
|
|
|
38 |
| Falcon-180B | 70.4 | 58.0 | 57.8 | 59.0 | 54.0 | 77.3 | 68.8 | 34.0 |
|
39 |
| Yi-6B | 63.2 | 75.5 | 72.0 | 72.2 | 42.8 | 72.3 | 68.7 | 19.8 |
|
40 |
| **Yi-34B** | **76.3** | **83.7** | **81.4** | 82.8 | **54.3** | **80.1** | 76.4 | 37.1 |
|
41 |
+
| Yi-6B-200K | 64.0 | 75.3 | 73.5 | 73.9 | 42.0 | 72.0 | 69.1 | 19.0 |
|
42 |
+
| Yi-34B-200K | 76.1 | 83.6 | **81.9** | **83.4** | 52.7 | 79.7 | **76.6** | 36.3 |
|
43 |
|
44 |
While benchmarking open-source models, we have observed a disparity between the
|
45 |
results generated by our pipeline and those reported in public sources (e.g.
|
|
|
84 |
|
85 |
The Yi series models are fully open for academic research and free commercial
|
86 |
usage with permission via applications. All usage must adhere to the [Model
|
87 |
+
License Agreement 2.0](https://huggingface.co/01-ai/Yi-6B/blob/main/LICENSE). To
|
88 |
apply for the official commercial license, please contact us
|
89 |
([[email protected]](mailto:[email protected])).
|