Upload README.md
Browse files
README.md
CHANGED
@@ -38,14 +38,14 @@ I use A100 GPU 40GB and COLAB, when trianing.
|
|
38 |
## KO-LLM leaderboard
|
39 |
- Follow up as [Open KO-LLM LeaderBoard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).
|
40 |
|
41 |
-
| Model | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
|
42 |
-
| --- | --- | --- | --- | --- | --- |
|
43 |
-
| Poly-platypus-ko-12.8b(ours) | NaN | NaN | NaN | NaN | NaN |
|
44 |
-
| [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 38.05 | 49.63 | 34.68 | 37.69 | 68.08 |
|
45 |
-
| [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 39.08 | 50.86 | 34.60 | 37.94 | 64.55 |
|
46 |
-
| [42MARU/polyglot-ko-12.8b-instruct](https://huggingface.co/42MARU/polyglot-ko-12.8b-instruct) | 36.35 | 51.59 | 26.38 | 45.16 | 59.98 |
|
47 |
-
|
|
48 |
-
| [
|
49 |
> Compare with Top 5 SOTA models. (update: 10/01)
|
50 |
|
51 |
---
|
|
|
38 |
## KO-LLM leaderboard
|
39 |
- Follow up as [Open KO-LLM LeaderBoard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).
|
40 |
|
41 |
+
| Model | Average |Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
|
42 |
+
| --- | --- | --- | --- | --- | --- | --- |
|
43 |
+
| Poly-platypus-ko-12.8b(ours) | NaN | NaN | NaN | NaN | NaN | NaN |
|
44 |
+
| [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 45.62 | 38.05 | 49.63 | 34.68 | 37.69 | 68.08 |
|
45 |
+
| [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 45.41 | 39.08 | 50.86 | 34.60 | 37.94 | 64.55 |
|
46 |
+
| [42MARU/polyglot-ko-12.8b-instruct](https://huggingface.co/42MARU/polyglot-ko-12.8b-instruct) | 43.89 | 36.35 | 51.59 | 26.38 | 45.16 | 59.98 |
|
47 |
+
| [FINDA-FIT/llama-p](https://huggingface.co/FINDA-FIT/llama-p) | 43.63 | 39.59 | 50.74 | 33.85 | 38.09 | 55.87 |
|
48 |
+
| [lcw99/polyglot-ko-12.8b-chang-instruct-chat](https://huggingface.co/lcw99/polyglot-ko-12.8b-chang-instruct-chat) | 43.06 | 34.90 | 52.72 | 25.98 | 44.44 | 57.28 |
|
49 |
> Compare with Top 5 SOTA models. (update: 10/01)
|
50 |
|
51 |
---
|