kyujinpy commited on
Commit
d5c3e63
1 Parent(s): 69e6d59

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -38,14 +38,14 @@ I use A100 GPU 40GB and COLAB, when trianing.
38
  ## KO-LLM leaderboard
39
  - Follow up as [Open KO-LLM LeaderBoard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).
40
 
41
- | Model | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
42
- | --- | --- | --- | --- | --- | --- |
43
- | Poly-platypus-ko-12.8b(ours) | NaN | NaN | NaN | NaN | NaN |
44
- | [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 38.05 | 49.63 | 34.68 | 37.69 | 68.08 |
45
- | [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 39.08 | 50.86 | 34.60 | 37.94 | 64.55 |
46
- | [42MARU/polyglot-ko-12.8b-instruct](https://huggingface.co/42MARU/polyglot-ko-12.8b-instruct) | 36.35 | 51.59 | 26.38 | 45.16 | 59.98 |
47
- | 42MARU/llama-2-ko-7b-instruct-v2 | 39.51 | 51.67 | 32.54 | 38.30 | 57.39 |
48
- | [FINDA-FIT/llama-p](https://huggingface.co/FINDA-FIT/llama-p) | 39.59 | 50.74 | 33.85 | 38.09 | 55.87 |
49
  > Compare with Top 5 SOTA models. (update: 10/01)
50
 
51
  ---
 
38
  ## KO-LLM leaderboard
39
  - Follow up as [Open KO-LLM LeaderBoard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).
40
 
41
+ | Model | Average |Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
42
+ | --- | --- | --- | --- | --- | --- | --- |
43
+ | Poly-platypus-ko-12.8b(ours) | NaN | NaN | NaN | NaN | NaN | NaN |
44
+ | [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 45.62 | 38.05 | 49.63 | 34.68 | 37.69 | 68.08 |
45
+ | [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 45.41 | 39.08 | 50.86 | 34.60 | 37.94 | 64.55 |
46
+ | [42MARU/polyglot-ko-12.8b-instruct](https://huggingface.co/42MARU/polyglot-ko-12.8b-instruct) | 43.89 | 36.35 | 51.59 | 26.38 | 45.16 | 59.98 |
47
+ | [FINDA-FIT/llama-p](https://huggingface.co/FINDA-FIT/llama-p) | 43.63 | 39.59 | 50.74 | 33.85 | 38.09 | 55.87 |
48
+ | [lcw99/polyglot-ko-12.8b-chang-instruct-chat](https://huggingface.co/lcw99/polyglot-ko-12.8b-chang-instruct-chat) | 43.06 | 34.90 | 52.72 | 25.98 | 44.44 | 57.28 |
49
  > Compare with Top 5 SOTA models. (update: 10/01)
50
 
51
  ---