Hugging Face's logo

nayohan
/
llama3-instrucTrans-enko-8b

Text Generation
Transformers
Safetensors
English
Korean
llama
translation
enko
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
3
nayohan commited on
Commit
0960346
β€’
1 Parent(s): ae6b2cc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -18
README.md CHANGED
@@ -109,15 +109,15 @@ OUTPUT: 기술 및 기초 과학은 연ꡬ μΈ‘λ©΄μ—μ„œ 맀우 μ€‘μš”ν•©λ‹ˆλ‹€.
109
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/TMo05LOUhPGYNbT2ADOgi.png)
110
  | model | aihub-111 | aihub-124 | aihub-125 | aihub-126 | aihub-563 | aihub-71265 | aihub-71266 | aihub-71382 | average |
111
  |:-----------------|------------:|------------:|------------:|------------:|------------:|--------------:|--------------:|--------------:|----------:|
112
- | EEVE-10.8b-it | 6.15 | 11.81 | 5.78 | 4.99 | 6.31 | 10.99 | 9.41 | 6.44 | 7.73 |
113
- | KULLM3 | 9.00 | 13.49 | 10.43 | 5.90 | 1.92 | 16.37 | 10.02 | 8.39 | 9.44 |
114
- | Seagull-13B | 9.8 | 18.38 | 8.51 | 5.53 | 8.74 | 17.44 | 10.11 | 11.21 | 11.21 |
115
- | Synatra-7B | 6.99 | 25.14 | 7.79 | 5.31 | 9.95 | 19.27 | 13.20 | 8.93 | 12.07 |
116
- | nhndq-nllb | 24.09 | 48.71 | 22.89 | 13.98 | 18.71 | 30.18 | 32.49 | 18.62 | 26.20 |
117
- | our-tech | 20.19 | 37.48 | 18.50 | 12.45 | 16.96 | 13.92 | 43.54 | 9.62 | 21.58 |
118
- | our-general | 24.72 | 45.22 | 21.61 | 18.97 | 17.23 | 30.00 | 32.08 | 13.55 | 25.42 |
119
- | our-sharegpt | 12.42 | 19.23 | 10.91 | 9.18 | 14.30 | 26.43 | 12.62 | 15.57 | 15.08 |
120
- | our-instrucTrans | 24.89 | 47.00 | 22.78 | 21.78 | 24.27 | 27.98 | 31.31 | 15.42 |**26.92** |
121
  ## **FLoRes 영-ν•œ λ²ˆμ—­λ°μ΄ν„°μ…‹ 평가**
122
  [FloRes](https://huggingface.co/datasets/facebook/flores)λŠ” νŽ˜μ΄μŠ€λΆμ—μ„œ κ³΅κ°œν•œ μ˜μ–΄μ™€ 적은 λ¦¬μ†ŒμŠ€μ˜ μ–Έμ–΄ 200κ°œμ— λŒ€ν•΄μ„œ λ³‘λ ¬λ‘œ κ΅¬μ„±ν•œ λ²ˆμ—­ 벀치마크 λ°μ΄ν„°μ…‹μž…λ‹ˆλ‹€.
123
  [traintogpb/aihub-flores-koen-integrated-sparta-30k](https://huggingface.co/datasets/traintogpb/aihub-flores-koen-integrated-sparta-30k)λ₯Ό ν™œμš©ν•˜μ—¬ 평가λ₯Ό μ§„ν–‰ν•˜μ˜€μŠ΅λ‹ˆλ‹€. (ν•œλ¬Έμž₯ ꡬ성)
@@ -166,15 +166,15 @@ OUTPUT: 기술 및 기초 과학은 연ꡬ μΈ‘λ©΄μ—μ„œ 맀우 μ€‘μš”ν•©λ‹ˆλ‹€.
166
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/bf2qjeg-03WRVTIbqvG7C.png)
167
  | model | aihub | flores | iwslt | news | average |
168
  |:-----------------|--------:|---------:|--------:|--------:|----------:|
169
- | EEVE-10.8b-it | 7.73 | 11.35 | 4.20 | 6.52 | 7.45 |
170
- | KULLM3 | 9.44 | 13.03 | 5.59 | 6.51 | 8.64 |
171
- | Seagull-13B | 11.21 | 11.73 | 5.34 | 5.95 | 8.56 |
172
- | Synatra-7B | 12.07 | 10.89 | 5.08 | 6.97 | 8.75 |
173
- | nhndq-nllb | 26.20 | 13.97 |**7.90** | 8.62 | 14.17 |
174
- | our-tech | 21.58 | 12.09 | 3.97 | 8.92 | 11.64 |
175
- | our-general | 25.42 | 14.75 | 6.75 | 10.66 | 14.40 |
176
- | our-sharegpt | 15.08 | 15.70 | 7.09 | 8.72 | 11.64 |
177
- | our-instrucTrans |**26.92**| **16.09**| 7.80 |**13.72**| **16.13** |
178
  ### **Citation**
179
  ```bibtex
180
  @article{InstrcTrans8b,
 
109
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/TMo05LOUhPGYNbT2ADOgi.png)
110
  | model | aihub-111 | aihub-124 | aihub-125 | aihub-126 | aihub-563 | aihub-71265 | aihub-71266 | aihub-71382 | average |
111
  |:-----------------|------------:|------------:|------------:|------------:|------------:|--------------:|--------------:|--------------:|----------:|
112
+ | [EEVE-10.8b-it](https://huggingface.co/yanolja/EEVE-Korean-10.8B-v1.0) | 6.15 | 11.81 | 5.78 | 4.99 | 6.31 | 10.99 | 9.41 | 6.44 | 7.73 |
113
+ | [KULLM3](https://huggingface.co/nlpai-lab/KULLM3) | 9.00 | 13.49 | 10.43 | 5.90 | 1.92 | 16.37 | 10.02 | 8.39 | 9.44 |
114
+ | [Seagull-13B](kuotient/Seagull-13b-translation) | 9.8 | 18.38 | 8.51 | 5.53 | 8.74 | 17.44 | 10.11 | 11.21 | 11.21 |
115
+ | [Synatra-7B](maywell/Synatra-7B-v0.3-Translation) | 6.99 | 25.14 | 7.79 | 5.31 | 9.95 | 19.27 | 13.20 | 8.93 | 12.07 |
116
+ | [nhndq-nllb](NHNDQ/nllb-finetuned-en2ko) | 24.09 | 48.71 | 22.89 | 13.98 | 18.71 | 30.18 | 32.49 | 18.62 | 26.20 |
117
+ | [our-tech](nayohan/llama3-8b-it-translation-tech-en-ko-1sent) | 20.19 | 37.48 | 18.50 | 12.45 | 16.96 | 13.92 | 43.54 | 9.62 | 21.58 |
118
+ | [our-general](https://huggingface.co/nayohan/llama3-8b-it-translation-general-en-ko-1sent) | 24.72 | 45.22 | 21.61 | 18.97 | 17.23 | 30.00 | 32.08 | 13.55 | 25.42 |
119
+ | [our-sharegpt](https://huggingface.co/nayohan/llama3-8b-it-translation-sharegpt-en-ko) | 12.42 | 19.23 | 10.91 | 9.18 | 14.30 | 26.43 | 12.62 | 15.57 | 15.08 |
120
+ | **our-instrucTrans** | 24.89 | 47.00 | 22.78 | 21.78 | 24.27 | 27.98 | 31.31 | 15.42 |**26.92** |
121
  ## **FLoRes 영-ν•œ λ²ˆμ—­λ°μ΄ν„°μ…‹ 평가**
122
  [FloRes](https://huggingface.co/datasets/facebook/flores)λŠ” νŽ˜μ΄μŠ€λΆμ—μ„œ κ³΅κ°œν•œ μ˜μ–΄μ™€ 적은 λ¦¬μ†ŒμŠ€μ˜ μ–Έμ–΄ 200κ°œμ— λŒ€ν•΄μ„œ λ³‘λ ¬λ‘œ κ΅¬μ„±ν•œ λ²ˆμ—­ 벀치마크 λ°μ΄ν„°μ…‹μž…λ‹ˆλ‹€.
123
  [traintogpb/aihub-flores-koen-integrated-sparta-30k](https://huggingface.co/datasets/traintogpb/aihub-flores-koen-integrated-sparta-30k)λ₯Ό ν™œμš©ν•˜μ—¬ 평가λ₯Ό μ§„ν–‰ν•˜μ˜€μŠ΅λ‹ˆλ‹€. (ν•œλ¬Έμž₯ ꡬ성)
 
166
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/bf2qjeg-03WRVTIbqvG7C.png)
167
  | model | aihub | flores | iwslt | news | average |
168
  |:-----------------|--------:|---------:|--------:|--------:|----------:|
169
+ | [EEVE-10.8b-it](https://huggingface.co/yanolja/EEVE-Korean-10.8B-v1.0) | 7.73 | 11.35 | 4.20 | 6.52 | 7.45 |
170
+ | [KULLM3](https://huggingface.co/nlpai-lab/KULLM3) | 9.44 | 13.03 | 5.59 | 6.51 | 8.64 |
171
+ | [Seagull-13B](kuotient/Seagull-13b-translation) | 11.21 | 11.73 | 5.34 | 5.95 | 8.56 |
172
+ | [Synatra-7B](maywell/Synatra-7B-v0.3-Translation) | 12.07 | 10.89 | 5.08 | 6.97 | 8.75 |
173
+ | [nhndq-nllb](NHNDQ/nllb-finetuned-en2ko) | 26.20 | 13.97 |**7.90** | 8.62 | 14.17 |
174
+ | [our-tech](nayohan/llama3-8b-it-translation-tech-en-ko-1sent) | 21.58 | 12.09 | 3.97 | 8.92 | 11.64 |
175
+ | [our-general](https://huggingface.co/nayohan/llama3-8b-it-translation-general-en-ko-1sent) | 25.42 | 14.75 | 6.75 | 10.66 | 14.40 |
176
+ | [our-sharegpt](https://huggingface.co/nayohan/llama3-8b-it-translation-sharegpt-en-ko) | 15.08 | 15.70 | 7.09 | 8.72 | 11.64 |
177
+ | **our-instrucTrans** |**26.92**| **16.09**| 7.80 |**13.72**| **16.13** |
178
  ### **Citation**
179
  ```bibtex
180
  @article{InstrcTrans8b,