Commit
•
a42f499
1
Parent(s):
6aed49a
Update README.md (#14)
Browse files- Update README.md (b8dfd8beb58e6beea24404d4853a886fee84f8d0)
Co-authored-by: Pakawat Phasook <[email protected]>
README.md
CHANGED
|
@@ -77,11 +77,11 @@ print(response)
|
|
| 77 |
## **Evaluation Performance**
|
| 78 |
| Model | m3exam | thaiexam | xcopa | belebele | xnli | thaisentiment | XL sum | flores200 eng > th | flores200 th > eng | iapp | AVG(NLU) | AVG(MC) | AVG(NLG) |
|
| 79 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 80 |
-
| Pathumma-llm-text-1.0.0 | 55.02 | 51.32 | 83 | 77.77 | 40.11 | 41.29 | 16.9286253 | 26.54 | 51.88 | 41.28 | 60.54 | 53.17 | 34.16 |
|
| 81 |
-
| Openthaigpt1.5-7b-instruct | 54.01 | 52.04 | 85.4 | 79.44 | 39.7 | 50.24 | 18.11 | 29.09 | 29.58 | 32.49 | 63.70 | 53.03 | 27.32 |
|
| 82 |
-
| SeaLLMs-v3-7B-Chat | 51.43 | 51.33 | 83.4 | 78.22 | 34.05 | 39.57 | 20.27 | 32.91 | 28.8 | 48.12 | 58.81 | 51.38 | 32.53 |
|
| 83 |
| llama-3-typhoon-v1.5-8B | 43.82 | 41.95 | 81.6 | 71.89 | 33.35 | 38.45 | 16.66 | 31.94 | 28.86 | 54.78 | 56.32 | 42.89 | 33.06 |
|
| 84 |
-
| Meta-Llama-3.1-8B-Instruct | 45.11 | 43.89 | 73.4 | 74.89 | 33.49 | 45.45 | 21.61 | 30.45 | 32.28 | 68.57 | 56.81 | 44.50 | 38.23 |
|
| 85 |
|
| 86 |
## **Contributor Contract**
|
| 87 |
|
|
|
|
| 77 |
## **Evaluation Performance**
|
| 78 |
| Model | m3exam | thaiexam | xcopa | belebele | xnli | thaisentiment | XL sum | flores200 eng > th | flores200 th > eng | iapp | AVG(NLU) | AVG(MC) | AVG(NLG) |
|
| 79 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 80 |
+
| Pathumma-llm-text-1.0.0 | **55.02** | 51.32 | 83 | 77.77 | **40.11** | 41.29 | 16.9286253 | 26.54 | **51.88** | 41.28 | 60.54 | **53.17** | 34.16 |
|
| 81 |
+
| Openthaigpt1.5-7b-instruct | 54.01 | **52.04** | **85.4** | **79.44** | 39.7 | **50.24** | 18.11 | 29.09 | 29.58 | 32.49 | **63.70** | 53.03 | 27.32 |
|
| 82 |
+
| SeaLLMs-v3-7B-Chat | 51.43 | 51.33 | 83.4 | 78.22 | 34.05 | 39.57 | 20.27 | **32.91** | 28.8 | 48.12 | 58.81 | 51.38 | 32.53 |
|
| 83 |
| llama-3-typhoon-v1.5-8B | 43.82 | 41.95 | 81.6 | 71.89 | 33.35 | 38.45 | 16.66 | 31.94 | 28.86 | 54.78 | 56.32 | 42.89 | 33.06 |
|
| 84 |
+
| Meta-Llama-3.1-8B-Instruct | 45.11 | 43.89 | 73.4 | 74.89 | 33.49 | 45.45 | **21.61** | 30.45 | 32.28 | **68.57** | 56.81 | 44.50 | **38.23** |
|
| 85 |
|
| 86 |
## **Contributor Contract**
|
| 87 |
|