Hugging Face's logo

scb10x
/
llama-3-typhoon-v1.5x-8b-instruct

Text Generation
Transformers
Safetensors
Thai
English
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
kunato commited on
Commit
035fedf
·
verified ·
1 Parent(s): a0f02b1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -39,9 +39,9 @@ Remark: We developed the TH pair by translating the original datasets into Thai
39
 
40
  | Model | ONET | IC | TGAT | TPAT-1 | A-Level | Average (ThaiExam) | MMLU |
41
  | --- | --- | --- | --- | --- | --- | --- | --- |
42
- | Typhoon-1.5 8B | 0.446 | 0.431 | 0.722 | 0.526 | 0.407 | 0.5028 | 0.6136 |
43
- | Typhoon-1.5X 8B | 0.478 | 0.379 | 0.722 | 0.5 | 0.435 | 0.5028 | 0.6369 |
44
- | gpt-3.5-turbo-0125 | 0.358 | 0.279 | 0.678 | 0.345 | 0.318 | 0.3956 | 0.700** |
45
 
46
  ** We report the MMLU score that is reported in GPT-4 Tech Report.
47
 
@@ -50,15 +50,15 @@ Remark: We developed the TH pair by translating the original datasets into Thai
50
  | Model | MT-Bench Thai | MT-Bench English |
51
  | --- | --- | --- |
52
  | Typhoon-1.5 8B | 6.402 | 7.275 |
53
- | Typhoon-1.5X 8B | 6.902 | 7.9 |
54
- | gpt-3.5-turbo-0125 | 6.186 | 8.181 |
55
 
56
  ### IFEval
57
 
58
  | Model | IFEval Thai | IFEval English |
59
  | --- | --- | --- |
60
- | Typhoon-1.5 8B | 0.548 | 0.676 |
61
- | Typhoon-1.5X 8B | 0.548 | 0.691 |
62
  | gpt-3.5-turbo-0125 | 0.479 | 0.659 |
63
 
64
  ## Insight
 
39
 
40
  | Model | ONET | IC | TGAT | TPAT-1 | A-Level | Average (ThaiExam) | MMLU |
41
  | --- | --- | --- | --- | --- | --- | --- | --- |
42
+ | Typhoon-1.5 8B | 0.446 | **0.431** | **0.722** | **0.526** | 0.407 | **0.5028** | 0.6136 |
43
+ | Typhoon-1.5X 8B | **0.478** | 0.379 | **0.722** | 0.5 | **0.435** | **0.5028** | 0.6369 |
44
+ | gpt-3.5-turbo-0125 | 0.358 | 0.279 | 0.678 | 0.345 | 0.318 | 0.3956 | **0.700**** |
45
 
46
  ** We report the MMLU score that is reported in GPT-4 Tech Report.
47
 
 
50
  | Model | MT-Bench Thai | MT-Bench English |
51
  | --- | --- | --- |
52
  | Typhoon-1.5 8B | 6.402 | 7.275 |
53
+ | Typhoon-1.5X 8B | **6.902** | 7.9 |
54
+ | gpt-3.5-turbo-0125 | 6.186 | **8.181** |
55
 
56
  ### IFEval
57
 
58
  | Model | IFEval Thai | IFEval English |
59
  | --- | --- | --- |
60
+ | Typhoon-1.5 8B | **0.548** | 0.676 |
61
+ | Typhoon-1.5X 8B | **0.548** | **0.691** |
62
  | gpt-3.5-turbo-0125 | 0.479 | 0.659 |
63
 
64
  ## Insight