Update README.md
Browse files
README.md
CHANGED
@@ -8,14 +8,19 @@ pipeline_tag: text-generation
|
|
8 |
**Llama3.2-Typhoon2-1B-instruct** is a instruct Thai 🇹🇭 large language model with 1 billion parameters, and it is based on Llama3.2-1B.
|
9 |
|
10 |
|
|
|
|
|
11 |
| Model | IFEval - TH | IFEval - EN | MT-Bench TH | MT-Bench EN | Thai Code-Switching (t=0.7) | Thai Code-Switching (t=1.0) | FunctionCall-TH | FunctionCall-EN |
|
12 |
|----------------------------|-------------|-------------|-------------|-------------|-----------------------------|-----------------------------|----------------|----------------|
|
13 |
| **Typhoon2 1b instruct** | **52.46%** | **53.35%** | **3.9725** | 5.2125 | 96.4% | **88%** | **34.96%** | **45.60%** |
|
14 |
| **Qwen2.5 1.5b instruct** | 44.42% | 48.45% | 2.9395 | **6.9343** | 82.6% | 20.6% | 13.83% | 17.88% |
|
15 |
| **llama3.2 1b instruct** | 31.76% | 51.15% | 2.5824 | 6.229 | **97.8%** | 22.6% | 29.88% | 36.50% |
|
16 |
|
|
|
17 |
|
18 |
-
|
|
|
|
|
19 |
|
20 |
|
21 |
For release post, please see our [blog](...).
|
|
|
8 |
**Llama3.2-Typhoon2-1B-instruct** is a instruct Thai 🇹🇭 large language model with 1 billion parameters, and it is based on Llama3.2-1B.
|
9 |
|
10 |
|
11 |
+
## Performance
|
12 |
+
|
13 |
| Model | IFEval - TH | IFEval - EN | MT-Bench TH | MT-Bench EN | Thai Code-Switching (t=0.7) | Thai Code-Switching (t=1.0) | FunctionCall-TH | FunctionCall-EN |
|
14 |
|----------------------------|-------------|-------------|-------------|-------------|-----------------------------|-----------------------------|----------------|----------------|
|
15 |
| **Typhoon2 1b instruct** | **52.46%** | **53.35%** | **3.9725** | 5.2125 | 96.4% | **88%** | **34.96%** | **45.60%** |
|
16 |
| **Qwen2.5 1.5b instruct** | 44.42% | 48.45% | 2.9395 | **6.9343** | 82.6% | 20.6% | 13.83% | 17.88% |
|
17 |
| **llama3.2 1b instruct** | 31.76% | 51.15% | 2.5824 | 6.229 | **97.8%** | 22.6% | 29.88% | 36.50% |
|
18 |
|
19 |
+
### Instruction-Following & Function Call Performance
|
20 |
|
21 |
+
<div align="center">
|
22 |
+
<img src="https://storage.googleapis.com/typhoon-public/assets/typhoon2-text/llama1b_general.png" alt="Typhoon General Performance" width="100%" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
|
23 |
+
</div>
|
24 |
|
25 |
|
26 |
For release post, please see our [blog](...).
|