Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ license: llama3
|
|
7 |
---
|
8 |
**Llama-3-Typhoon-1.5X-8B-instruct: Thai Large Language Model (Instruct)**
|
9 |
|
10 |
-
**Llama-3-Typhoon-1.5X-8B-instruct** is an 8 billion parameter instruct model designed for Thai 🇹🇭 language. It demonstrates competitive performance with GPT-3.5-turbo, and is optimized for **
|
11 |
|
12 |
Built on Typhoon 1.5 8B and Llama 3 8B Instruct. This model is a result of our experiment on **cross-lingual transfer**. It utilizes the [task-arithmetic model editing](https://arxiv.org/abs/2212.04089) technique, combining the Thai understanding capability of Typhoon with the human alignment performance of Llama 3 Instruct.
|
13 |
|
@@ -28,7 +28,7 @@ We evaluated the model's performance in **Language & Knowledge Capabilities** an
|
|
28 |
- Assessed using multiple-choice question-answering datasets such as ThaiExam and MMLU.
|
29 |
- **Instruction Following Capabilities**:
|
30 |
- Evaluated based on our beta users' feedback, focusing on two factors:
|
31 |
-
- **Human Alignment & Reasoning**: Ability to generate responses that are
|
32 |
- Evaluated using [MT-Bench](https://arxiv.org/abs/2306.05685) — How LLMs can answer embedded knowledge to align with human needs.
|
33 |
- **Instruction-following**: Ability to adhere to specified constraints in the instruction
|
34 |
- Evaluated using [IFEval](https://arxiv.org/abs/2311.07911) — How LLMs can follow specified constraints, such as formatting and brevity.
|
@@ -63,7 +63,7 @@ Remark: We developed the TH pair by translating the original datasets into Thai
|
|
63 |
|
64 |
## Insight
|
65 |
|
66 |
-
|
67 |
|
68 |
## **Usage Example**
|
69 |
|
@@ -127,7 +127,7 @@ This model is experimental and might not be fully evaluated for all use cases. D
|
|
127 |
|
128 |
## **SCB 10X Typhoon Team**
|
129 |
|
130 |
-
- Kunat Pipatanakul, Potsawee Manakul, Sittipong Sripaisarnmongkol, Pathomporn Chokchainant, Kasima Tharnpipitchai
|
131 |
- If you find Typhoon-1.5X useful for your work, please cite it using:
|
132 |
|
133 |
```
|
|
|
7 |
---
|
8 |
**Llama-3-Typhoon-1.5X-8B-instruct: Thai Large Language Model (Instruct)**
|
9 |
|
10 |
+
**Llama-3-Typhoon-1.5X-8B-instruct** is an 8 billion parameter instruct model designed for Thai 🇹🇭 language. It demonstrates competitive performance with GPT-3.5-turbo, and is optimized for **application** use cases, **Retrieval-Augmented Generation (RAG), constrained generation**, and **reasoning** tasks.
|
11 |
|
12 |
Built on Typhoon 1.5 8B and Llama 3 8B Instruct. This model is a result of our experiment on **cross-lingual transfer**. It utilizes the [task-arithmetic model editing](https://arxiv.org/abs/2212.04089) technique, combining the Thai understanding capability of Typhoon with the human alignment performance of Llama 3 Instruct.
|
13 |
|
|
|
28 |
- Assessed using multiple-choice question-answering datasets such as ThaiExam and MMLU.
|
29 |
- **Instruction Following Capabilities**:
|
30 |
- Evaluated based on our beta users' feedback, focusing on two factors:
|
31 |
+
- **Human Alignment & Reasoning**: Ability to generate responses that are clear and logically structured across multiple steps.
|
32 |
- Evaluated using [MT-Bench](https://arxiv.org/abs/2306.05685) — How LLMs can answer embedded knowledge to align with human needs.
|
33 |
- **Instruction-following**: Ability to adhere to specified constraints in the instruction
|
34 |
- Evaluated using [IFEval](https://arxiv.org/abs/2311.07911) — How LLMs can follow specified constraints, such as formatting and brevity.
|
|
|
63 |
|
64 |
## Insight
|
65 |
|
66 |
+
We utilized **model editing** techniques and found that the most critical feature for generating accurate Thai answers is located in the backend (the upper layers of the transformer block). Accordingly, we incorporated a high ratio of Typhoon components in these backend layers to enhance our model’s performance.
|
67 |
|
68 |
## **Usage Example**
|
69 |
|
|
|
127 |
|
128 |
## **SCB 10X Typhoon Team**
|
129 |
|
130 |
+
- Kunat Pipatanakul, Potsawee Manakul, Sittipong Sripaisarnmongkol, Natapong Nitarach, Pathomporn Chokchainant, Kasima Tharnpipitchai
|
131 |
- If you find Typhoon-1.5X useful for your work, please cite it using:
|
132 |
|
133 |
```
|