|
--- |
|
language: |
|
- ms |
|
- en |
|
- zh |
|
- ta |
|
--- |
|
|
|
# Malaysian Llama 3.2 3B Instruct |
|
|
|
Continue finetuning https://huggingface.co/meta-llama/Llama-3.2-3B on Malaysian instruction dataset. |
|
|
|
## Improvement |
|
|
|
1. 128k context length. |
|
2. Support respond in Mandarin, Tamil, Jawi, Johor, Kedah, Kelantan, Pahang, Perak, Sabah, Sarawak, Selangor, Negeri Sembilan and Terengganu. |
|
3. Able to code in Mandarin, Tamil, Jawi, Johor, Kedah, Kelantan, Pahang, Perak, Sabah, Sarawak, Selangor, Negeri Sembilan and Terengganu. |
|
4. Multi-turn Malaysian context such as related to Malaysian Legislation, politics, religions and languages. |
|
5. Malaysian role-playing. |
|
6. Standard RAG. |
