---
license: mit
language:
- ja
- en
- zh
tags:
- LLaMA2
- Japanese
- LLM
---

This model is traned with [llm-japanese-dataset](https://huggingface.co/datasets/izumi-lab/llm-japanese-dataset) dataset. And this model used a few of dataset by 50000 chat samples and 280000 non chat samples.  
Improved performance in Chinese and Japanese.  
Use the QLoRA to fine-tune the vanilla [Llama-2-13b-chat-hf](https://huggingface.co/NousResearch/Llama-2-13b-chat-hf).  
And you can use test.py to test the model.

### Recommend Generation parameters:
* temperature: 0.5~0.7
* top p: 0.65~1.0
* top k: 30~50
* repeat penalty: 1.03~1.17




Contribute by Yokohama Nationaly University Mori Lab.