---
license: cc-by-nc-4.0
language:
- ko
- en
---

## Base Model:
We made a LLM model with yanolja/KoSOLAR-10.7B-v0.3 

## Model Description
We use QLoRA(64, 16) and NEFTune on LLM Fine-tuning
lr = 2e-4

## Train Detail
Our Korean Wiki QA data used, and 3 epoch train

## Others
We are making LLM model for Kolon !