| license: cc-by-nc-4.0 | |
| language: | |
| - ko | |
| - en | |
| ## Base Model: | |
| We made a LLM model with davidkim205/nox-solar-10.7b-v4 | |
| ## Model Description | |
| We use QLOR(128, 32) and NEFTune on LLM Fine-tuning | |
| lr = 1e-5 | |
| , | |
| ## Train Detail | |
| Our private data used, 5 epoch train, and parameter changed | |
| ## Others | |
| We are making LLM model for Kolon ! |