File size: 625 Bytes
c628c5e da444c8 c628c5e da444c8 586a6be da444c8 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 |
---
license: apache-2.0
datasets: We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs
language:
- ko
pipeline_tag: text-generation
---
**Explanation**
- With the base model, applied DPO to the small amount of layers with the open dataset , saved just the adapter part
- Merged the base model and the tuned adapter together
**Base Model**
- [yanolja/KoSOLAR-10.7B-v0.3](https://huggingface.co/yanolja/KoSOLAR-10.7B-v0.3)
**Used Corpus**
- [We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs](https://huggingface.co/datasets/We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs)
**Score**
- TBU
**Log**
- 2024.02.13: Initial version Upload
**LICENSE**
- Apache 2.0 |