Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,26 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
+
datasets: We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs
|
4 |
+
language:
|
5 |
+
- ko
|
6 |
+
pipeline_tag: text-generation
|
7 |
---
|
8 |
+
|
9 |
+
**Explanation**
|
10 |
+
- With the base model, applied DPO to the small amount of layers with the open dataset , saved just the adapter part
|
11 |
+
- Merged the base model and the tuned adapter together
|
12 |
+
|
13 |
+
**Base Model**
|
14 |
+
- [yanolja/KoSOLAR-10.7B-v0.3](https://huggingface.co/yanolja/KoSOLAR-10.7B-v0.3)
|
15 |
+
|
16 |
+
**Used Corpus**
|
17 |
+
- [We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs](https://huggingface.co/datasets/We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs)
|
18 |
+
|
19 |
+
**Score**
|
20 |
+
TBU
|
21 |
+
|
22 |
+
**Log**
|
23 |
+
- 2024.02.13: Initial version Upload
|
24 |
+
|
25 |
+
**LICENSE**
|
26 |
+
- Apache 2.0
|