maywell commited on
Commit
31a62db
โ€ข
1 Parent(s): c722f92

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +69 -0
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-sa-4.0
3
+ language:
4
+ - ko
5
+ - en
6
+ ---
7
+
8
+ # **kiqu-70b**
9
+ <img src="./kiqu.webp" alt="kiqu-70B" width="390"/>
10
+
11
+ **kiqu-70b** is a SFT+DPO trained model based on Miqu-70B-Alpaca-DPO using **Korean** datasets.
12
+
13
+ Since this model is finetune of miqu-1-70b using it on commercial purposes is at your own risk. โ€” leaked early version Mistral-Medium
14
+
15
+ ๋ณธ ๋ชจ๋ธ **kiqu-70b**๋Š” Miqu-70B-Alpaca-DPO ๋ชจ๋ธ์„ ๊ธฐ๋ฐ˜์œผ๋กœ **ํ•œ๊ตญ์–ด** ๋ฐ์ดํ„ฐ์…‹์„ ์‚ฌ์šฉํ•˜์—ฌ SFT+DPO ํ›ˆ๋ จ์„ ์ง„ํ–‰ํ•˜์—ฌ ์ œ์ž‘๋˜์—ˆ์Šต๋‹ˆ๋‹ค.
16
+
17
+ ๋ฒ ์ด์Šค ๋ชจ๋ธ์ธ miqu-1-70b ๋ชจ๋ธ์ด ๋ฏธ์ŠคํŠธ๋ž„-๋ฏธ๋””์›€์˜ ์ดˆ๊ธฐ ์œ ์ถœ ๋ฒ„์ „์ด๊ธฐ์— ์ƒ์—…์  ์‚ฌ์šฉ์— ๋Œ€ํ•œ risk๋Š” ๋ณธ์ธ์—๊ฒŒ ์žˆ์Šต๋‹ˆ๋‹ค.
18
+
19
+ Beside that this model follows **cc-by-sa-4.0**
20
+
21
+ ๋ณธ ๋ชจ๋ธ ์ž์ฒด๋กœ์„œ๋Š” **cc-by-sa-4.0**์„ ๋”ฐ๋ฆ…๋‹ˆ๋‹ค.
22
+
23
+ # **Model Details**
24
+
25
+ **Base Model**
26
+ miqu-1-70b (Early Mistral-Medium)
27
+
28
+ **Instruction format**
29
+
30
+ It follows **Mistral** format.
31
+ Giving few-shots to model is highly recommended
32
+
33
+ ๋ณธ ๋ชจ๋ธ์€ ๋ฏธ์ŠคํŠธ๋ž„ ํฌ๋งท์„ ๋”ฐ๋ฆ…๋‹ˆ๋‹ค.
34
+ few-shot ์‚ฌ์šฉ์„ ์ ๊ทน ๊ถŒ์žฅํ•ฉ๋‹ˆ๋‹ค.
35
+ ```
36
+ <s>[INST] {instruction}
37
+ [/INST] {output}</s>
38
+ ```
39
+
40
+ Multi-shot
41
+ ```
42
+ <s>[INST] {instruction}
43
+ [/INST] {output}
44
+
45
+ [INST] {instruction}
46
+ [/INST] {output}
47
+
48
+ [INST] {instruction}
49
+ [/INST] {output}</s>
50
+ .
51
+ .
52
+ .
53
+ ```
54
+
55
+ # **Model Benchmark**
56
+ TBD
57
+
58
+
59
+ # **Author's Message**
60
+
61
+ This model's training got sponsered by no one but support from people around Earth.
62
+
63
+ [Support Me](https://www.buymeacoffee.com/mwell)
64
+
65
+ [Discord Server](https://discord.gg/MrBt3PXdXc)
66
+
67
+ Contact Me on Discord - is.maywell
68
+
69
+ Follow me on twitter - https://twitter.com/stablefluffy