zomd commited on
Commit
7195bf1
1 Parent(s): 36887d6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +38 -10
README.md CHANGED
@@ -1,15 +1,43 @@
1
  ---
 
 
 
 
 
2
  license: cc-by-nc-4.0
3
  ---
4
 
5
- basemodel:
6
- - beomi/Yi-Ko-6B
7
-
8
- rank:
9
- 128
10
-
11
- alpha:
12
- 3
13
 
14
- Model Details Description This model is further finefuned model based on beomi/Yi-Ko-6B.
15
- DPO learning was also performed with additional data.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ datasets:
5
+ - Intel/orca_dpo_pairs
6
+ pipeline_tag: text-generation
7
  license: cc-by-nc-4.0
8
  ---
9
 
10
+ # AISquare-Instruct-yi-ko-6b-v0.9.30
 
 
 
 
 
 
 
11
 
12
+ ## Model Details
13
+
14
+ **Developed by** [Inswave Systems](https://www.inswave.com) UI Platform Team
15
+
16
+ **Method**
17
+ Using DPO method and SFT method
18
+
19
+ **Hardware**
20
+ We utilized an A100x4 * 1 for training our model
21
+
22
+ **Base Model**
23
+ [beomi/Yi-Ko-6B](https://huggingface.co/beomi/Yi-Ko-6B)
24
+
25
+ ## Open ko-leaderboard Rank
26
+ <img src='./ko-leaderboard.png' width=512>
27
+
28
+ # Implementation Code
29
+ ```python
30
+ from transformers import AutoModelForCausalLM, AutoTokenizer
31
+ import torch
32
+
33
+ repo = "zomd/AISquare-Instruct-yi-ko-6b-v0.9.30"
34
+ model = AutoModelForCausalLM.from_pretrained(
35
+ repo,
36
+ return_dict=True,
37
+ torch_dtype=torch.float16,
38
+ device_map='auto'
39
+ )
40
+ tokenizer = AutoTokenizer.from_pretrained(repo)
41
+ ```
42
+
43
+ ---