yjf9966 commited on
Commit
51763dc
·
1 Parent(s): 327d85f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -30,7 +30,7 @@ This is an experimental product that can be used to create new LLM bassed on Chi
30
 
31
  <!-- Provide the basic links for the model. -->
32
 
33
- - **Repository:** [https://huggingface.co/BlueWhaleX/Chinese-Alpaca-COIG-49954-7B-HF]
34
 
35
  ## Uses
36
 
@@ -103,12 +103,12 @@ BAAI/COIG-PC
103
 
104
  #### Preprocessing [optional]
105
 
106
- [80% for train dataset and 20% for test dataset]
107
 
108
 
109
  #### Training Hyperparameters
110
 
111
- - **Training regime:** [fp16 mixed precision, lr=1e-4, lora_rank=8, lora_alpha=32] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
112
 
113
 
114
  ## Evaluation
 
30
 
31
  <!-- Provide the basic links for the model. -->
32
 
33
+ - **Repository:** https://huggingface.co/BlueWhaleX/Chinese-Alpaca-COIG-49954-7B-HF
34
 
35
  ## Uses
36
 
 
103
 
104
  #### Preprocessing [optional]
105
 
106
+ 80% for train dataset and 20% for test dataset
107
 
108
 
109
  #### Training Hyperparameters
110
 
111
+ - **Training regime:** fp16 mixed precision, lr=1e-4, lora_rank=8, lora_alpha=32 <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
112
 
113
 
114
  ## Evaluation