Update README.md
Browse files
README.md
CHANGED
@@ -30,7 +30,7 @@ This is an experimental product that can be used to create new LLM bassed on Chi
|
|
30 |
|
31 |
<!-- Provide the basic links for the model. -->
|
32 |
|
33 |
-
- **Repository:**
|
34 |
|
35 |
## Uses
|
36 |
|
@@ -103,12 +103,12 @@ BAAI/COIG-PC
|
|
103 |
|
104 |
#### Preprocessing [optional]
|
105 |
|
106 |
-
|
107 |
|
108 |
|
109 |
#### Training Hyperparameters
|
110 |
|
111 |
-
- **Training regime:**
|
112 |
|
113 |
|
114 |
## Evaluation
|
|
|
30 |
|
31 |
<!-- Provide the basic links for the model. -->
|
32 |
|
33 |
+
- **Repository:** https://huggingface.co/BlueWhaleX/Chinese-Alpaca-COIG-49954-7B-HF
|
34 |
|
35 |
## Uses
|
36 |
|
|
|
103 |
|
104 |
#### Preprocessing [optional]
|
105 |
|
106 |
+
80% for train dataset and 20% for test dataset
|
107 |
|
108 |
|
109 |
#### Training Hyperparameters
|
110 |
|
111 |
+
- **Training regime:** fp16 mixed precision, lr=1e-4, lora_rank=8, lora_alpha=32 <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
112 |
|
113 |
|
114 |
## Evaluation
|