Hugging Face's logo

shi3z
/
RWKV-LM-LoRA-Alpaca-Cleaned-Japan

Japanese
Model card Files Community
1
shi3z commited on
Commit
bf4ad79
·
1 Parent(s): 07bc8d3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -13,6 +13,10 @@ https://github.com/Blealtan/RWKV-LM-LoRA
13
  Dataset:
14
  https://github.com/shi3z/alpaca_ja
15
 
 
 
 
 
16
  Training Prompt:
17
  python train.py \
18
  --load_model RWKV-4-Pile-14B-Instruct-test5-20230329-ctx4096.pth \
 
13
  Dataset:
14
  https://github.com/shi3z/alpaca_ja
15
 
16
+ Loss:
17
+ Epoch 320: loss 0.76
18
+ Epoch 500: loss 0.62
19
+
20
  Training Prompt:
21
  python train.py \
22
  --load_model RWKV-4-Pile-14B-Instruct-test5-20230329-ctx4096.pth \