yueyulin commited on
Commit
3dfd592
1 Parent(s): 08b373c

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ This is the first model which converts Qwen2.5-7B's checkpoint to RWKV-7 architecture.
2
+ It's trained in one A800 for one day which might not be that versatile. It shows an acceptable performance to chat with you fluently.
3
+ The shortage is that this base model can't do math and related tasks. I'll add a more balanced data to improve that model's capability later.
4
+
5
+ Please refer the https://github.com/yynil/RWKVinLLAMA/blob/rwkv_7/gradio/chat_rwkv7.py about how to use it.
6
+
7
+