Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
This is the first model which converts Qwen2.5-7B's checkpoint to RWKV-7 architecture.
|
2 |
+
It's trained in one A800 for one day which might not be that versatile. It shows an acceptable performance to chat with you fluently.
|
3 |
+
The shortage is that this base model can't do math and related tasks. I'll add a more balanced data to improve that model's capability later.
|
4 |
+
|
5 |
+
Please refer the https://github.com/yynil/RWKVinLLAMA/blob/rwkv_7/gradio/chat_rwkv7.py about how to use it.
|
6 |
+
|
7 |
+
|