TimeMobius
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -30,6 +30,9 @@ Mobius 12B 128k based on RWKV v5.2 arch, which is leading state based RNN+CNN+Tr
|
|
30 |
* [RWKV Runner](https://github.com/josStorer/RWKV-Runner)
|
31 |
* [Ai00 server](https://github.com/cgisky1980/ai00_rwkv_server)
|
32 |
|
|
|
|
|
|
|
33 |
## future plan
|
34 |
If you need a HF version let us know
|
35 |
|
|
|
30 |
* [RWKV Runner](https://github.com/josStorer/RWKV-Runner)
|
31 |
* [Ai00 server](https://github.com/cgisky1980/ai00_rwkv_server)
|
32 |
|
33 |
+
## Trainning details
|
34 |
+
pretrained with 100B high quality datasets.
|
35 |
+
|
36 |
## future plan
|
37 |
If you need a HF version let us know
|
38 |
|