Commit
·
7c507c0
1
Parent(s):
deeb947
Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,7 @@ language:
|
|
10 |
inference: false
|
11 |
---
|
12 |
# Model Card for Mobius-12B-base-m1
|
13 |
-
The Mobius-12B-base-m1 Large Language Model (LLM) is a pretrained model based on RWKV v5 arch. We use 0.01B tokens to post train this model.
|
14 |
|
15 |
|
16 |
## Warning
|
@@ -27,6 +27,9 @@ User: {Instruction|prompt}\n\nAssistant:
|
|
27 |
```
|
28 |
|
29 |
## Run the model
|
|
|
|
|
|
|
30 |
Need to install this [PR](https://github.com/huggingface/transformers/pull/26963)
|
31 |
pip install -e git://github.com/BBuf/transformers.git
|
32 |
|
|
|
10 |
inference: false
|
11 |
---
|
12 |
# Model Card for Mobius-12B-base-m1
|
13 |
+
The Mobius-12B-base-m1 Large Language Model (LLM) is a pretrained model based on RWKV v5 arch. We use 0.01B tokens to post train this model for alignment benchmarks.
|
14 |
|
15 |
|
16 |
## Warning
|
|
|
27 |
```
|
28 |
|
29 |
## Run the model
|
30 |
+
|
31 |
+
[need to convert checkpoint to HF format](https://github.com/xiaol/RWKV-World-HF-Tokenizer?tab=readme-ov-file#huggingface-rwkv-world-model-convert)
|
32 |
+
|
33 |
Need to install this [PR](https://github.com/huggingface/transformers/pull/26963)
|
34 |
pip install -e git://github.com/BBuf/transformers.git
|
35 |
|