OpenMOSE
/

RWKV-x070-Potato

Model card Files Files and versions Community

OpenMOSE commited on Feb 7

Commit

fca3a6d

·

verified ·

1 Parent(s): e325b5e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ license: apache-2.0
 - **Training Approch**: LoRA(r=256)
 - **Expert Configuration**:
   - Total LoRA Experts: 4
-  - Active LoRA Experts: 2
 - **End Token**: `\n\n\x17`
 - **Inference**: only supported latest RWKV-Infer

 - **Training Approch**: LoRA(r=256)
 - **Expert Configuration**:
   - Total LoRA Experts: 4
+  - Active LoRA Experts: 2(Shared Expert0 + n)
 - **End Token**: `\n\n\x17`
 - **Inference**: only supported latest RWKV-Infer