Commit
•
e78356d
1
Parent(s):
dc2add3
Update README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ tags:
|
|
| 10 |
|
| 11 |
A Chat Model, Testing only, no performance guaranteeeee...
|
| 12 |
|
| 13 |
-
In short: CausalLM / Qwen 8x7B MoE in Mixtral Arch, 8 real
|
| 14 |
|
| 15 |
Only intended for conceptual validation, however the expert models do not seem to be working as expected. The model could output text and complete the conversation normally, but the performance of the expert model was not significant.
|
| 16 |
|
|
|
|
| 10 |
|
| 11 |
A Chat Model, Testing only, no performance guaranteeeee...
|
| 12 |
|
| 13 |
+
In short: CausalLM / Qwen 8x7B MoE in Mixtral Arch, from 8 real, explainable expert models in different domains. Trained, not a merge.
|
| 14 |
|
| 15 |
Only intended for conceptual validation, however the expert models do not seem to be working as expected. The model could output text and complete the conversation normally, but the performance of the expert model was not significant.
|
| 16 |
|