Update README.md
Browse files
README.md
CHANGED
@@ -25,7 +25,7 @@ A pretrained generative language model with ~47 billion parameters geared toward
|
|
25 |
|
26 |
## Model Details
|
27 |
|
28 |
-
This model was built via parameter-efficient finetuning of the [mistralai/Mixtral-8x7B-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) base model on the first
|
29 |
|
30 |
- **Developed by:** Daniel Furman
|
31 |
- **Model type:** Causal language model (clm)
|
|
|
25 |
|
26 |
## Model Details
|
27 |
|
28 |
+
This model was built via parameter-efficient finetuning of the [mistralai/Mixtral-8x7B-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) base model on the first 40k rows in each of the [jondurbin/airoboros-2.2.1](https://huggingface.co/datasets/jondurbin/airoboros-2.2.1), [Open-Orca/SlimOrca](https://huggingface.co/datasets/Open-Orca/SlimOrca), and [garage-bAInd/Open-Platypus](https://huggingface.co/datasets/garage-bAInd/Open-Platypus) datasets.
|
29 |
|
30 |
- **Developed by:** Daniel Furman
|
31 |
- **Model type:** Causal language model (clm)
|