Update README.md
Browse files
README.md
CHANGED
|
@@ -25,7 +25,7 @@ A pretrained generative language model with ~47 billion parameters geared toward
|
|
| 25 |
|
| 26 |
## Model Details
|
| 27 |
|
| 28 |
-
This model was built via parameter-efficient finetuning of the [mistralai/Mixtral-8x7B-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) base model on the first
|
| 29 |
|
| 30 |
- **Developed by:** Daniel Furman
|
| 31 |
- **Model type:** Causal language model (clm)
|
|
|
|
| 25 |
|
| 26 |
## Model Details
|
| 27 |
|
| 28 |
+
This model was built via parameter-efficient finetuning of the [mistralai/Mixtral-8x7B-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) base model on the first 40k rows in each of the [jondurbin/airoboros-2.2.1](https://huggingface.co/datasets/jondurbin/airoboros-2.2.1), [Open-Orca/SlimOrca](https://huggingface.co/datasets/Open-Orca/SlimOrca), and [garage-bAInd/Open-Platypus](https://huggingface.co/datasets/garage-bAInd/Open-Platypus) datasets.
|
| 29 |
|
| 30 |
- **Developed by:** Daniel Furman
|
| 31 |
- **Model type:** Causal language model (clm)
|