| language: | |
| - en | |
| license: apache-2.0 | |
| tags: | |
| - text-generation-inference | |
| - transformers | |
| - unsloth | |
| - mistral | |
| - trl | |
| - medical | |
| datasets: | |
| - Shekswess/medical_mistral_instruct_dataset_short | |
| base_model: unsloth/mistral-7b-instruct-v0.2-bnb-4bit | |
| - **Developed by:** Shekswess | |
| - **License:** apache-2.0 | |
| - **Finetuned from model :** unsloth/mistral-7b-instruct-v0.2-bnb-4bit | |
| To utilize the finetuning of the model, you need to use the mistral instruction prompt template for this medical version of the model : | |
| ``` | |
| [INST] Answer the question truthfully, you are a medical professional. This is the question: {question} [/INST] | |
| ``` | |
| Metrics: | |
| - train_runtime: 4344.2962 | |
| - train_samples_per_second: 0.691 | |
| - train_steps_per_second: 0.086 | |
| - total_flos: 5.890426176208896e+16 | |
| - train_loss: 1.0629666401545206 | |
| - steps: 375 | |
| - epoch: 1.0 | |
|  | |