File size: 593 Bytes
027067b 9cdc359 027067b 9cdc359 027067b 9cdc359 027067b 9cdc359 027067b 9cdc359 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
---
library_name: transformers
license: apache-2.0
datasets:
- TokenBender/code_instructions_122k_alpaca_style
---
# Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->
This is a LoRA adapter for Mistral-Instruct-v0.2
Base Model: [Mistral-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
Dataset: [TokenBender/code_instructions_122k_alpaca_style](https://huggingface.co/datasets/TokenBender/code_instructions_122k_alpaca_style)
Test run, trained on subsample of 5k examples for 1 epoch using QLoRa technique.
Final loss: 0.394200 |