--- language: - en base_model: - unsloth/Llama-3.2-3B-Instruct license: llama3.2 --- A much further trained version, this time done with full finetuning instead of DoRA. Similar ~50/50 mix of completion and instruct data. Note: This likely has refusals like [PJMixers-Dev/LLaMa-3.2-Instruct-JankMix-v0.1-SFT-3B](https://huggingface.co/PJMixers-Dev/LLaMa-3.2-Instruct-JankMix-v0.1-SFT-3B) since no focus was put on removing refusals. I'm working on a KTO DoRA to solve this, and possibly improve roleplay performance.