Uploaded model
- Developed by: keithdrexel
- License: apache-2.0
- Finetuned from model : keithdrexel/unsloth-llama-3.2-1b-tldr-unsloth-nobnb
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- 8
Model tree for keithdrexel/unsloth-llama-3.2-1b-tldr-unsloth-dpo
Base model
meta-llama/Llama-3.2-1B
Finetuned
unsloth/Llama-3.2-1B