Hugging Face's logo

PriyanshiD
/
Llama-3.2-3B-bnb-4bit-python-DPO

Question Answering
Transformers
Safetensors
English
unsloth
llama
trl
Model card Files Community

Uploaded model

  • Developed by: PriyanshiD
  • License: apache-2.0
  • Finetuned from model : unsloth/Llama-3.2-3B-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
Question Answering
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for PriyanshiD/Llama-3.2-3B-bnb-4bit-python-DPO

Base model

meta-llama/Llama-3.2-3B
Quantized
unsloth/Llama-3.2-3B-bnb-4bit
Finetuned
(136)
this model

Dataset used to train PriyanshiD/Llama-3.2-3B-bnb-4bit-python-DPO