Uploaded model

Developed by: mazzaqq
License: apache-2.0
Finetuned from model: mazzaqq/SFT-base_merged_fp16

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Model tree for mazzaqq/meta-llama-Meta-Llama-3.1-8B-Instruct-DPO_3neg

Base model

Finetuned

(3)

this model