Hugging Face's logo

cookinai
/
NeuralLlama-3-ORPO

Text Generation
Transformers
PyTorch
English
llama
text-generation-inference
unsloth
trl
orpo
Inference Endpoints
Model card Files Community
NeuralLlama-3-ORPO
File size: 744 Bytes 
5054b28
 
 
 
 
 
 
 
 
 
00ad549
5054b28
 
 
9a70fa3
5054b28
5565dd5
0705605
80d76ad
 
5054b28
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
 
---
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
- orpo
base_model: unsloth/llama-3-8b-bnb-4bit
---

# Llama-3-8B ORPOtuned on Intel/orca_dpo_pairs dataset

![Brain](https://huggingface.co/cookinai/NeuralLlama-3-ORPO/resolve/main/-hracBXbjuRHUd8dJwTEn.png)

Further Testing Needed

- **Developed by:** cookinai
- **License:** apache-2.0
- **Finetuned from model :** unsloth/llama-3-8b-bnb-4bit

This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)