File size: 486 Bytes
acaa471
 
 
 
 
 
5e90c73
acaa471
 
5e90c73
acaa471
5e90c73
 
 
 
 
 
 
 
1b5f1ef
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
---
license: apache-2.0
datasets:
- HuggingFaceH4/ultrafeedback_binarized
language:
- en
- fr
base_model:
- NousResearch/Nous-Hermes-llama-2-7b
- meta-llama/Llama-2-7b
pipeline_tag: text-generation
metrics:
- accuracy
- bertscore
- bleurt
- brier_score
tags:
- biology
- chemistry
---

Trained NousResearch/Nous-Hermes-llama-2-7b on UltraFeedback for Direct Preference Optimization on the preference data created on Ultrafeedback having difference b/w chosen score and rejected score>=5