File size: 458 Bytes
a26a56f 5ddbc49 a26a56f 5ddbc49 a26a56f 5ddbc49 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
library_name: transformers
tags:
- gsm8k
- dpo
datasets:
- August4293/gsm8k_preference_dataset_it_1
language:
- en
---
## Model Overview
This model has been fine-tuned using the [GSM8K Preference Dataset](https://huggingface.co/datasets/August4293/gsm8k_preference_dataset_it_1) with the Direct Preference Optimization algorithm. The goal of this fine-tuning is to enhance the model's performance in solving arithmetic problems on the GSM8K benchmark.
|