Edit model card

Model Overview

This model has been fine-tuned using the GSM8K Preference Dataset with the Direct Preference Optimization algorithm. The goal of this fine-tuning is to enhance the model's performance in solving arithmetic problems on the GSM8K benchmark.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model’s pipeline type. Check the docs .

Dataset used to train August4293/mistral_gsm8k_ssl_it1