---
license: apache-2.0
datasets:
- abacusai/MetaMathFewshot
---

DPO finetune of our [MetaMath SFT Model](https://huggingface.co/abacusai/MM-Orc-Vic-bagel-34b-c1000) on the [Truthy DPO dataset](https://huggingface.co/datasets/jondurbin/truthy-dpo-v0.1)

### Evaluation Results

| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
| --- | --- | --- | --- | --- | --- | --- |
|  75.54  | 69.20 | 84.34  |   76.46 | 67.58 | 82.87 | 72.78 |