File size: 375 Bytes
9cbdfd8 fd9a7a1 9cbdfd8 f9a2990 9cbdfd8 fd9a7a1 |
1 2 3 4 5 6 7 8 9 10 11 |
---
library_name: transformers
tags: []
---
## Description
Gemma-2-9b-it model finetuned by off-policy WPO. Details in [WPO: Enhancing RLHF with Weighted Preference Optimization](https://arxiv.org/abs/2406.11827).
## License
This model is licensed under the Zoom software license and is permitted for use only for noncommercial, educational, or academic research purposes. |