metadata
library_name: transformers
tags: []
Description
Gemma-2-9b-it model finetuned by off-policy WPO. Details in WPO: Enhancing RLHF with Weighted Preference Optimization.
License
This model is licensed under the Zoom software license and is permitted for use only for noncommercial, educational, or academic research purposes.