Zephyr ORPO
Collection
Models and datasets to align LLMs with Odds Ratio Preference Optimisation (ORPO). Recipes here: https://github.com/huggingface/alignment-handbook
β’
3 items
β’
Updated
β’
17