Aligned models based on Zephyr-SFT from Table 2 and 3 in the KTO paper by Ethayarajh et al. (2024) (https://arxiv.org/pdf/2402.01306).