Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

4,938

Full-text search

Active filters: dpo

sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-05

Updated Sep 3, 2024 • 5

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-coding-group-dpo

Text Generation • Updated Sep 3, 2024 • 8

mradermacher/zephyr-7b-hh-dpo-i1-GGUF

Updated Sep 3, 2024 • 246

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-dpo-2

Text Generation • Updated Sep 3, 2024 • 6

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-coding-dpo-2

Text Generation • Updated Sep 3, 2024 • 8

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-coding-dpo-2

Text Generation • Updated Sep 3, 2024 • 6

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-logic-dpo-2

Text Generation • Updated Sep 3, 2024 • 4

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-dpo-2

Text Generation • Updated Sep 3, 2024 • 8

tsavage68/Na_L3_1000steps_1e6rate_03beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 6

NicholasCorrado/tinyllama-1.1b-chat-v1.0-rlced-conifer-3-1-dpo

Text Generation • Updated Sep 4, 2024 • 4

NicholasCorrado/tulu-2-7b-rlced-conifer-dpo

Text Generation • Updated Sep 4, 2024 • 7

tsavage68/Na_L3_1000steps_1e6rate_01beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 5

NanQiangHF/llama3.1_8b_dpo_bwgenerator

Updated Sep 18, 2024 • 3

tsavage68/Na_L3_150steps_1e6rate_01beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 4

tsavage68/Na_L3_100steps_1e6rate_03beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 4

NicholasCorrado/zephyr-7b-uf-rlced-conifer-dpo-2e

Text Generation • Updated Sep 6, 2024 • 9

tsavage68/Na_L3_1000steps_1e6rate_05beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 6

tsavage68/Na_L3_100steps_1e6rate_05beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 4

CultriX/Lama-DPOlphin-8B-Q3_K_S-GGUF

Text Generation • Updated Sep 4, 2024 • 11 • 1

CultriX/Lama-DPOlphin-8B-Q4_K_S-GGUF

Text Generation • Updated Sep 4, 2024 • 11 • 1

QuantFactory/Fireball-3.1-8B-ORPO-GGUF

Text Generation • Updated Sep 4, 2024 • 36 • 2

mradermacher/Lama-DPOlphin-8B-GGUF

Updated Sep 4, 2024 • 247 • 1

tsavage68/Na_L3_1000steps_1e7rate_01beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 4

tsavage68/Na_L3_1000steps_1e7rate_03beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 4

tsavage68/Na_L3_350steps_1e7rate_01beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 7

tsavage68/Na_L3_250steps_1e7rate_03beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 4

tsavage68/Na_L3_1000steps_1e7rate_05beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 4

tsavage68/Na_L3_350steps_1e7rate_05beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 4

mradermacher/Lama-DPOlphin-8B-i1-GGUF

Updated Sep 4, 2024 • 274 • 1

tsavage68/Na_M2_1000steps_1e7rate_01beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 8