Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,940

Full-text search

Active filters: 2-bit

MaziyarPanahi/Phi-4-Empathetic-GGUF

Text Generation • Updated Jan 24 • 125

MaziyarPanahi/Phi-4-QwQ-GGUF

Text Generation • Updated Jan 24 • 155

MaziyarPanahi/Llama-8B-Distill-CoT-GGUF

Text Generation • Updated Jan 24 • 174

MaziyarPanahi/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • Updated Jan 24 • 729

MaziyarPanahi/xLAM-7b-fc-r-GGUF

Text Generation • Updated Jan 24 • 147

MaziyarPanahi/xLAM-1b-fc-r-GGUF

Text Generation • Updated Jan 24 • 110

ReadyArt/L3.3-Nevoria-R1-70b_EXL2_2.0bpw_H8

Text Generation • Updated Jan 27 • 13

roleplaiapp/Fimbulvetr-11B-v2-i1-Q2_K-GGUF

Text Generation • Updated Jan 27 • 4

roleplaiapp/Llama-3.2-3B-Instruct-uncensored-Q2_K-GGUF

Text Generation • Updated Jan 27 • 15

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q2_K-GGUF

Text Generation • Updated Jan 27 • 17

roleplaiapp/QwQ-32B-Preview-abliterated-Q2_K-GGUF

Text Generation • Updated Jan 27 • 21

roleplaiapp/MN-12B-Mag-Mell-R1-Q2_K-GGUF

Text Generation • Updated Jan 27 • 4

kaitchup/Llama-3.2-3B-Instruct-gptqmodel-2bit

Text Generation • Updated Feb 10 • 11

kaitchup/Llama-3.1-8B-Instruct-gptqmodel-2bit

Text Generation • Updated Feb 10 • 27

roleplaiapp/Midnight-Miqu-70B-v1.5-i1-Q2_K-GGUF

Text Generation • Updated Jan 27 • 12

ReadyArt/Chuluun-Qwen2.5-72B-v0.08_EXL2_2.0bpw_H8

Text Generation • Updated Jan 27 • 15

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q2_K-GGUF

Text Generation • Updated Jan 28 • 13

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q2_K-GGUF

Text Generation • Updated Jan 28 • 88

AlfRjw/Confucius-o1-14B-Q2-mlx

Text Generation • Updated Jan 29 • 17

raufrajar/gemma-2-2b-it-2bit

Text Generation • Updated Jan 28 • 12

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q2_K-GGUF

Text Generation • Updated Jan 29 • 37

roleplaiapp/14B-Qwen2.5-Kunou-v1-Q2_K-GGUF

Text Generation • Updated Jan 29 • 3

roleplaiapp/Chocolatine-2-14B-Instruct-v2.0b2-i1-Q2_K-GGUF

Text Generation • Updated Jan 29 • 2

kaitchup/Qwen2.5-1.5B-Instruct-gptqmodel-2bit

Text Generation • Updated Feb 4 • 24

roleplaiapp/q-2.5-deepseek-r1-veltha-v0.3-Q2_K-GGUF

Text Generation • Updated Jan 29

roleplaiapp/DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q2_K-GGUF

Text Generation • Updated Jan 29 • 14

roleplaiapp/Reasoning-Llama-3.1-CoT-RE1-i1-Q2_K-GGUF

Text Generation • Updated Jan 29 • 1

kaitchup/Qwen2.5-7B-Instruct-gptqmodel-2bit

Text Generation • Updated Feb 4 • 18

roleplaiapp/Phi-4-ReasoningRP-Q2_K-GGUF

Text Generation • Updated Jan 29 • 2

roleplaiapp/Lascivious-LLaMa-70B-Q2_K-GGUF

Text Generation • Updated Jan 29 • 420