Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,832

Full-text search

Active filters: quantized

MaziyarPanahi/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-MADNESS-GGUF

Text Generation • Updated Nov 7 • 33

MaziyarPanahi/Mistral-Nemo-Kurdish-Instruct-GGUF

Text Generation • Updated Nov 7 • 48

MaziyarPanahi/calme-3.2-instruct-3b-GGUF

Text Generation • Updated Nov 15 • 563

MaziyarPanahi/calme-3.1-baguette-3b-GGUF

Text Generation • Updated Nov 15 • 263

MaziyarPanahi/calme-3.2-baguette-3b-GGUF

Text Generation • Updated Nov 15 • 580

MaziyarPanahi/calme-3.3-baguette-3b-GGUF

Text Generation • Updated Nov 15 • 563

MaziyarPanahi/calme-3.2-qwenloi-3b-GGUF

Text Generation • Updated Nov 15 • 129

MaziyarPanahi/calme-3.3-qwenloi-3b-GGUF

Text Generation • Updated Nov 15 • 130

MaziyarPanahi/calme-3.1-llamaloi-3b-GGUF

Text Generation • Updated Nov 15 • 155

MaziyarPanahi/calme-3.3-llamaloi-3b-GGUF

Text Generation • Updated Nov 15 • 145

dwikitheduck/gen-try1-Q4_K_M-GGUF

Updated Nov 11 • 38

fahmizainal17/Meta-Llama-3-8B-Instruct-fine-tuned

Text Generation • Updated Nov 13 • 23

neuralmagic/Sparse-Llama-3.1-8B-gsm8k-2of4-FP8-dynamic

Text Generation • Updated 6 days ago • 136

shreyasmeher/ConflLlama-Alt

Text Classification • Updated Nov 19 • 26

Guchyos/gemma-2b-elyza-task

Text Generation • Updated Nov 18 • 4

TheMelonGod/Llama-3.1-8B-ArliAI-RPMax-v1.3-exl2

Text Generation • Updated 16 days ago • 24

dwikitheduck/gen-sql-1-Q4_K_M-GGUF

Updated Nov 18 • 60

jsjeon/SummLlama3.2-3B-Q4_K_M-GGUF

TheMelonGod/dolphin-2.9.4-llama3.1-8b-exl2

Text Generation • Updated 15 days ago • 46

neuralmagic/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16

Text Generation • Updated 6 days ago • 45

TheMelonGod/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base-exl2

Text Generation • Updated Nov 23 • 5

TheMelonGod/NaturalLM-exl2

Text Generation • Updated Nov 24 • 9

TheMelonGod/dolphin-2.9.3-mistral-7B-32k-exl2

Text Generation • Updated 9 days ago • 25

dwikitheduck/gen-inst-1-Q4_K_M-GGUF

Updated about 1 month ago • 91

namannn/llama2-13b-hyperbolic-cluster-pruned

Text Generation • Updated 23 days ago • 365

TheMelonGod/MN-12B-Lyra-v4-exl2

Text Generation • Updated 21 days ago • 18

MaziyarPanahi/magnum-twilight-12b-GGUF

Text Generation • Updated 19 days ago • 126

MaziyarPanahi/patricide-12B-Unslop-Mell-GGUF

Text Generation • Updated 19 days ago • 142

MaziyarPanahi/Capt-Dark-Science-12B-GGUF

Text Generation • Updated 19 days ago • 127

MaziyarPanahi/Dark-Science-12B-GGUF

Text Generation • Updated 19 days ago • 115