Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,580

Full-text search

Active filters: instruct

Triangle104/Llama3.1-8B-ShiningValiant2-Q5_K_S-GGUF

Text Generation • Updated Nov 24 • 25 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • Updated Nov 24 • 32 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q6_K-GGUF

Text Generation • Updated Nov 24 • 26 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q8_0-GGUF

Text Generation • Updated Nov 24 • 31 • 1

artificialguybr/LLAMA3.2-1B-Synthia-II-Redmond-gguf

Updated Nov 25 • 580 • 1

mav23/SOLAR-0-70b-16bit-GGUF

Text Generation • Updated about 1 month ago • 401 • 1

QuantFactory/BgGPT-Gemma-2-9B-IT-v1.0-GGUF

Text Generation • Updated about 1 month ago • 869 • 1

QuantFactory/Qwen2.5-7B-HomerCreative-Mix-GGUF

Updated about 1 month ago • 567 • 2

mradermacher/RQwen-v0.1-GGUF

Updated about 1 month ago • 357 • 2

mradermacher/OpenHermes-Mixtral-8x7B-i1-GGUF

Updated 29 days ago • 571 • 1

QuantFactory/BgGPT-Gemma-2-2.6B-IT-v1.0-GGUF

Text Generation • Updated 29 days ago • 1.03k • 2

DavidAU/L3.1-Instruct-Guru-8B-GGUF

Text Generation • Updated 27 days ago • 715 • 2

Fluxter/OpenHermes-2.5-Mistral-7B-Q8_0-GGUF

Updated 27 days ago • 29 • 1

QuantFactory/Qwen2.5-7B-HomerAnvita-NerdMix-GGUF

Text Generation • Updated 23 days ago • 852 • 2

prithivMLmods/SmolLM2-Math-IIO-1.7B-Instruct

Text Generation • Updated 23 days ago • 120 • 8

mav23/Hermes-Trismegistus-Mistral-7B-GGUF

Updated 22 days ago • 382 • 1

sapienzanlp/Minerva-7B-instruct-v1.0-GGUF

Text Generation • Updated 19 days ago • 416 • 3

mradermacher/Novus-7b-tr_v1-GGUF

Updated 18 days ago • 182 • 1

mradermacher/Novus-7b-tr_v1-i1-GGUF

Updated 18 days ago • 360 • 1

hierholzer/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated 14 days ago • 503 • 1

bartowski/Hermes-3-Llama-3.2-3B-GGUF

Text Generation • Updated 14 days ago • 2.18k • 4

NikolayKozloff/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated 14 days ago • 28 • 1

namelessai/mythalion-13b-Q4_K_M-GGUF

Text Generation • Updated 10 days ago • 24 • 1

QuantFactory/Hermes-3-Llama-3.2-3B-GGUF

Updated 7 days ago • 935 • 2

QuantFactory/OpenHermes-Emojitron-001-GGUF

Updated 13 days ago • 473 • 2

lunahr/Hermes-3-Llama-3.2-3B-abliterated

Text Generation • Updated 13 days ago • 67 • 1

darkc0de/Hermes-3-Llama-3.2-3B-abliterated-Q5_K_M-GGUF

Updated 12 days ago • 43 • 1

mradermacher/Hermes-3-Llama-3.2-3B-abliterated-GGUF

Updated 11 days ago • 533 • 1

mradermacher/Hermes-3-Llama-3.2-3B-abliterated-i1-GGUF

Updated 11 days ago • 812 • 1

huihui-ai/Hermes-3-Llama-3.2-3B-abliterated

Text Generation • Updated 9 days ago • 34 • 1