Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,978

Full-text search

Active filters: instruct

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_S-GGUF

Text Generation • Updated Nov 19, 2024 • 10

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_M-GGUF

Text Generation • Updated Nov 19, 2024 • 10

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_S-GGUF

Text Generation • Updated Nov 19, 2024 • 11

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • Updated Nov 19, 2024 • 13

Triangle104/Llama3.2-3B-ShiningValiant2-Q6_K-GGUF

Text Generation • Updated Nov 19, 2024 • 12

Triangle104/Llama3.2-3B-ShiningValiant2-Q8_0-GGUF

Text Generation • Updated Nov 19, 2024 • 4

mradermacher/Llama3.2-3B-Enigma-GGUF

Updated Nov 20, 2024 • 375

mradermacher/BgGPT-Gemma-2-2.6B-IT-v1.0-GGUF

Updated Nov 20, 2024 • 52

mradermacher/Llama3.2-3B-Enigma-i1-GGUF

Updated Nov 20, 2024 • 236

mradermacher/BgGPT-Gemma-2-9B-IT-v1.0-GGUF

Updated Nov 20, 2024 • 102

mradermacher/BgGPT-Gemma-2-27B-IT-v1.0-GGUF

Updated Nov 20, 2024 • 41

mradermacher/BgGPT-Gemma-2-9B-IT-v1.0-i1-GGUF

Updated Nov 20, 2024 • 197 • 1

mradermacher/BgGPT-Gemma-2-2.6B-IT-v1.0-i1-GGUF

Updated Nov 20, 2024 • 140

mradermacher/BgGPT-Gemma-2-27B-IT-v1.0-i1-GGUF

Updated Nov 20, 2024 • 129

mradermacher/OpenBioLLM-Llama3-70B-GGUF

Updated Dec 15, 2024 • 93

mav23/13B-HyperMantis-GGUF

Updated Nov 21, 2024 • 135

ZeroXClem/Qwen2.5-7B-HomerAnvita-NerdMix

Text Generation • Updated Nov 22, 2024 • 233 • 4

Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B

Text Generation • Updated Nov 24, 2024 • 119 • 3

NikolayKozloff/BgGPT-Gemma-2-9B-IT-v1.0-Q8_0-GGUF

Text Generation • Updated Nov 22, 2024 • 11 • 1

NikolayKozloff/BgGPT-Gemma-2-2.6B-IT-v1.0-Q8_0-GGUF

Text Generation • Updated Nov 22, 2024 • 8 • 1

NikolayKozloff/BgGPT-Gemma-2-27B-IT-v1.0-Q2_K-GGUF

Text Generation • Updated Nov 22, 2024 • 5 • 1

mradermacher/Qwen2.5-7B-HomerAnvita-NerdMix-GGUF

Updated Nov 22, 2024 • 224 • 3

mradermacher/Qwen2.5-7B-HomerAnvita-NerdMix-i1-GGUF

Updated Nov 22, 2024 • 236 • 4

mradermacher/Qwen2.5-7B-HomerCreative-Mix-i1-GGUF

Updated Nov 22, 2024 • 138 • 3

Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • Updated 10 days ago • 110 • 3

artificialguybr/LLAMA3.2-1B-Synthia-I-Redmond-gguf

Updated Nov 24, 2024 • 730 • 1

mradermacher/Hermes-2-Pro-Mixtral-4x7B-GGUF

Updated Nov 25, 2024 • 40

ehristoforu/RQwen-v0.1

Text Generation • Updated Nov 25, 2024 • 29 • 2

Triangle104/Llama3.1-8B-ShiningValiant2-Q4_K_S-GGUF

Text Generation • Updated Nov 24, 2024 • 10 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q4_K_M-GGUF

Text Generation • Updated Nov 24, 2024 • 13 • 1