Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

4-bit precision

Models

10,114

Full-text search

Active filters: llama-cpp

ooff123/lawyer-llama-13b-v2-Q4_K_M-GGUF

Updated Jul 26 • 31.4k • 3

iG8R/t5_translate_en_ru_zh_large_1024_v2-Q8_0-GGUF

Translation • Updated Jul 26 • 189 • 4

ooff123/DISC-LawLLM-Q4_K_M-GGUF

Updated Jul 27 • 26 • 2

ooff123/lawyer-llama-13b-v2-Q4_K_S-GGUF

Updated Jul 28 • 23 • 1

PabloSuaLap/llama-3.1-8b-instruct-reglamentacion-V1-Q4_K_M-GGUF

Text Generation • Updated Jul 30 • 9 • 1

kpranav22/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 1 • 63 • 1

jpacifico/Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF

Text Generation • Updated Aug 4 • 261 • 6

cyanic-selkie/flan-t5-small-Q4_K_M-GGUF

Text2Text Generation • Updated Aug 5 • 25 • 1

networkjohnny0/DeepSeek-Coder-V2-Lite-Base-Q4_K_M-GGUF

Updated Aug 11 • 1 • 1

ysn-rfd/gpt2-Q8_0-GGUF

Updated Oct 25 • 58 • 1

neifuisan/Gemma2-9b-Neuro-sama-Q4_K_M-GGUF

Text Generation • Updated Aug 12 • 1.94k • 1

wsxiaoys/jina-embeddings-v2-base-code-Q8_0-GGUF

Feature Extraction • Updated Aug 11 • 61 • 2

Sri-Vigneshwar-DJ/sarvam-2b-v0.5-GGUF

Updated 25 days ago • 29 • 2

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • Updated Sep 2 • 579 • 9

hellork/calme-2.1-qwen2-7b-Q4_K_M-GGUF

Text Generation • Updated Sep 17 • 1

RealTruth/secgpt-Q8_0-GGUF

Text Generation • Updated Aug 16 • 275 • 1

urkz/sarashina2-13b-Q4_K_M-GGUF

Updated Aug 22 • 14 • 1

SteelTalon/nephra_v1.0-Q4_K_M-GGUF

Updated Aug 23 • 14 • 1

KeyurRamoliya/multilingual-e5-large-instruct-GGUF

Updated Aug 23 • 61 • 1

jpacifico/Chocolatine-3B-Instruct-DPO-v1.2-Q4_K_M-GGUF

Text Generation • Updated Oct 18 • 10 • 2

v000000/L3.1-Niitorm-8B-LATCOSx2-Version-GGUFs-IMATRIX

Updated Aug 30 • 142 • 4

Triangle104/MN-12B-Starcannon-v3-Q4_K_M-GGUF

Updated Nov 19 • 11 • 1

Triangle104/MN-12B-Starcannon-v3-Q5_K_M-GGUF

Updated Nov 19 • 4 • 1

ywms666/gpt-neox-20b-fiction-novel-generation-Q4_K_M-GGUF

Text Generation • Updated Aug 30 • 159 • 1

Triangle104/phi3.5-gutenberg-4B-Q4_K_M-GGUF

Updated Oct 27 • 17 • 1

onix331/L3-8B-Stheno-v3.2-Q6_K-GGUF

Updated Sep 3 • 3 • 2

Pelegoto/Honey-Yuzu-Mod-13B-Q5_K_M-GGUF

Updated Sep 5 • 5 • 2

bunnycore/HyperLlama3.1-v2-Q4_K_M-GGUF

Updated Sep 7 • 4 • 1

tianlp/flan-t5-large-Q4_K_M-GGUF

Text2Text Generation • Updated Sep 10 • 10 • 1

jpacifico/Chocolatine-3B-Instruct-DPO-Revised-Q8_0-GGUF

Text Generation • Updated Sep 12 • 40 • 2