Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

11,151

Full-text search

Active filters: gguf-my-repo

bunnycore/Tulu-3.1-8B-SuperNova-Smart-IQ4_XS-GGUF

Updated Nov 23, 2024 • 10 • 1

hardikg2907/code-llama-html-completion-1-Q2_K-GGUF

Updated Nov 26, 2024 • 8 • 1

nanowell/QwQ-32B-Preview-Q4_K_M-GGUF

Text Generation • Updated Nov 27, 2024 • 79 • 7

gchrisoh/Llama-3-8B-Jonathan-aLLM-Instruct-v1.0-Q4_K_M-GGUF

Text Generation • Updated Nov 28, 2024 • 1 • 1

djuna/qwen2.5-11B-Mzy-Q4_K_M-GGUF

Updated Nov 28, 2024 • 1 • 1

deltanym/QwQ-32B-Preview-abliterated-Q4_K_M-GGUF

Text Generation • Updated Nov 29, 2024 • 7 • 2

performanceoptician/MiniCPM3-4B-IQ4_NL-GGUF

Text Generation • Updated Dec 1, 2024 • 21 • 2

Triangle104/Loki-v2.8-8b-EROTICA-Q5_K_M-GGUF

Updated Dec 2, 2024 • 45 • 1

matrixportal/Llama-3.2-3B-Instruct-uncensored-Q4_K_M-GGUF

Updated Dec 3, 2024 • 14 • 1

matrixportal/L3-8B-Stheno-v3.3-32K-Q3_K_M-GGUF

Updated Dec 5, 2024 • 20 • 1

Triangle104/Impish_Mind_8B-Q4_K_S-GGUF

Updated Dec 5, 2024 • 8 • 1

Lucy-in-the-Sky/deepthought-8b-abliterated-Q8_0-GGUF

Question Answering • Updated Dec 7, 2024 • 111 • 2

aeranginkaman/Dorna2-Llama3.1-8B-Instruct-Q8_0-GGUF

Updated Dec 7, 2024 • 13 • 1

ehristoforu/Llama-TI-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 8, 2024 • 11 • 2

SYNERDATA/SYNERDATA-Hermes-3-LLaMA-3.1-8b-Q8_0.GGUF

Updated Dec 9, 2024 • 7 • 1

Theros/Qwen2.5-CyberMix-7B-Q4_K_M-GGUF

Updated Dec 9, 2024 • 2 • 1

ktibr/T-pro-it-1.0-Q8_0-GGUF

Updated Dec 11, 2024 • 160 • 2

evgensoft/T-pro-it-1.0-Q4_K_M-GGUF

Updated Dec 11, 2024 • 430 • 7

aovchinnikov/T-lite-it-1.0-Q4_K_M-GGUF

Updated Dec 11, 2024 • 281 • 1

chende2024/QwQ-32B-Preview-Q4_0-GGUF

Updated Dec 11, 2024 • 45 • 1

kri1200/T-lite-it-1.0-Q6_K-GGUF

Updated Dec 11, 2024 • 74 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_S-GGUF

Updated Dec 11, 2024 • 18 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

Updated Dec 11, 2024 • 26 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_S-GGUF

Updated Dec 11, 2024 • 4 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_M-GGUF

Updated Dec 12, 2024 • 16 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q6_K-GGUF

Updated Dec 12, 2024 • 13 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated Dec 12, 2024 • 14 • 1

NikolayKozloff/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated Dec 12, 2024 • 82 • 2

namelessai/mythalion-13b-Q4_K_M-GGUF

Text Generation • Updated 27 days ago • 21 • 1

qingy2024/NaturalLM-7B-Instruct-Q6_K-GGUF

Updated about 1 month ago • 30 • 1