Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

9,919

Full-text search

Active filters: gguf-my-repo

herrkobold/TinyLlama-1.1B-Chat-v1.0-german-Q5_K_M-GGUF

Updated Jul 7 • 6

mrgxxer/L3-8B-Stheno-v3.2-Q4_K_M-GGUF

Updated Jul 7 • 20

yoeldcd/leniachat-qwen2-1.5B-v0-Q4_K_M-GGUF

Updated Jul 8 • 11

zachaman/chpr3019-Q8_0-GGUF

Question Answering • Updated Jul 21

zhezhe/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 16

tinyrao/Hermes-2-Pro-Llama-3-8B-Q4_K_M-GGUF

Updated Jul 8 • 16

saejoon/gemma-2-27b-it-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 5 • 2

Rivaidan/Smegmma-9B-v1-Q8_0-GGUF

Updated Jul 8 • 4

notjjustnumbers/madlad400-3b-mt-Q4_K_M-GGUF

Translation • Updated Jul 8 • 56

ethangoh/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 1

HenryyTwitchyfinger/L3-8B-Stheno-v3.2-Q4_K_M-GGUF

Updated Jul 8 • 17

utterlygreat/omost-llama-3-8b-IQ4_NL-GGUF

Updated Jul 8 • 9

teemperor/Phi-3-medium-128k-instruct-Q6_K-GGUF

Text Generation • Updated Jul 8

zhezhe/Gemma-2-9B-Chinese-Chat-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 3

NikolayKozloff/madlad400-3b-mt-Q8_0-GGUF

Translation • Updated Jul 8 • 53 • 1

NikolayKozloff/madlad400-10b-mt-Q8_0-GGUF

Translation • Updated Jul 8 • 88 • 2

NikolayKozloff/madlad400-10b-mt-Q6_K-GGUF

Translation • Updated Jul 8 • 1.83k • 1

Cran-May/internlm2_5-7b-chat-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 1

NikolayKozloff/sqt5-xl-Albanian-shqip-llama.cpp-compatible-Q8_0-GGUF

Updated Jul 8 • 2 • 1

dimcha/mxbai-embed-large-v1-Q4_K_M-GGUF

Feature Extraction • Updated Jul 8 • 9

bmi-labmedinfo/Igea-3B-v0.1-GGUF

Cran-May/internlm2_5-7b-chat-IQ4_XS-GGUF

Text Generation • Updated Jul 8 • 3

carterprince/google-gemma-2-27b-it-ortho-Q4_K_S-GGUF

Updated Jul 8 • 2 • 1

mrmage/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 2 • 1

mrmage/Qwen2-0.5B-Instruct-Q3_K_M-GGUF

Text Generation • Updated Jul 8 • 3

ZappY-AI/medllama3-v20-Q4_K_M-GGUF

Updated Jul 8 • 5

martintomov/gemma-2-27b-it-Q8_0-GGUF

Text Generation • Updated Jul 8 • 12

faceradix/Daredevil-8B-abliterated-Q4_K_M-GGUF

Updated Jul 8 • 2

martintomov/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated Jul 8

Nialixus/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 1