Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

9,985

Full-text search

Active filters: gguf-my-repo

gate369/Bitnet-Mistral.0.2-v6.8-Q8_0-GGUF

Updated Jun 28 • 1

YorkieOH10/Qwen2-7B-Multilingual-RP-Q8_0-GGUF

Updated Jun 28 • 7 • 2

Pekarnick/e5-large-v2-Q4_K_M-GGUF

Sentence Similarity • Updated Jun 28 • 3

YorkieOH10/Qwen2-7B-Multilingual-RP-Q5_K_M-GGUF

Updated Jun 28 • 3

YorkieOH10/Qwen2-7B-Multilingual-RP-Q4_K_M-GGUF

Updated Jun 28 • 92 • 1

Leths/gpt2-Q4_K_M-GGUF

Updated Jun 28 • 7

Kurgan1138/L3-8B-Instruct-Abliterated-DWP-Q5_K_M-GGUF

Updated Jun 28 • 4

NikolayKozloff/L3-8B-Lunaris-v1-Q4_0-GGUF

Updated Jun 28 • 20 • 1

NikolayKozloff/L3-8B-Lunaris-v1-Q5_0-GGUF

Updated Jun 28 • 1

NikolayKozloff/L3-8B-Lunaris-v1-IQ4_NL-GGUF

Updated Jun 28 • 3 • 1

fusi0n/llm-compiler-13b-ftd-Q6_K-GGUF

Updated Jun 28 • 2

Kurgan1138/L3-8B-Stheno-Horny-v3.3-32K-Q5_K_M-GGUF

Updated Jun 28 • 20

naverick/L3-8B-Lunaris-v1-Q4_K_M-GGUF

Updated Jun 28 • 62 • 2

skratos115/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF

Updated Jun 28 • 6

markhneedham/dolphin-2.9-llama3-8b-Q2_K-GGUF

Updated Jun 28 • 41

jeiku/qwen2base-Q4_K_M-GGUF

Updated Jun 28 • 12

AaronVB/L3-8B-Lunaris-v1-Q5_K_M-GGUF

Updated Oct 26 • 7

jeiku/Very_Berry_Qwen2_7B-Q4_K_M-GGUF

BenevolenceMessiah/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated Jun 29 • 3

Azazelle/L3-Persephone-8B-v1.0-Q8_0-GGUF

Updated Jun 29 • 1

cansa/Turkish-Llama-8b-Instruct-v0.1-Q5_K_S-GGUF

Text Generation • Updated Jun 29 • 2

cansa/Turkish-Llama-8b-Instruct-v0.1-Q8_0-GGUF

Text Generation • Updated Jun 29 • 2

NikolayKozloff/Turkish-Llama-8b-Instruct-v0.1-IQ4_NL-GGUF

Text Generation • Updated Jun 29 • 8 • 1

NikolayKozloff/Trendyol-LLM-7b-chat-v1.8-Q4_0-GGUF

Text Generation • Updated Jun 29 • 23 • 1

NikolayKozloff/Trendyol-LLM-7b-chat-v1.8-Q5_0-GGUF

Text Generation • Updated Jun 29 • 2 • 1

NikolayKozloff/Trendyol-LLM-7b-chat-v1.8-IQ4_NL-GGUF

Text Generation • Updated Jun 29 • 2 • 1

Yolozh/Qwen2-1.5B-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 29 • 6

quixotedav/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Jun 29 • 25

NikolayKozloff/Viking-7B-Q8_0-GGUF

Updated Jun 29 • 1

NikolayKozloff/Viking-7B-Q6_K-GGUF

Updated Jun 29 • 2 • 1