Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

10,096

Full-text search

Active filters: gguf-my-repo

LLukas22/DeepSeek-Coder-V2-Lite-Instruct-Q4_0-GGUF

Updated Jun 25 • 34

xX-FANE-Xx/mistral-7b-eufaq-merged-Q8_0-GGUF

Updated Jun 25 • 1

Jianping746/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF

Updated Jun 25 • 2

jkrahmann/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jun 25 • 3

dejankocic/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF

Updated Jun 25 • 2

fenglingzmb/Yi-1.5-9B-Chat-Q4_K_M-GGUF

Updated Jun 25 • 2

Anvix/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 25 • 2

antoste/Magiq-3-Q4_K_M-GGUF

Text Generation • Updated Jun 25 • 3

antoste/Magiq-3-Q2_K-GGUF

Text Generation • Updated Jun 25 • 1

pszemraj/Mistral-7B-sarcasm-scrolls-v2-Q4_K_M-GGUF

Updated Jun 26 • 4

antoste/Minerva-3B-base-v1.0-IQ3_M-GGUF

Text Generation • Updated Jun 25 • 3

DarwinAnim8or/InstructLM-1.3B-Q4_K_M-GGUF

Updated Jun 25 • 1

Hiddengamer007/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 25

oriyaho/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 25 • 6

win10/DeepSeek-Coder-V2-Lite-Instruct-Q6_K-GGUF

Updated Jun 26 • 7

win10/DeepSeek-Coder-V2-Lite-Instruct-Q8_0-GGUF

Updated Jun 26 • 6

win10/Breeze-13B-32k-Instruct-v1_0-Q8_0-GGUF

Updated Jun 29 • 2

cptnemo-pata/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 26

icycodes/deepseek-coder-6.7b-base-Q8_0-GGUF

Updated Jun 26 • 176

Klevin/EM-Mistral-7b-v-0.3-Q4_K_M-GGUF

Updated Jun 26 • 1

Klevin/EMO-Ai-7b-Q2_K-GGUF

Updated Jun 26 • 1 • 1

Klevin/EMO-Ai-7b-Q8_0-GGUF

Klevin/EMO-Ai-7b-Q4_0-GGUF

Updated Jun 26 • 3 • 1

Fulcrum-AI/Ryze-Q4_K_M-GGUF

phillip888/Llama3-TAIDE-LX-8B-Chat-Alpha1-Q4_K_M-GGUF

phillip888/Llama3-TAIDE-LX-8B-Chat-Alpha1-Q8_0-GGUF

Updated Jun 26 • 2

icycodes/deepseek-coder-1.3b-base-Q8_0-GGUF

Updated Jun 26 • 48

Fulcrum-AI/Ryze-Q8_0-GGUF

jerrykim9981/no-robots-y34b-lora-Q8_0-GGUF

Updated Jun 26 • 1

nalf3in2/Llama-3-Instruct-8B-SPPO-Iter3-Q5_K_S-GGUF

Text Generation • Updated Jun 26 • 2