Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

4-bit precision

Models

10,115

Full-text search

Active filters: llama-cpp

AlicanKiraz0/SenecaLLM-Q4_K_M-GGUF

Updated about 2 hours ago • 11 • 11

prithivMLmods/OpenMath-8B-GGUF

Text Generation • Updated 24 days ago • 518 • 7

CronoBJS/LLaMA-Mesh-Q6_K-GGUF

Text Generation • Updated Nov 19 • 60 • 2

IntelligentEstate/Kaiju-Warding_AGI_Qwn7B-iMatrxQ4_nl-GGUF

Updated 1 day ago • 35 • 2

akineAItech/Vecteus-v1-abliterated-Q4_K_M-GGUF

Text Generation • Updated 7 days ago • 42 • 3

akineAItech/Vecteus-v1-abliterated-Q8_0-GGUF

Text Generation • Updated 7 days ago • 114 • 2

ClaudioItaly/Intelligence-QwQ-Q6_K-GGUF

Updated 3 days ago • 18 • 2

ggml-org/gemma-1.1-2b-it-Q8_0-GGUF

Updated Apr 5 • 1.48k • 1

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5 • 580 • 2

DavidAU/HelpingAI-Lite-4x1b-Q6_K-GGUF

Updated Apr 9 • 6 • 1

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9 • 731 • 15

gate369/Bitnet-M7-70m-Q8_0-GGUF

Updated Apr 15 • 22 • 1

DavidAU/UNA-dolphin-2.6-mistral-7b-dpo-laser-Q6_K-GGUF

Updated Apr 19 • 3 • 1

DavidAU/RedPajama-INCITE-7B-Instruct-Q6_K-GGUF

Updated Apr 20 • 10 • 2

noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q4_K_M-GGUF-PTBR

Text Generation • Updated May 1 • 15 • 1

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated May 14 • 1.06k • 52

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3 • 10.6k • 52

TouchNight/Yi-9B-200K-AEZAKMI-RAW-TOXIC-1-Q6_K-GGUF

Updated May 21 • 6 • 1

YorkieOH10/AlchemistCoder-DS-6.7B-Q4_K_M-GGUF

Updated May 30 • 2 • 1

zhaijunxiao/omost-llama-3-8b-Q8_0-GGUF

Updated Jun 12 • 81 • 4

HDiffusion/Llama3-8b-CunnyGPT-16bit-Q4_K_M-GGUF

Updated Jun 13 • 36 • 2

mobeetle/Saul-7B-Instruct-v1-Q4_K_M-GGUF

Updated Jun 20 • 2 • 1

elyza/Llama-3-ELYZA-JP-8B-GGUF

Updated Jun 26 • 8.89k • 45

fishbone64/gte-Qwen2-7B-instruct-Q8_0-GGUF

Sentence Similarity • Updated Jun 26 • 30 • 2

huggingkot/dolphin-2.9.3-mistral-7B-32k-Q4_K_M-GGUF

Updated Jul 3 • 14 • 3

jorismathijssen/t5-base-Q4_K_M-GGUF

Translation • Updated Jul 8 • 53 • 1

xiaoshuai111/llama3-8b-Lawyer-v2-Q4_0-GGUF

Text Generation • Updated Jul 15 • 2.43k • 2

xiaoshuai111/lawyer-llama-13b-v2-Q4_0-GGUF

Updated Aug 28 • 276 • 3

catbash/Mistral-7B-v0.1-flashback-v2-instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 17 • 7 • 2

hoorang/llama-3-Korean-Bllossom-8B-Q8_0-GGUF

Updated Jul 25 • 30 • 1