Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

4-bit precision

text-generation-inference

AutoTrain Compatible

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

122

Full-text search

Active filters: llama.cpp

teleprint-me/cyberpunk-valerie-v0.1

Text Generation • Updated Apr 18, 2024 • 31 • 1

qwp4w3hyb/Meta-Llama-3-8B-Instruct-iMat-GGUF

Text Generation • Updated Apr 29, 2024 • 1.86k • 6

mgonzs13/Mistroll-7B-v2.2-GGUF

Text Generation • Updated Apr 29, 2024 • 66

mgonzs13/ladybird-base-7B-v8-GGUF

Text Generation • Updated Apr 29, 2024 • 41

google/codegemma-1.1-2b-GGUF

Text Generation • Updated Jun 27, 2024 • 3

google/codegemma-1.1-7b-it-GGUF

Text Generation • Updated Jun 27, 2024 • 10 • 14

mgonzs13/TextBase-7B-v0.1-GGUF

Text Generation • Updated Jun 11, 2024 • 24

QuantFactory/TextBase-7B-v0.1-GGUF

Text Generation • Updated Jun 18, 2024 • 230

njwright92/ComicBot_v.2-gguf

Text Generation • Updated Aug 30, 2024 • 51

Irathernotsay/qwen2-1.5B-medical_qa-Finetune

Text Generation • Updated Jul 17, 2024 • 3

palusi/Qwen2-0.5B-Instruct-GGUF

Updated Jun 27, 2024 • 16

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k

Text Generation • Updated Jul 9, 2024 • 20

ruslanmv/Medical-Llama3-v2-Q4_K_M-GGUF

Updated Jun 30, 2024 • 4

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GGUF

Text Generation • Updated Jul 9, 2024 • 31

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GPTQ

Text Generation • Updated Jul 9, 2024 • 7

zhhan/Phi-3-mini-4k-instruct_gguf_derived

Summarization • Updated Jul 2, 2024 • 27 •

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-AWQ

Text Generation • Updated Jul 9, 2024 • 5

mgonzs13/stablelm-zephyr-3B-localmentor-GGUF

Text Generation • Updated Jul 3, 2024 • 827

chatpdflocal/llama3.1-8b-gguf

Updated Dec 27, 2024 • 436 • 26

akshathmangudi/llama3.1-8b-gguf

Updated Jul 26, 2024

jhilburn/gemma-inference

Text Generation • Updated Aug 7, 2024

ghost-x/ghost-8b-beta-1608-gguf

Text Generation • Updated Aug 26, 2024 • 104 • 6

PaulJusst/codegemma-7b-it-GGUF

Text Generation • Updated Sep 13, 2024

TheCluster/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 6

v000000/Typhon-Mixtral-v1-imatrix-v2.Q6_K-GGUF

Updated Sep 26, 2024 • 8 • 1

LPN64/LongCite-llama3.1-8b-GGUF

Text Generation • Updated Oct 1, 2024 • 147 • 6

cstr/Ministral-8B-Instruct-2410-GGUF

Updated Oct 17, 2024 • 16 • 1

mrcuddle/Lumimaid-v0.2-12B-Q4_K_M-GGUF

Text Generation • Updated Oct 20, 2024 • 2

Manel/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Updated Nov 3, 2024 • 2

Manel/Llama-2-13b-chat-hf-Q4_0-GGUF

Text Generation • Updated Nov 3, 2024 • 33