Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

4-bit precision

text-generation-inference

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

145

Full-text search

Active filters: llama.cpp

google/gemma-1.1-2b-it-GGUF

Updated Jun 27, 2024 • 9 • 20

webbigdata/C3TR-Adapter_gguf

Translation • Updated Aug 14, 2024 • 189 • 25

google/codegemma-2b-GGUF

Text Generation • Updated Jun 27, 2024 • 33 • 26

google/codegemma-7b-GGUF

Text Generation • Updated Jun 27, 2024 • 152 • 20

google/codegemma-7b-it-GGUF

Text Generation • Updated Jun 27, 2024 • 68 • 56

pacozaa/bonito-gguf

Updated Apr 14, 2024 • 1

pmking27/PrathameshLLM-2B-GGUF

Updated Apr 9, 2024 • 2.35k • 1

teleprint-me/cyberpunk-valerie-v0.1

Text Generation • Updated Apr 18, 2024 • 24 • 1

qwp4w3hyb/Meta-Llama-3-8B-Instruct-iMat-GGUF

Text Generation • Updated Apr 29, 2024 • 168 • 6

mgonzs13/Mistroll-7B-v2.2-GGUF

Text Generation • Updated Apr 29, 2024 • 11

mgonzs13/ladybird-base-7B-v8-GGUF

Text Generation • Updated Apr 29, 2024 • 14

google/codegemma-1.1-2b-GGUF

Text Generation • Updated Jun 27, 2024 • 2 • 1

google/codegemma-1.1-7b-it-GGUF

Text Generation • Updated Jun 27, 2024 • 8 • 14

openbmb/MiniCPM-Llama3-V-2_5-gguf

Updated Feb 27 • 5.99k • 214

mgonzs13/TextBase-7B-v0.1-GGUF

Text Generation • Updated Jun 11, 2024 • 16

QuantFactory/TextBase-7B-v0.1-GGUF

Text Generation • Updated Jun 18, 2024 • 84

njwright92/ComicBot_v.2-gguf

Text Generation • Updated Aug 30, 2024 • 21

Irathernotsay/qwen2-1.5B-medical_qa-Finetune

Text Generation • Updated Jul 17, 2024 • 18

palusi/Qwen2-0.5B-Instruct-GGUF

Updated Jun 27, 2024 • 68

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k

Text Generation • Updated Jul 9, 2024 • 16

ruslanmv/Medical-Llama3-v2-Q4_K_M-GGUF

Updated Jun 30, 2024 • 3

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GGUF

Text Generation • Updated Jul 9, 2024 • 5

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GPTQ

Text Generation • Updated Jul 9, 2024 • 17

zhhan/Phi-3-mini-4k-instruct_gguf_derived

Summarization • Updated Jul 2, 2024 • 21

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-AWQ

Text Generation • Updated Jul 9, 2024 • 7

mgonzs13/stablelm-zephyr-3B-localmentor-GGUF

Text Generation • Updated Jul 3, 2024 • 85

google/gemma-2-2b-it-GGUF

Updated Aug 27, 2024 • 26 • 82

google/gemma-2-2b-GGUF

Updated Aug 2, 2024 • 84 • 17

chatpdflocal/llama3.1-8b-gguf

Updated Dec 27, 2024 • 241 • 27

akshathmangudi/llama3.1-8b-gguf

Updated Jul 26, 2024