Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

19,729

Full-text search

Active filters: 4-bit

TechxGenus/Meta-Llama-3-8B-Instruct-AWQ

Text Generation • Updated Apr 19 • 1.53k • 4

leliuga/Meta-Llama-Guard-2-8B-bnb-4bit

Text Generation • Updated Apr 19 • 69 • 1

TechxGenus/Meta-Llama-3-70B-AWQ

Text Generation • Updated Apr 19 • 90 • 6

SweatyCrayfish/llama-3-8b-quantized

Text Generation • Updated Apr 20 • 569 • 10

solidrust/Einstein-v6.1-Llama3-8B-AWQ

Text Generation • Updated Sep 3 • 33 • 4

Adityyaa/Mistral-7b_finetuned_mental_health

Text Generation • Updated Apr 24 • 125 • 4

MaziyarPanahi/Poppy_Porpoise-v0.6-L3-8B-GGUF

Text Generation • Updated Apr 24 • 224 • 4

MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.1-GGUF

Text Generation • Updated Apr 25 • 583 • 2

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29 • 220 • 24

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3 • 12.6k • 27

fxmeng/PiSSA-Llama-3-8B-4bit-r128-5iter

Text Generation • Updated Jun 26 • 86 • 1

HuggingFaceM4/idefics2-8b-chatty-AWQ

Image-Text-to-Text • Updated May 6 • 46 • 5

NexaAIDev/Octopus-v2-gguf-awq

Text Generation • Updated Jun 23 • 1.99k • 7

ragibhasan/phi-3-bangla-instruct

Text Generation • Updated May 8 • 48 • 5

nm-testing/Llama-2-7b-pruned2.4-Marlin_24

Text Generation • Updated May 15 • 925 • 1

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Jul 22 • 15.9k • 70

unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated Nov 22 • 62.7k • 13

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10 • 1.24k • 16

cookey39/Five_Phases_Mindset

Text Generation • Updated May 27 • 34 • 1

saheedniyi/Llama3-8b-Naija_v1

Text Generation • Updated Jun 4 • 36 • 8

solidrust/Llama-3-Lumimaid-8B-v0.1-OAS-AWQ

Text Generation • Updated Sep 3 • 33 • 1

weifar/FTAudit-llama3-8b-v1

Text Generation • Updated Sep 16 • 38 • 1

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1 • 273 • 24

MohamedAhmedAE/Llama3-8B-Medical-Finetune-Merged

Text Generation • Updated Jun 4 • 35 • 1

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21 • 16.7k • 23

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6 • 2.22M • 10

unsloth/Qwen2-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 361 • 7

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 2.2M • 9

nikravan/glm-4vq

Document Question Answering • Updated Jun 16 • 1.24k • 27

fxmeng/PiSSA-Qwen2-72B-4bit-r64-5iter

Text Generation • Updated Jun 15 • 23 • 1