Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,440

Full-text search

Active filters: awq

shunran/L3-ChaoticSoliloquy-v1.5-4x8B-awq

Text Generation • Updated Jul 8, 2024 • 4

nihaomur/Llama-3-Taiwan-8B-Instruct-AWQ-4bit

Text Generation • Updated Jul 19, 2024 • 80 • 1

solidrust/Phi-3-mini-128k-instruct-AWQ

Text Generation • Updated Sep 3, 2024 • 198 • 1

solidrust/Phi-3-mini-4k-instruct-AWQ

Text Generation • Updated Sep 3, 2024 • 40

Weni/ZeroShot-Agents-Llama3-4.0.58-SFT-AWQ

Text Generation • Updated Jul 8, 2024 • 4

Weni/ZeroShot-Agents-Llama3-4.0.57-SFT-140-AWQ

Text Generation • Updated Jul 8, 2024 • 4

h2oai/llama-3-70b-instruct-awq

Text Generation • Updated Jul 8, 2024 • 5

h2oai/llama-3-8b-instruct-awq

Text Generation • Updated Jul 8, 2024 • 99

Weni/ZeroShot-Agents-Llama3-4.0.57-SFT-100-AWQ

Text Generation • Updated Jul 8, 2024 • 5

Weni/ZeroShot-Agents-Llama3-4.0.59-SFT-AWQ

Text Generation • Updated Jul 8, 2024 • 4

Weni/ZeroShot-Agents-Llama3-4.0.60-SFT-AWQ

Text Generation • Updated Jul 9, 2024 • 4

solidrust/Yi-1.5-9B-Chat-AWQ

Text Generation • Updated Sep 3, 2024 • 10

solidrust/Qwen2-7B-Instruct-v0.8-AWQ

Text Generation • Updated Sep 3, 2024 • 5

Weni/ZeroShot-Agents-Llama3-4.0.51-SFT-AWQ

Text Generation • Updated Jul 9, 2024 • 4

nihaomur/gemma-2-9b-it-AWQ

Text Generation • Updated Jul 19, 2024 • 196

MSLars/test_model

Text Generation • Updated Jul 9, 2024 • 4

Weni/ZeroShot-Agents-Llama3-4.0.61-SFT-AWQ

Text Generation • Updated Jul 9, 2024 • 4

kaiwangrv/Llama-2-7b-hf_awq

Text Generation • Updated Jul 9, 2024 • 4

darthhexx/Phi-3-medium-128k-instruct-awq

Text Generation • Updated Jul 10, 2024 • 10

internlm/internlm-xcomposer2d5-7b-4bit

Visual Question Answering • Updated Aug 5, 2024 • 841 • 13

AnhQuangNguyen/Vistral-7B-Chat-function-calling-awq

Text Generation • Updated Jul 15, 2024 • 66

PrunaAI/dreamgen-WizardLM-2-7B-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 79

PrunaAI/MaziyarPanahi-Mistral-7B-v0.3-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 80

PrunaAI/cognitivecomputations-dolphin-2.9.1-llama-3-8b-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 83

PrunaAI/openchat-openchat-3.5-0106-gemma-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 79

PrunaAI/Remek-Llama-3-8B-Omnibus-1-PL-v01-INSTRUCT-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 81

Weni/ZeroShot-Agents-Llama3-4.0.62-SFT-AWQ

Text Generation • Updated Jul 12, 2024 • 79

Weni/ZeroShot-Agents-Llama3-4.0.63-DPO-AWQ

Text Generation • Updated Jul 12, 2024 • 79

Alirezamp/Mistral-7B-v0.3-news-category_awq

Text Generation • Updated Jul 12, 2024 • 81

aqweteddy/Llama3-Taiwan-70B-Instruct-128K-AWQ-4bits

Text Generation • Updated Jul 12, 2024 • 4