Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,439

Full-text search

Active filters: awq

Weni/ZeroShot-Agents-Llama3-4.0.63-DPO-100-AWQ

Text Generation • Updated Jul 12, 2024 • 78

Weni/WeniGPT-Agents-Llama3-5.1.2-SFT-AWQ

Text Generation • Updated Jul 12, 2024 • 78

Weni/WeniGPT-Agents-Llama3-5.1.4-SFT-AWQ

Text Generation • Updated Aug 22, 2024 • 22

PrunaAI/cgato-L3-TheSpice-8b-v0.8.3-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 81

PrunaAI/Qwen-CodeQwen1.5-7B-Chat-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 95

PrunaAI/DeepMount00-Mistral-Ita-7b-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 76

PrunaAI/tokyotech-llm-Swallow-7b-instruct-hf-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 78

PrunaAI/rhaymison-Mistral-portuguese-luana-7b-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 79

PrunaAI/01-ai-Yi-1.5-9B-Chat-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 76

Weni/ZeroShot-Agents-Llama3-4.0.64-DPO-AWQ

Text Generation • Updated Jul 13, 2024 • 76

PrunaAI/VAGOsolutions-Llama-3-SauerkrautLM-8b-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 78

PrunaAI/VAGOsolutions-SauerkrautLM-1.5b-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 76

PrunaAI/Qwen-Qwen2-7B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 77

PrunaAI/Qwen-Qwen1.5-4B-Chat-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 78

PrunaAI/SeaLLMs-SeaLLM-7B-v2-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 77

PrunaAI/ibm-granite-granite-8b-code-base-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 80

Weni/ZeroShot-Agents-Llama3-4.0.65-DPO-AWQ

Text Generation • Updated Jul 13, 2024 • 77

Weni/ZeroShot-Agents-Llama3-4.0.66-SFT-AWQ

Text Generation • Updated Jul 14, 2024 • 75

Weni/ZeroShot-Agents-Llama3-4.0.67-DPO-AWQ

Text Generation • Updated Jul 14, 2024 • 72

PrunaAI/openlynn-Llama-3-Soliloquy-8B-v2-AWQ-4bit-smashed

Text Generation • Updated Jul 14, 2024 • 80

PrunaAI/Qwen-Qwen2-0.5B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 14, 2024 • 79

Weni/ZeroShot-Agents-Llama3-4.0.68-SFT-AWQ

Text Generation • Updated Jul 14, 2024 • 63

Alirezamp/gemma2b-news-gategory-lc_awq

Text Generation • Updated Jul 14, 2024 • 64

Weni/ZeroShot-Agents-Llama3-4.0.69-SFT-AWQ

Text Generation • Updated Jul 14, 2024 • 63

ntdat017/Llama-3-LewdPlay-8B-AWQ

Text Generation • Updated Jul 14, 2024 • 64

Ichigo2899/Artigenz-Artigenz-Coder-DS-6.7B-AWQ

Text Generation • Updated Jul 14, 2024 • 68

PrunaAI/SeaLLMs-SeaLLM-7B-v2.5-AWQ-4bit-smashed

Text Generation • Updated Jul 14, 2024 • 69

PrunaAI/Gryphe-Tiamat-8b-1.2-Llama-3-DPO-AWQ-4bit-smashed

Text Generation • Updated Jul 14, 2024 • 64

PrunaAI/Qwen-CodeQwen1.5-7B-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 68

msobroza/prometheus-8x7b-v2.0-awq

Text Generation • Updated Jul 15, 2024 • 8