Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

compressed-tensors

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

Mixture of Experts

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Models

1,026

Full-text search

Active filters: compressed-tensors

BSC-LT/salamandra-7b-base-fp8

Text Generation • Updated 1 day ago • 23

BSC-LT/salamandra-2b-instruct-fp8

Text Generation • Updated 1 day ago • 25

yejingfu/nmagic-Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • Updated Oct 31, 2024 • 319k

CalamitousFelicitousness/EVA-Qwen2.5-32B-v0.1-FP8-Dynamic

Text Generation • Updated Oct 31, 2024 • 7

PyrTools/Rocinante-12B-v1.1-FP8-Dynamic

Updated Oct 31, 2024 • 4

PyrTools/Cydonia-22B-v1.2-FP8-Dynamic

Updated Nov 1, 2024 • 5

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W4A16

Text Generation • Updated Nov 5, 2024 • 4

nm-testing/pixtral-12b-FP8-dynamic-all

Updated Feb 7 • 13

SicariusSicariiStuff/TheDrummer_Behemoth-123B-v1.1_FP8

Updated Nov 1, 2024 • 4

nm-testing/Llama-3.2-1B-Instruct-FP8-KV

Updated Nov 1, 2024 • 8.98k

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W4A16

Text Generation • Updated Nov 5, 2024 • 8

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W8A8

Text Generation • Updated Nov 5, 2024 • 4

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W8A16

Text Generation • Updated Nov 5, 2024 • 6

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-SmoothQuant-RTN-W4A16

Text Generation • Updated Nov 5, 2024 • 4

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W4A16

Text Generation • Updated Nov 5, 2024 • 8

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W8A8

Text Generation • Updated Nov 5, 2024 • 4

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W8A16

Text Generation • Updated Nov 5, 2024 • 4

Vikhrmodels/vikhr-nemo-12b-W8A8-gptq-jsoncal

Text Generation • Updated Nov 4, 2024 • 4

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W8A8

Text Generation • Updated Nov 5, 2024 • 4

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W8A16

Text Generation • Updated Nov 5, 2024 • 4

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-SmoothQuant-RTN-W8A8

Text Generation • Updated Nov 5, 2024 • 4

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-SmoothQuant-RTN-W8A16

Text Generation • Updated Nov 5, 2024 • 4

leon-se/Molmo-7B-D-0924-FP8-Dynamic

Updated Nov 4, 2024 • 9

yejingfu/nmagic-Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated Nov 5, 2024 • 13

gmonair/Qwen2.5-Math-72B-Instruct-W4A16-padded

Updated Nov 5, 2024 • 4

gmonair/Qwen2.5-Math-72B-Instruct-W8A16-padded

Updated Nov 5, 2024 • 4

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W4A16-KV8

Updated Nov 5, 2024 • 4

stan-hua/Llama-3.1-8B-Instruct-LC-RTN-W4A16-KV4

Updated Nov 5, 2024 • 4

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W4A16-KV4

Updated Nov 5, 2024 • 4

shadowlilac/reasoning-sparse

Updated Nov 5, 2024 • 6