Edit Models filters

Inference status

Misc

compressed-tensors

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

549

Full-text search

Active filters: compressed-tensors

SicariusSicariiStuff/invisietch_MiS-Firefly-v0.2-22B_FP8

Updated Nov 9 • 4

SicariusSicariiStuff/invisietch_L3.1-70Blivion-v0.1-rc1-70B_FP8

Updated Nov 9 • 5

reinforce20001/SakuraLLM.Sakura-14B-Qwen2.5-v1.0.q6k.fp8

Updated Nov 9 • 4

CalamitousFelicitousness/EVA-Qwen2.5-72B-v0.1-FP8-Dynamic

Text Generation • Updated Nov 13 • 630

callcenterstudio/cosmos-W8A8-INT8

Updated Nov 12 • 9

callcenterstudio/cosmos-FP8

Text Generation • Updated Nov 12 • 12

nm-testing/debug-gsm8k-llmcompressor_packed

Updated Nov 19 • 430

nm-testing/Llama-3.2-1B-Instruct-GPTQ-nonuniform

Updated Nov 13 • 6

nm-testing/Llama-3.1-8B-Instruct-GPTQ-nonuniform

Updated Nov 13 • 10

danieldk/Qwen2.5-1.5B-Instruct-w8a8-int-dynamic-weight

Text Generation • Updated Nov 14 • 1.54k

nm-testing/Qwen2-VL-72B-Instruct-FP8-dynamic

Updated Nov 14 • 117

nm-testing/Llama-3.1-8B-FP8-compressed

Updated Nov 14 • 4

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-FP8-compressed

Updated Nov 14 • 2

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-FP8-uncompressed

Updated Nov 14 • 7

neuralmagic/Sparse-Llama-3.1-8B-gsm8k-2of4-FP8-dynamic

Text Generation • Updated 7 days ago • 156

neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic

Text Generation • Updated 7 days ago • 12

nm-testing/SparseLlama-3.1-8B-evolcodealpaca-pruned.2of4-FP8-dynamic

Updated Nov 15 • 6

ConfidentialMind/arcee-ai-SuperNova-Medius-CM-w4a16

Updated Nov 20 • 3.3k

wordslab-org/Qwen2.5-Coder-14B-Instruct-FP8-Dynamic

Text Generation • Updated Nov 17 • 17

wordslab-org/Qwen2.5-Coder-7B-Instruct-FP8-Dynamic

Text Generation • Updated Nov 17 • 12

wordslab-org/Qwen2.5-Coder-3B-Instruct-FP8-Dynamic

Text Generation • Updated Nov 17 • 18

SicariusSicariiStuff/concedo_Beepo-22B_FP8

Text Generation • Updated Nov 17 • 10

CalamitousFelicitousness/EVA-Qwen2.5-72B-v0.1-INT8

Text Generation • Updated Nov 18 • 15

nm-testing/Llama-3.1-8B-gsm8k-quantized.w4a16

Updated Nov 19 • 9

danieldk/Llama-3.1-8B-w4a16-int-24

Updated Nov 19 • 1.26k

nm-testing/Llama-3.2-11B-Vision-Instruct-W8A8

Updated Nov 19 • 56

nm-testing/Llama-3.2-90B-Vision-Instruct-W8A8

Updated Nov 19 • 100

nm-testing/Llama-3.2-90B-Vision-Instruct-W4A16

Updated Nov 19 • 120

nm-testing/pixtral-12b-W4A16

Updated Nov 19 • 110

yejingfu/q-Meta-Llama-3.1-8B-Instruct-w8a8kv8-sss

Updated Nov 20 • 27.4k