Edit Models filters

Inference status

Misc

compressed-tensors

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

590

Full-text search

Active filters: compressed-tensors

nm-testing/Phi-3.5-vision-instruct-W8A8-Dynamic-Per-Token

Updated Oct 17 • 5

noneUsername/Ministral-8B-Instruct-2410-HF-W8A8-Dynamic-Per-Token

Updated Oct 19 • 2

noneUsername/TouchNight-Ministral-8B-Instruct-2410-HF-W8A8-Dynamic-Per-Token

Updated Oct 19 • 6

CalamitousFelicitousness/Magnum-V4-72B-FP8-Dynamic

Text Generation • Updated Oct 20 • 11

gmonair/Qwen2.5-Math-1.5B-Instruct-W8A8-Dynamic-Per-Token

Updated Oct 20 • 3

gmonair/Qwen2.5-Math-1.5B-Instruct-W8A16

Updated Oct 20 • 3

leon-se/Aria-sequential_mlp-FP8-dynamic

Image-Text-to-Text • Updated Oct 23 • 120 • 5

noneUsername/magnum-v4-22b-W8A8-Dynamic-Per-Token

Updated Oct 22 • 39

gmonair/Qwen2.5-Math-7B-Instruct-W8A16

Updated Oct 22 • 3

noneUsername/magnum-v4-12b-W8A8-Dynamic-Per-Token

Updated Oct 22 • 2

nm-testing/SparseLlama-3-8B-pruned_50.2of4_Fp8-compressed

Updated Oct 22 • 2

nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.2of4-FP8-compressed

Updated 24 days ago • 50 • 1

nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.2of4-INT8-compressed

Updated Oct 29 • 4

asabet/Llama-3.2-11B-Vision-Instruct-fp8-dynamic

Updated Oct 24 • 2

PyrTools/Ministral-8B-Instruct-2410-FP8-Dynamic

Updated Oct 25 • 2

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-quantized.w8a8

Updated Oct 24 • 2

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-FP8

Updated Oct 24 • 5

nm-testing/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16

Updated Oct 24 • 26

CalamitousFelicitousness/Llama-3.05-Nemotron-Tenyxchat-Storybreaker-70B-FP8-Dynamic

Updated Oct 25 • 8

mbayser/granite-20b-functioncalling-FP8-KV

Updated Oct 25 • 5.96k

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_2of4-e2e

Text Generation • Updated about 9 hours ago • 512

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_2of4_channel-e2e

Text Generation • Updated about 10 hours ago • 557

CalamitousFelicitousness/EVA-Qwen2.5-72B-v0.0-FP8-Dynamic

Text Generation • Updated Oct 29 • 281

nm-testing/paligemma-3b-mix-224-FP8-dynamic

Updated Oct 29 • 9

nm-testing/llava-onevision-qwen2-7b-ov-hf-FP8-dynamic

Updated Oct 29 • 5

yejingfu/nmagic-Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • Updated Oct 31 • 8

CalamitousFelicitousness/EVA-Qwen2.5-32B-v0.1-FP8-Dynamic

Text Generation • Updated Oct 31 • 10

PyrTools/Rocinante-12B-v1.1-FP8-Dynamic

Updated Oct 31 • 4

PyrTools/Cydonia-22B-v1.2-FP8-Dynamic

Updated Nov 1 • 2

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W4A16

Text Generation • Updated Nov 5 • 10