Edit Models filters

Inference status

Misc

compressed-tensors

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

522

Full-text search

Active filters: compressed-tensors

neuralmagic/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic

Text Generation • Updated Oct 17 • 11.8k • 14

nm-testing/Qwen2.5-Coder-32B-Instruct-FP8-dynamic

Updated Nov 15 • 347 • 1

nm-testing/Qwen2.5-32B-Instruct-FP8-dynamic

Updated Nov 15 • 163 • 1

neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-FP8-dynamic

Text Generation • Updated 5 days ago • 37 • 1

nm-testing/pixtral-12b-W8A8

Updated Nov 19 • 195 • 2

qeternity/AIDC-AI_Marco-o1-GPTQ-INT4

Updated 28 days ago • 40 • 1

reinforce20001/SakuraLLM.Sakura-14B-Qwen2.5-v1.0-W8A8-Int8

Updated 27 days ago • 78 • 1

pL-Community/SauerkrautLM-v2-14b-DPO-FP8

Text Generation • Updated 20 days ago • 105 • 1

nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic

Updated 18 days ago • 16.5k • 6

CalamitousFelicitousness/Llama-3.3-70B-Instruct-W8A8-INT8

Updated 18 days ago • 203 • 3

ibm-fms/Bamba-9B-1.8T-fp8

Text Generation • Updated 6 days ago • 148 • 1

cortecs/Llama-3.3-70B-Instruct-FP8-Dynamic

Updated 11 days ago • 13k • 3

cortecs/EuroLLM-9B-Instruct-FP8-Dynamic

Updated 11 days ago • 101 • 1

neuralmagic-ent/Llama-3.3-70B-Instruct-FP8-dynamic

Updated 13 days ago • 2.28k • 3

zhyncs/DeepSeek-V2.5-1210-FP8-Dynamic

Updated 6 days ago • 74 • 1

BigHuggyD/gghfez_Writer-Large-2411-v2.1-FP8-Dynamic

Updated about 2 hours ago • 13 • 1

CalamitousFelicitousness/Evathene-v1.0-FP8-Dynamic

Text Generation • Updated Nov 19 • 21 • 2

nm-testing/tinyllama-one-shot-static-quant-test-compressed

Text Generation • Updated Oct 9 • 12

nm-testing/tinyllama-one-shot-dynamic-test

Text Generation • Updated Oct 9 • 13

nm-testing/tinyllama-one-shot-w4a16-group-packed

Text Generation • Updated Oct 10 • 23

nm-testing/tinyllama-one-shot-w4a16-channel-compressed

Text Generation • Updated Oct 9 • 14

nm-testing/tinyllama-one-shot-w4a16-channel-packed

Text Generation • Updated Oct 9 • 15

nm-testing/llama7b-one-shot-2_4-w4a16-packed

Text Generation • Updated Oct 9 • 19

nm-testing/tinyllama-one-shot-w4a16-group128-packed

Text Generation • Updated Oct 9 • 18

nm-testing/llama3-8b-w8_channel-a8_tensor-compressed

Text Generation • Updated Oct 9 • 17

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24

Text Generation • Updated Jun 4 • 14

nm-testing/llama7b-one-shot-2_4-w4a16-group128-packed

Text Generation • Updated Jun 4 • 14

nm-testing/llama1.1b_0.5_sparse_bitmask

Text Generation • Updated Oct 9 • 10

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t

Text Generation • Updated Oct 9 • 4.72k • 1

nm-testing/tinyllama-one-shot-w8a8-dynamic-channel

Text Generation • Updated Oct 9 • 12