neuralmagic-ent/Qwen2.5-72B-Instruct-quantized.w4a16
Updated
•
12
Edit Models filters
Active filters:
compressed-tensors
neuralmagic-ent/Qwen2.5-32B-Instruct-quantized.w4a16
Updated
•
17
neuralmagic-ent/Qwen2.5-32B-FP8-dynamic
Updated
•
10
nm-testing/llama2.c-stories15M-pruned_50.2of4-uncompressed-tensor_weights_tensor_act_fp8-BitMaskCompressed
Updated
•
7
neuralmagic-ent/Qwen2.5-72B-FP8-dynamic
Updated
•
11
neuralmagic-ent/Qwen2.5-14B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
19
neuralmagic-ent/Qwen2.5-14B-FP8-dynamic
Updated
•
6
horheynm/d
Updated
•
2
neuralmagic-ent/Qwen2.5-7B-FP8-dynamic
Updated
•
8
horheynm/llama2.c_stories15M_pruned_50.2of4_compressed
Updated
•
25
horheynm/llama2.c_stories15M_pruned_50.2of4_uncompressed
Updated
•
22
neuralmagic-ent/Qwen2.5-3B-FP8-dynamic
Updated
•
6
neuralmagic-ent/Qwen2.5-1.5B-FP8-dynamic
Updated
•
6
neuralmagic-ent/Qwen2.5-0.5B-FP8-dynamic
Updated
•
18
neuralmagic-ent/Qwen2.5-0.5B-Instruct-FP8-dynamic
Text Generation
•
Updated
•
23
neuralmagic-ent/Qwen2.5-1.5B-Instruct-FP8-dynamic
Text Generation
•
Updated
•
10
BigHuggyD/EVA-UNIT-01_EVA-LLaMA-3.33-70B-v0.0-FP8-Dynamic
Text Generation
•
Updated
•
83
neuralmagic-ent/Qwen2.5-3B-Instruct-FP8-dynamic
Updated
•
6
neuralmagic-ent/Qwen2.5-7B-Instruct-FP8-dynamic
Updated
•
89
neuralmagic-ent/Qwen2.5-14B-Instruct-FP8-dynamic
Updated
•
10
neuralmagic-ent/Qwen2.5-32B-Instruct-FP8-dynamic
Updated
•
9
neuralmagic-ent/Qwen2.5-72B-Instruct-FP8-dynamic
Updated
•
11
neuralmagic-ent/Qwen2.5-7B-quantized.w4a16
Updated
•
9
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Static-Per-Tensor-Sym
Updated
•
69
neuralmagic-ent/Qwen2.5-32B-quantized.w4a16
Updated
•
8
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Dynamic-Asym
Updated
•
68
neuralmagic-ent/Qwen2.5-72B-quantized.w4a16
Updated
•
8
neuralmagic-ent/Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
20
neuralmagic-ent/Llama-3.1-8B-quantized.w8a8
Text Generation
•
Updated
•
5
neuralmagic-ent/Llama-3.1-8B-Instruct-FP8-dynamic
Text Generation
•
Updated
•
665