Llama 3.2 Quantized - a neuralmagic-ent Collection

neuralmagic-ent 's Collections

DeepSeekCoder-V2 Quantized

Qwen2.5 Math Quantized

Qwen2.5 Coder Quantized

Phi-3 Quantized

Llama 3.3 Quantized

Llama 3.2 Quantized

Llama 3.1 Quantized

Qwen2.5 Quantized

Llama 3.2 Quantized

updated 13 days ago

neuralmagic-ent/Llama-3.2-1B-Instruct-quantized.w8a8

Text Generation • Updated 15 days ago • 17
neuralmagic-ent/Llama-3.2-1B-quantized.w8a8

Updated 15 days ago • 8
neuralmagic-ent/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated 15 days ago • 14
neuralmagic-ent/Llama-3.2-1B-Instruct-FP8-dynamic

Text Generation • Updated 15 days ago • 11
neuralmagic-ent/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • Updated 15 days ago • 11
neuralmagic-ent/Llama-3.2-3B-quantized.w8a8

Updated 15 days ago • 9