neuralmagic-ent/Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
20
Llama 3.1 Quantized
-
-
neuralmagic-ent/Llama-3.1-70B-quantized.w8a8
Updated • 4 -
neuralmagic-ent/Llama-3.1-8B-Instruct-FP8-dynamic
Text Generation • Updated • 665 -
neuralmagic-ent/Llama-3.1-70B-Instruct-quantized.w8a8
Text Generation • Updated • 7 -
neuralmagic-ent/Llama-3.1-8B-Instruct-quantized.w4a16
Text Generation • Updated • 4 -
neuralmagic-ent/Llama-3.1-8B-quantized.w8a8
Text Generation • Updated • 5 -
neuralmagic-ent/Llama-3.1-405B-Instruct-quantized.w8a8
Text Generation • Updated • 17 -
neuralmagic-ent/Llama-3.1-70B-Instruct-FP8-dynamic
Text Generation • Updated • 51 -
neuralmagic-ent/Llama-3.1-70B-Instruct-quantized.w4a16
Text Generation • Updated • 11 -
neuralmagic-ent/Llama-3.1-405B-Instruct-quantized.w4a16
Text Generation • Updated • 14 -
neuralmagic-ent/Llama-3.1-405B-Instruct-FP8-dynamic
Text Generation • Updated • 22