neuralmagic
/

Meta-Llama-3-8B-Instruct-quantized.w8a16

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Meta-Llama-3-8B-Instruct-quantized.w8a16 / model.safetensors.index.json

Commit History

Upload LlamaForCausalLM

a7dad7d
verified

alexmarques commited on Jul 2, 2024

Delete model.safetensors.index.json

1eed734
verified

alexmarques commited on Jul 2, 2024

Upload LlamaForCausalLM

c34fb16
verified

alexmarques commited on Jul 2, 2024