Hugging Face's logo

ShawnFlower
/
Meta-Llama-3-8B-Instruct-4bit

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community

Meta-Llama-3-8B-Instruct-4bit

Model Details

Model Description

4-bit GPTQ quantization for Meta-Llama-3-8B-Instruct by c4 dataset

Model Sources

Downloads last month
69
Safetensors
Model size
1.99B params
Tensor type
FP16
·
I32
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.