Hugging Face's logo

corneille97
/
Llama-3-8B-4bits-turbo

Text Generation
Transformers
Safetensors
llama
Llama3-8B
Llama3
Llama-3
4bits
bnb
conversational
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community

Model : Llama 3 8B 4bits

This is a Llama 3 8B model quantized on 4 bits using BitsandBytes. For fast upload enjoy !.

License : see https://huggingface.co/meta-llama/Meta-Llama-3-8B

Downloads last month
6
Safetensors
Model size
4.65B params
Tensor type
FP16
路
F32
路
U8
路
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.