Hugging Face's logo

hugging-quants
/
Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation
Transformers
Safetensors
llama
llama-3.1
meta
autogptq
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
18
Meta-Llama-3.1-405B-Instruct-GPTQ-INT4
  • 6 contributors
 History: 50 commits
AshtonIsNotHere's picture
AshtonIsNotHere
Change max_position_embeddings to original value
581b14d verified