oftverse
/

Meta-Llama-3.1-8B-GPTQ-INT4-BF16

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-8B-GPTQ-INT4-BF16 / generation_config.json

Commit History

Upload LlamaForCausalLM

6805132
verified

zqiu commited on Dec 8, 2024