compressa-ai
/

Llama-3-8B-Instruct-OmniQuant

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Llama-3-8B-Instruct-OmniQuant / model-00001-of-00002.safetensors

Commit History

add asymm quantized model, add two eos in code sample

6758e8a

Vasily Alexeev commited on Apr 24, 2024

add model weights and stuff

1a27dec

Vasily Alexeev commited on Apr 23, 2024