Annuvin
/

Llasa-3B-8.0bpw-h8-exl2

8-bit precision

Model card Files Files and versions Community

Inference

https://github.com/Zuellni/LLaSA-WebUI

Downloads last month: 26

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for Annuvin/Llasa-3B-8.0bpw-h8-exl2

Base model

meta-llama/Llama-3.2-3B-Instruct

Finetuned

HKUSTAudio/Llasa-3B

Quantized

(6)

this model

Collection including Annuvin/Llasa-3B-8.0bpw-h8-exl2

LLaSA

ExLlamaV2 quants for LLaSA. Inference: https://github.com/Zuellni/LLaSA-WebUI • 5 items • Updated 13 days ago