Exl2 quants for Qwen1.5-0.5B-Chat
Automatically quantized using the auto quant script from hf-scripts
Created as an example for Auto EXL2 HF upload
BPW:
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The HF Inference API does not support text-generation models for ExLlamaV2
library.
Model tree for Anthonyg5005/Qwen1.5-0.5B-Chat-exl2
Base model
Qwen/Qwen1.5-0.5B-Chat