Hugging Face's logo

TheBloke
/
Falcon-180B-Chat-AWQ

Text Generation
Transformers
Safetensors
falcon
text-generation-inference
4-bit precision
awq
Model card Files Community
1
New discussion

Quantization not recognized, even when building VLLM from source

2
#1 opened almost 2 years ago by
willowill5