TheBloke
/

Falcon-180B-Chat-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

Quantization not recognized, even when building VLLM from source

#1 opened about 1 year ago by