Exl2
Collection
Models that we have quantized to exllamav2's quantization format
•
22 items
•
Updated
•
2
This is a Exl2 quantized version of Pygmalion-2-13b-SuperCOT-weighed
Please refer to the original creator for more information.
Branches:
- main: 4 bits per weight
- 5.0bpw: 5 bits per weight
- 6.0bpw: 6 bits per weight
- Downloads last month
- 14
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.