README.md

---
license: other
license_name: tongyi-qianwen
license_link: https://huggingface.co/Qwen/Qwen2-72B-Instruct/blob/main/LICENSE
language:
- en
pipeline_tag: text-generation
tags:
- chat
---
EXL2 quants of [turbcat-instruct-72b](https://huggingface.co/turboderp/turbcat-instruct-72b)

[2.50 bits per weight](https://huggingface.co/turboderp/turbcat-instruct-72b-exl2/tree/2.5bpw)     
[3.00 bits per weight](https://huggingface.co/turboderp/turbcat-instruct-72b-exl2/tree/3.0bpw)     
[3.50 bits per weight](https://huggingface.co/turboderp/turbcat-instruct-72b-exl2/tree/3.5bpw)     
[4.00 bits per weight](https://huggingface.co/turboderp/turbcat-instruct-72b-exl2/tree/4.0bpw)     
[5.00 bits per weight](https://huggingface.co/turboderp/turbcat-instruct-72b-exl2/tree/5.0bpw)     
[8.00 bits per weight](https://huggingface.co/turboderp/turbcat-instruct-72b-exl2/tree/8.0bpw)     

[measurement.json](https://huggingface.co/turboderp/turbcat-instruct-72b-exl2/blob/main/measurement.json)