library_name: transformers | |
tags: [] | |
## Exllama v2 Quantizations of Tess-v2.5.2-Qwen2-72B | |
Using <a href="https://github.com/turboderp/exllamav2/releases/tag/v0.0.21">turboderp's ExLlamaV2 v0.0.21</a> for quantization. | |
Original model: https://huggingface.co/migtissera/Tess-v2.5.2-Qwen2-72B |