Exllama v2 Quantizations of Tess-v2.5.2-Qwen2-72B

Using turboderp's ExLlamaV2 v0.0.21 for quantization.

Original model: https://huggingface.co/migtissera/Tess-v2.5.2-Qwen2-72B

Downloads last month
7
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.