gghfez's picture
Update README.md
b1506eb verified
metadata
library_name: transformers
license: other
license_name: qwen
license_link: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct/blob/main/LICENSE
base_model:
  - Sao10K/72B-Qwen2.5-Kunou-v1
tags:
  - generated_from_trainer
model-index:
  - name: 72B-Qwen2.5-Kunou-v1
    results: []

exl2 quant of Sao10K/72B-Qwen2.5-Kunou-v1

I noticed nobody uploaded exl2 quants yet so here's my 6.5bpw quant of 72B-Qwen2.5-Kunou-v1

  • mesaurement.json

I'll probably delete this once the big quanters get around to it.