Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Mixtral-8x22B-Instruct-v0.1-exl2

Model card Files Files and versions Community
5
Mixtral-8x22B-Instruct-v0.1-exl2 / README.md
turboderp's picture
turboderp
Update README.md
a28dc01 verified over 1 year ago
preview code
|
raw
history blame
1.22 kB

EXL2 quants of Mixtral 8x22B Instruct v0.1

More bitrates still cooking

2.30 bits per weight
2.50 bits per weight
2.70 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
6.00 bits per weight

measurement.json