Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Mixtral-8x7B-Instruct-v0.1-exl3

Model card Files Files and versions Community
Mixtral-8x7B-Instruct-v0.1-exl3 / README.md
turboderp's picture
turboderp
Update README.md
f43115b verified 1 day ago
preview code
|
raw
history blame contribute delete
1.16 kB
metadata
license: apache-2.0

EXL3 quants of Mixtral-8x7B-Instruct-v0.1

2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight / H8

image/png

(Couldn't find any GGUF or AWQ versions that still work.)