Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Llama2-7B-chat-exl2

Model card Files Files and versions Community
Llama2-7B-chat-exl2 / README.md
turboderp's picture
turboderp
Create README.md
b1a3b3a almost 2 years ago
preview code
|
raw
history blame contribute delete
1.06 kB

EXL2 quants of Llama2-7B-chat

2.50 bits per weight
2.70 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.65 bits per weight
5.00 bits per weight
6.00 bits per weight
7.00 bits per weight
8.00 bits per weight

measurement.json