turboderp
/

Llama-3.1-8B-exl2

Model card Files Files and versions Community

Llama-3.1-8B-exl2 / README.md

turboderp's picture

Update README.md

5a0e37a verified 2 months ago

|

history blame contribute delete

576 Bytes

metadata

license: llama3.1

EXL2 quants of Llama-3.1 8B

4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

measurement.json