turboderp
/

Llama-3.1-8B-Instruct-exl2

Model card Files Files and versions Community

turboderp commited on Jul 23

Commit

344c824

•

1 Parent(s): 1cb9750

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -3,6 +3,8 @@ license: llama3.1
 ---
 EXL2 quants of [Llama-3.1 8B instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct)
 [3.00 bits per weight](https://huggingface.co/turboderp/Llama-3.1-8B-Instruct-exl2/tree/3.0bpw)
 [3.50 bits per weight](https://huggingface.co/turboderp/Llama-3.1-8B-Instruct-exl2/tree/3.5bpw)
 [4.00 bits per weight](https://huggingface.co/turboderp/Llama-3.1-8B-Instruct-exl2/tree/4.0bpw)

 ---
 EXL2 quants of [Llama-3.1 8B instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct)
+_**This model requires the dev branch of ExLlamaV2 for now. New release coming soon with the necessary changes.**_
 [3.00 bits per weight](https://huggingface.co/turboderp/Llama-3.1-8B-Instruct-exl2/tree/3.0bpw)
 [3.50 bits per weight](https://huggingface.co/turboderp/Llama-3.1-8B-Instruct-exl2/tree/3.5bpw)
 [4.00 bits per weight](https://huggingface.co/turboderp/Llama-3.1-8B-Instruct-exl2/tree/4.0bpw)