turboderp
/

dots.llm1.inst-exl3

Model card Files Files and versions Community

turboderp commited on 17 days ago

Commit

5c79f7b

·

verified ·

1 Parent(s): fd18d25

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -4,5 +4,7 @@ license_link: https://huggingface.co/rednote-hilab/dots.llm1.inst/blob/main/LICE
 ---
 EXL3 quants of [dots.llms1.inst](https://huggingface.co/rednote-hilab/dots.llm1.inst)
 [4.00 bits per weight](https://huggingface.co/turboderp/dots.llm1.inst-exl3/tree/4.0bpw)
 (more to come)

 ---
 EXL3 quants of [dots.llms1.inst](https://huggingface.co/rednote-hilab/dots.llm1.inst)
+[2.00 bits per weight](https://huggingface.co/turboderp/dots.llm1.inst-exl3/tree/2.0bpw)
+[2.50 bits per weight](https://huggingface.co/turboderp/dots.llm1.inst-exl3/tree/2.5bpw)
 [4.00 bits per weight](https://huggingface.co/turboderp/dots.llm1.inst-exl3/tree/4.0bpw)
 (more to come)