rAIfle
/

maid-yuzu-v8-alter-exl2-rpcal

Inference Endpoints

Model card Files Files and versions Community

rAIfle commited on Mar 6

Commit

4031dea

•

1 Parent(s): 10ea4e2

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -21,6 +21,7 @@ Branches:
 - `6b6h` -- 6bpw, 6bit lm_head
 - `5b6h` -- 5bpw, 6bit lm_head
 - `3.5b6h` -- 3.5bpw, 6bit lm_head
 Requires ExllamaV2 version 0.0.12 and up.

 - `6b6h` -- 6bpw, 6bit lm_head
 - `5b6h` -- 5bpw, 6bit lm_head
 - `3.5b6h` -- 3.5bpw, 6bit lm_head
+- `2.25b6h` -- 2.25bpw, 6bit lm_head
 Requires ExllamaV2 version 0.0.12 and up.