Update README.md
Browse files
README.md
CHANGED
@@ -31,12 +31,14 @@ Quantized using 200 samples of 8192 tokens from an RP-oriented [PIPPA](https://h
|
|
31 |
|
32 |
Branches:
|
33 |
- `main` -- `measurement.json`
|
34 |
-
- `
|
|
|
|
|
35 |
- `4b6h` -- 4bpw, 6bit lm_head
|
36 |
-
- `
|
37 |
-
- `2.
|
38 |
|
39 |
-
Original model link:
|
40 |
|
41 |
Original model README below.
|
42 |
|
|
|
31 |
|
32 |
Branches:
|
33 |
- `main` -- `measurement.json`
|
34 |
+
- `8b8h` -- 8bpw, 8bit lm_head
|
35 |
+
- `6b6h` -- 6bpw, 6bit lm_head
|
36 |
+
- `5b6h` -- 5bpw, 6bit lm_head
|
37 |
- `4b6h` -- 4bpw, 6bit lm_head
|
38 |
+
- `3b6h` -- 3bpw, 6bit lm_head
|
39 |
+
- `2.25b6h` -- 2.25bpw, 6bit lm_head
|
40 |
|
41 |
+
Original model link: [InferenceIllusionist/TeTO-MS-8x7b](https://huggingface.co/InferenceIllusionist/TeTO-MS-8x7b)
|
42 |
|
43 |
Original model README below.
|
44 |
|