Update README.md
Browse files
README.md
CHANGED
@@ -42,9 +42,9 @@ Measured using ExLlamaV2 and 4096 max_seq_len with [Oobabooga's Text Generation
|
|
42 |
| Branch | BPW | VRAM Usage | Description |
|
43 |
| ------ | --- | ---------- | ----------- |
|
44 |
[5.0bpw (main)](https://huggingface.co/hgloow/Sakura-SOLAR-Instruct-EXL2/tree/main)|5.0|7.7 GB|For >=10GB VRAM cards
|
45 |
-
[6.0bpw](https://huggingface.co/hgloow/Sakura-SOLAR-Instruct-EXL2/tree/6.0bpw)|6.0|9.0 GB|For >=10GB VRAM cards with idle VRAM atleast or below 500MB (headroom for
|
46 |
-
[7.0bpw](https://huggingface.co/hgloow/Sakura-SOLAR-Instruct-EXL2/tree/7.0bpw)|7.0|10.2 GB|For >=11GB VRAM cards with idle VRAM atleast or below 500MB (headroom for
|
47 |
-
[8.0bpw](https://huggingface.co/hgloow/MSakura-SOLAR-Instruct-EXL2/tree/8.0bpw)|8.0|11.3 GB|For >=12GB VRAM cards with idle VRAM atleast or below 500MB (headroom for
|
48 |
|
49 |
## Prompt template: Orca-Hashes
|
50 |
Courtesy of [TheBloke](https://huggingface.co/TheBloke)
|
|
|
42 |
| Branch | BPW | VRAM Usage | Description |
|
43 |
| ------ | --- | ---------- | ----------- |
|
44 |
[5.0bpw (main)](https://huggingface.co/hgloow/Sakura-SOLAR-Instruct-EXL2/tree/main)|5.0|7.7 GB|For >=10GB VRAM cards
|
45 |
+
[6.0bpw](https://huggingface.co/hgloow/Sakura-SOLAR-Instruct-EXL2/tree/6.0bpw)|6.0|9.0 GB|For >=10GB VRAM cards with idle VRAM atleast or below 500MB (headroom for other things)
|
46 |
+
[7.0bpw](https://huggingface.co/hgloow/Sakura-SOLAR-Instruct-EXL2/tree/7.0bpw)|7.0|10.2 GB|For >=11GB VRAM cards with idle VRAM atleast or below 500MB (headroom for other things)
|
47 |
+
[8.0bpw](https://huggingface.co/hgloow/MSakura-SOLAR-Instruct-EXL2/tree/8.0bpw)|8.0|11.3 GB|For >=12GB VRAM cards with idle VRAM atleast or below 500MB (headroom for other things)
|
48 |
|
49 |
## Prompt template: Orca-Hashes
|
50 |
Courtesy of [TheBloke](https://huggingface.co/TheBloke)
|