hgloow commited on
Commit
d3b7608
·
1 Parent(s): 8b9d53a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -42,9 +42,9 @@ Measured using ExLlamaV2 and 4096 max_seq_len with [Oobabooga's Text Generation
42
  | Branch | BPW | VRAM Usage | Description |
43
  | ------ | --- | ---------- | ----------- |
44
  [5.0bpw (main)](https://huggingface.co/hgloow/Sakura-SOLAR-Instruct-EXL2/tree/main)|5.0|7.7 GB|For >=10GB VRAM cards
45
- [6.0bpw](https://huggingface.co/hgloow/Sakura-SOLAR-Instruct-EXL2/tree/6.0bpw)|6.0|9.0 GB|For >=10GB VRAM cards with idle VRAM atleast or below 500MB (headroom for ui)
46
- [7.0bpw](https://huggingface.co/hgloow/Sakura-SOLAR-Instruct-EXL2/tree/7.0bpw)|7.0|10.2 GB|For >=11GB VRAM cards with idle VRAM atleast or below 500MB (headroom for ui)
47
- [8.0bpw](https://huggingface.co/hgloow/MSakura-SOLAR-Instruct-EXL2/tree/8.0bpw)|8.0|11.3 GB|For >=12GB VRAM cards with idle VRAM atleast or below 500MB (headroom for ui)
48
 
49
  ## Prompt template: Orca-Hashes
50
  Courtesy of [TheBloke](https://huggingface.co/TheBloke)
 
42
  | Branch | BPW | VRAM Usage | Description |
43
  | ------ | --- | ---------- | ----------- |
44
  [5.0bpw (main)](https://huggingface.co/hgloow/Sakura-SOLAR-Instruct-EXL2/tree/main)|5.0|7.7 GB|For >=10GB VRAM cards
45
+ [6.0bpw](https://huggingface.co/hgloow/Sakura-SOLAR-Instruct-EXL2/tree/6.0bpw)|6.0|9.0 GB|For >=10GB VRAM cards with idle VRAM atleast or below 500MB (headroom for other things)
46
+ [7.0bpw](https://huggingface.co/hgloow/Sakura-SOLAR-Instruct-EXL2/tree/7.0bpw)|7.0|10.2 GB|For >=11GB VRAM cards with idle VRAM atleast or below 500MB (headroom for other things)
47
+ [8.0bpw](https://huggingface.co/hgloow/MSakura-SOLAR-Instruct-EXL2/tree/8.0bpw)|8.0|11.3 GB|For >=12GB VRAM cards with idle VRAM atleast or below 500MB (headroom for other things)
48
 
49
  ## Prompt template: Orca-Hashes
50
  Courtesy of [TheBloke](https://huggingface.co/TheBloke)