Hugging Face's logo

Anthonyg5005
/
ReMM-v2.2-L2-13B-exl2

Text Generation
Safetensors
English
ExLlamaV2
llama
Mytho
ReMM
LLaMA 2
Quantized Model
exl2
Model card Files Community
Anthonyg5005 commited on
Commit
7ff8d56
·
verified ·
1 Parent(s): 2b8a084

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -24,7 +24,7 @@ This repository includes the quantized models for the [ReMM V2.2](https://huggin
24
 
25
  | exl2 Quant | Model Branch | Model Size | Minimum recommended VRAM GPU (4096 Context) | BPW |
26
  |-|-|-|-|-|
27
- | 3-Bit | main | N/A | 8GB GPU | 3.14 |
28
  | 3-Bit | 3bit | 6.36 GB | 10GB GPU | 3.72 |
29
  | 4-Bit | 4bit | 7.13 GB | 12GB GPU (10GB with swap) | 4.2 |
30
  | 4-Bit | 4.6bit | 7.81 GB | 12GB GPU | 4.63 |
 
24
 
25
  | exl2 Quant | Model Branch | Model Size | Minimum recommended VRAM GPU (4096 Context) | BPW |
26
  |-|-|-|-|-|
27
+ | 3-Bit | main | 5.44 GB | 8GB GPU | 3.14 |
28
  | 3-Bit | 3bit | 6.36 GB | 10GB GPU | 3.72 |
29
  | 4-Bit | 4bit | 7.13 GB | 12GB GPU (10GB with swap) | 4.2 |
30
  | 4-Bit | 4.6bit | 7.81 GB | 12GB GPU | 4.63 |