Anthonyg5005
/

ReMM-v2.2-L2-13B-exl2

Text Generation

Quantized Model

Model card Files Files and versions Community

Anthonyg5005 commited on Jan 24, 2024

Commit

93b14ea

·

verified ·

1 Parent(s): 809c22c

Update README.md

Files changed (1) hide show

README.md +6 -4

README.md CHANGED Viewed

@@ -22,11 +22,13 @@ This repository includes the quantized models for the [ReMM V2.2](https://huggin
 ## Current models
-| exl2 Quant | Model Branch | Model Size | Minimum VRAM (4096 Context) | BPW |
 |-|-|-|-|-|
-| 3-Bit | main | N/A | N/A | 3.72 |
-| 4-Bit | 4bit | N/A | N/A | N/A |
-| 5-Bit | [Orang Baik's Repo](https://huggingface.co/R136a1/ReMM-v2.2-L2-13B-exl2) | 8.96 GB | 16GB GPU | 5.33 |
 ### Note

 ## Current models
+| exl2 Quant | Model Branch | Model Size | Minimum recommended VRAM GPU (4096 Context) | BPW |
 |-|-|-|-|-|
+| 3-Bit | main | N/A | 10GB GPU | 3.14 |
+| 3-Bit | 3bit | 6.36 GB | 10GB GPU | 3.72 |
+| 4-Bit | 4bit | 7.13 GB | 12GB GPU (10GB with swap) | 4.2 |
+| 4-Bit | 4.6bit | 7.81 GB | 12GB GPU | 4.63 |
+| 5-Bit | [Orang Baik's Repo](https://huggingface.co/R136a1/ReMM-v2.2-L2-13B-exl2) | 8.96 GB | 16GB GPU (12GB with swap) | 5.33 |
 ### Note