R136a1
/

Synthia-13B-v1.2-EXL2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

R136a1 commited on Sep 27, 2023

Commit

4e95f0d

•

1 Parent(s): dc22b90

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -12,7 +12,7 @@ Other quantized models are available from TheBloke: [GPTQ](https://huggingface.c
 ## Model details
 This repo contains 5 bits (5.33b) ExLlamav2 quantization model files for [migtissera's Synthia-13B-v1.2](https://huggingface.co/migtissera/Synthia-13B-v1.2).
-You can run this model on 4K context on T4 GPU (16Gb VRAM).
 ## Prompt Format

 ## Model details
 This repo contains 5 bits (5.33b) ExLlamav2 quantization model files for [migtissera's Synthia-13B-v1.2](https://huggingface.co/migtissera/Synthia-13B-v1.2).
+You can run this model on 4K context on T4 GPU (16GB VRAM).
 ## Prompt Format