File size: 985 Bytes
90762c6 dc22b90 90762c6 dc22b90 90762c6 dc22b90 90762c6 dc22b90 90762c6 dc22b90 4e95f0d 90762c6 dc22b90 90762c6 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |
---
license: other
language:
- en
---
[EXL2](https://github.com/turboderp/exllamav2/tree/master#exllamav2) Quantization of [migtissera's Synthia-13B-v1.2](https://huggingface.co/migtissera/Synthia-13B-v1.2).
Other quantized models are available from TheBloke: [GPTQ](https://huggingface.co/TheBloke/Synthia-13B-v1.2-GPTQ) - [GGUF](https://huggingface.co/TheBloke/Synthia-13B-v1.2-GGUF) - [AWQ](https://huggingface.co/TheBloke/Synthia-13B-v1.2-AWQ)
## Model details
This repo contains 5 bits (5.33b) ExLlamav2 quantization model files for [migtissera's Synthia-13B-v1.2](https://huggingface.co/migtissera/Synthia-13B-v1.2).
You can run this model on 4K context on T4 GPU (16GB VRAM).
## Prompt Format
```
SYSTEM: Elaborate on the topic using a Tree of Thoughts and backtrack when necessary to construct a clear, cohesive Chain of Thought reasoning. Always answer without hesitation.
USER: How is a rocket launched from the surface of the earth to Low Earth Orbit?
ASSISTANT:
```
|