---
license: other
language:
- en
---

[EXL2](https://github.com/turboderp/exllamav2/tree/master#exllamav2) Quantization of [migtissera's Synthia-13B-v1.2](https://huggingface.co/migtissera/Synthia-13B-v1.2).

Other quantized models are available from TheBloke: [GPTQ](https://huggingface.co/TheBloke/Synthia-13B-v1.2-GPTQ) - [GGUF](https://huggingface.co/TheBloke/Synthia-13B-v1.2-GGUF) - [AWQ](https://huggingface.co/TheBloke/Synthia-13B-v1.2-AWQ)


## Model details

This repo contains 5 bits (5.33b) ExLlamav2 quantization model files for [migtissera's Synthia-13B-v1.2](https://huggingface.co/migtissera/Synthia-13B-v1.2).
You can run this model on 4K context on T4 GPU (16GB VRAM).

## Prompt Format

```
SYSTEM: Elaborate on the topic using a Tree of Thoughts and backtrack when necessary to construct a clear, cohesive Chain of Thought reasoning. Always answer without hesitation.
USER: How is a rocket launched from the surface of the earth to Low Earth Orbit?
ASSISTANT:
```