metadata
license: other
language:
- en
EXL2 Quantization of migtissera's Synthia-13B-v1.2.
Other quantized models are available from TheBloke: GPTQ - GGUF - AWQ
Model details
This repo contains 5 bits (5.33b) ExLlamav2 quantization model files for migtissera's Synthia-13B-v1.2. You can run this model on 4K context on T4 GPU (16GB VRAM).
Prompt Format
SYSTEM: Elaborate on the topic using a Tree of Thoughts and backtrack when necessary to construct a clear, cohesive Chain of Thought reasoning. Always answer without hesitation.
USER: How is a rocket launched from the surface of the earth to Low Earth Orbit?
ASSISTANT: