Requantization of TheBloke's fp16 version of Wizard-Vicuna 13B with SuperHOT merged to GGUFv2.

Original link: https://huggingface.co/TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-fp16

Downloads last month
198
GGUF
Model size
13B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .