README.md

---
license: cc-by-nc-nd-4.0
language:
  - en
library_name: transformers
pipeline_tag: text-generation
tags:
  - starling
  - mistral
  - llama-2
---
quant of [Delcos's](https://huggingface.co/Delcos) [Velara-11B-V2](https://huggingface.co/Delcos/Velara-11B-V2)

```
python3 convert.py \
    -i /input/Delcos_Velara-11B-V2/ \
    -c /input/pippa_cleaned/0000.parquet \
    -o /output/temp/ \
    -cf /output/Velara-11B-V2-8bpw-h8-exl2/ \
    -l 8192 \
    -ml 8192 \
    -b 8 \
    -hb 8
```