| license: cc-by-nc-nd-4.0 | |
| language: | |
| - en | |
| library_name: transformers | |
| pipeline_tag: text-generation | |
| tags: | |
| - starling | |
| - mistral | |
| - llama-2 | |
| quant of [Delcos's](https://huggingface.co/Delcos) [Velara-11B-V2](https://huggingface.co/Delcos/Velara-11B-V2) | |
| ``` | |
| python3 convert.py \ | |
| -i /input/Delcos_Velara-11B-V2/ \ | |
| -c /input/pippa_cleaned/0000.parquet \ | |
| -o /output/temp/ \ | |
| -cf /output/Velara-11B-V2-8bpw-h8-exl2/ \ | |
| -l 8192 \ | |
| -ml 8192 \ | |
| -b 8 \ | |
| -hb 8 | |
| ``` |