--- pipeline_tag: text-generation --- 8.1 bpw exl2 quant of [Cat-Llama-3-70B-instruct](https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct) More quants: https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct-exl2