--- base_model: - mistralai/Mixtral-8x7B-v0.1 - jondurbin/bagel-dpo-8x7b-v0.2 - Sao10K/Sensualize-Mixtral-bf16 - mistralai/Mixtral-8x7B-v0.1 - Doctor-Shotgun/limarp-zloss-mixtral-8x7b-qlora - mistralai/Mixtral-8x7B-Instruct-v0.1 tags: - mergekit - merge license: cc-by-nc-4.0 --- # BagelMIsteryTour-v2-8x7B 4bpw Exllama quant of [ycros/BagelMIsteryTour-v2-8x7B](https://huggingface.co/ycros/BagelMIsteryTour-v2-8x7B) ## Other quants: EXL2: [8bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-4bpw-exl2), [3.5bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-3.5bpw-exl2) ## Prompt format: Alpaca It is noted to also work with mistral ``` Below is an instruction that describes a task. Write a response that appropriately completes the request. ### Instruction: {prompt} ### Input: {input} ### Response: ``` ## Contact Kooten on discord [ko-fi.com/kooten](https://ko-fi.com/kooten) if you would like to support me