BagelMIsteryTour-v2-8x7B 4bpw

Exllama quant of ycros/BagelMIsteryTour-v2-8x7B

Other quants:

EXL2: 8bpw, 6bpw, 5bpw, 4bpw, 3.5bpw

Prompt format: Alpaca

It is noted to also work with mistral

Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Input:
{input}
### Response:

Contact

Kooten on discord

ko-fi.com/kooten if you would like to support me

Downloads last month
8
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for Kooten/BagelMIsteryTour-v2-8x7B-4bpw-exl2