GGUF quant of https://huggingface.co/openerotica/Occult-Roleplay-Mixtral-4x7B

Only Q5_K and FP16 for now, given it seems to be under active development

Prompt format: ChatML, possibly others

All credit to openerotica et al

Downloads last month
48
GGUF
Model size
24.2B params
Architecture
llama

5-bit

Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.