GGUF quant of https://huggingface.co/openerotica/Occult-Roleplay-Mixtral-4x7B
Only Q5_K and FP16 for now, given it seems to be under active development
Prompt format: ChatML, possibly others
All credit to openerotica et al
- Downloads last month
- 48
5-bit
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.