Hugging Face's logo

zhengr
/
MixTAO-7Bx2-MoE-v8.1-GGUF

GGUF
Inference Endpoints
Model card Files Community
2

Prompt format

#2
by solotrek - opened
Discussion
solotrek
•
edited May 9, 2024

I am using LMStudio for inference of this model. Does anyone have a successful prompt format that could be shared? I have tried a few and the model seems to be spitting out garbage at the moment for me.

solotrek changed discussion title from Prompt template to Prompt format
zhengr
 Owner

Please use the "Alpaca" and you can try the HF space:

  1. https://zhengr-mixtao-7bx2-moe-v8-1-gguf-chat.hf.space
  2. https://zhengr-text-generation-webui.hf.space
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment