Did I do anything wrong?
#1
by
victorx98
- opened
Got some strange output:
Me: hello
Output:
201 Created
HTTP/1.1 201 Created
Date: Wed, 30 Mar 2023 15:47:36 GMT
Content-Type: application/json; charset=utf-8
Transfer-Encoding: chunked
Connection: keep-alive
{
"id": "9d8e1f0c-a7
Are you using the right prompt template? I tested it using Loader: Exllama and the Vicuna 1.1 prompt template and it works well for me
Thanks. By default it was loaded with "WizardLM", I switched to MPT-chat and it seems to be working fine now.
I don't think MPT-Chat is quite right either. Switch it to Instruct-Vicuna 1.1
Don't see Instruct-Vicuna 1.1 in the list. I used Vicuna 1.1 and it works fine though
Ah yeah they're named differently in chat mode. Anyway, that's the right one.