Spaces:

huggingchat

/

chat-ui

like 1.09k

Running

What is the correct prompt template for WizardLM-2-8x22B in the .env.local?

When setting it to the default one:

 <s>{{#each messages}}{{#ifUser}}[INST] {{#if 

@first

	}}{{#if 

@root

	.preprompt}}{{@root.preprompt}}\n{{/if}}{{/if}}{{content}} [/INST]{{/ifUser}}{{#ifAssistant}}{{content}}</s>{{/ifAssistant}}{{/each}}

the generated output is very odd and incoherent.

When setting the prompt template to the one displayed in the model card: {system_prompt} USER: {prompt} ASSISTANT: </s>

the output gets even worse.

Can anyone help?