Spaces:
Running
Running
leaderboard
/
benchmark
/llm_text_generation
/chat
/models
/microsoft
/Phi-3-small-8k-instruct
/README.md
A newer version of the Gradio SDK is available:
5.29.0
- Added
chat_template
that uses the chat format recommended by phi-3's HuggingFace hub README and supports the "system" role.
Chat template
{% if messages[0]['role'] == 'system' %}
{% set loop_messages = messages[1:] %}
{% set system_message = messages[0]['content'] + ' ' %}
{% else %}
{% set loop_messages = messages %}
{% set system_message = '' %}
{% endif %}
{{ bos_token }}
{% for message in loop_messages %}
{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}
{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}
{% endif %}
{% if loop.index0 == 0 %}
{% set content = system_message + message['content'] %}
{% else %}
{% set content = message['content'] %}
{% endif %}
{% if (message['role'] == 'user') %}
{{'<|user|>' + '\n' + content + '<|end|>' + '\n' + '<|assistant|>' + '\n'}}
{% elif (message['role'] == 'assistant') %}
{{content + '<|end|>' + '\n'}}
{% endif %}
{% endfor %}