my_app.aiconfig.json

{
  "name": "Enterprise Scenarios Leaderboard - Playground 🚀",
  "schema_version": "latest",
  "metadata": {
    "parameters": {
      "context": "BrightHouse Smart Thermostat is a learning thermostat that programs itself, saves energy by changing temperature according to user habits, it can be controlled from anywhere using the BrightHouse mobile app. It also has a Farsight feature located, which lights up the thermostat to show temperature, time, or weather. You turn on the Farsight Feature in Settings on the left menu on the app. "
    },
    "models": {},
    "default_model": null,
    "model_parsers": null
  },
  "description": "Play with the models from the **Enterprise Scenarios Leaderboard**: https://huggingface.co/spaces/PatronusAI/enterprise_scenarios_leaderboard) \n➤ This example tests a Customer Support Use Case -> Open **Global Parameters** which has {{context}} set. \n➤ Only includes models on inference API.                                                                                        ",
  "prompts": [
    {
      "name": "Mistral-7B-Instruct-v0.1",
      "input": "You are given context to answer a customer question. Answer the question using the context. Question: How do I turn on the Farsight feature?\nContext: {{context}}",
      "metadata": {
        "model": {
          "name": "Text Generation",
          "settings": {
            "model": "mistralai/Mistral-7B-Instruct-v0.1"
          }
        },
        "tags": null,
        "parameters": {}
      },
      "outputs": [
        {
          "output_type": "execute_result",
          "execution_count": 0,
          "data": "\n\nAnswer: To turn on the Farsight feature on your BrightHouse Smart Thermostat, you can follow these steps: \n1. Open the BrightHouse mobile app on your smartphone or tablet.\n2. Log in to your account if you're not already logged in.\n3. On the left menu, click on the \"Settings\" icon.\n4. In the \"Settings\" menu, scroll down and click on \"Farsight\".\n5. Toggle the switch to turn on the Farsight feature.\n6. Now, your thermostat will display the temperature, time, or weather on the Farsight feature, even when you're not in the room.</s>",
          "mime_type": null,
          "metadata": {}
        }
      ]
    },
    {
      "name": "zephyr-7b-beta",
      "input": "You are given context to answer a customer question. Answer the question using the context. Question: How do I turn on the Farsight feature?\nContext: {{context}}",
      "metadata": {
        "model": {
          "name": "Text Generation",
          "settings": {
            "model": "HuggingFaceH4/zephyr-7b-beta",
            "max_new_tokens": 50
          }
        },
        "tags": null,
        "parameters": {}
      },
      "outputs": [
        {
          "output_type": "execute_result",
          "execution_count": 0,
          "data": "1. Open the BrightHouse mobile app. 2. Tap the left menu. 3. Tap Settings. 4. Tap Display. 5. Toggle the Farsight switch to the right to turn on the",
          "mime_type": null,
          "metadata": {}
        }
      ]
    },
    {
      "name": "openchat-3.5-0106",
      "input": "You are given context to answer a customer question. Answer the question using the context. Question: How do I turn on the Farsight feature?\nContext: {{context}}",
      "metadata": {
        "model": {
          "name": "Text Generation",
          "settings": {
            "model": "openchat/openchat-3.5-0106"
          }
        },
        "tags": null,
        "parameters": {}
      },
      "outputs": [
        {
          "output_type": "execute_result",
          "execution_count": 0,
          "data": "\nAnswer: To turn on the Farsight feature, go to the Settings on the left menu on the BrightHouse mobile app and enable the Farsight feature.<|end_of_turn|>",
          "mime_type": null,
          "metadata": {}
        }
      ]
    }
  ]
}