OpenHands / docs /usage /llms /azure-llms.mdx
Backup-bdg's picture
Upload 964 files
51ff9e5 verified
raw
history blame
1.3 kB
---
title: Azure
description: OpenHands uses LiteLLM to make calls to Azure's chat models. You can find their documentation on using Azure as a provider [here](https://docs.litellm.ai/docs/providers/azure).
---
## Azure OpenAI Configuration
When running OpenHands, you'll need to set the following environment variable using `-e` in the
[docker run command](../installation#running-openhands):
```
LLM_API_VERSION="<api-version>" # e.g. "2023-05-15"
```
Example:
```bash
docker run -it --pull=always \
-e LLM_API_VERSION="2023-05-15"
...
```
Then in the OpenHands UI Settings under the `LLM` tab:
<Note>
You will need your ChatGPT deployment name which can be found on the deployments page in Azure. This is referenced as
&lt;deployment-name&gt; below.
</Note>
1. Enable `Advanced` options.
2. Set the following:
- `Custom Model` to azure/&lt;deployment-name&gt;
- `Base URL` to your Azure API Base URL (e.g. `https://example-endpoint.openai.azure.com`)
- `API Key` to your Azure API key
### Azure OpenAI Configuration
When running OpenHands, set the following environment variable using `-e` in the
[docker run command](../installation#running-openhands):
```
LLM_API_VERSION="<api-version>" # e.g. "2024-02-15-preview"
```