Spaces:
Configuration error
Configuration error
# Secret Managers | |
liteLLM reads secrets from yoour secret manager, .env file | |
- [Infisical Secret Manager](#infisical-secret-manager) | |
- [.env Files](#env-files) | |
For expected format of secrets see [supported LLM models](https://litellm.readthedocs.io/en/latest/supported) | |
## Infisical Secret Manager | |
Integrates with [Infisical's Secret Manager](https://infisical.com/) for secure storage and retrieval of API keys and sensitive data. | |
### Usage | |
liteLLM manages reading in your LLM API secrets/env variables from Infisical for you | |
``` | |
import litellm | |
from infisical import InfisicalClient | |
litellm.secret_manager = InfisicalClient(token="your-token") | |
messages = [ | |
{"role": "system", "content": "You are a helpful assistant."}, | |
{"role": "user", "content": "What's the weather like today?"}, | |
] | |
response = litellm.completion(model="gpt-3.5-turbo", messages=messages) | |
print(response) | |
``` | |
## .env Files | |
If no secret manager client is specified, Litellm automatically uses the `.env` file to manage sensitive data. | |