forked from phoenix/litellm-mirror
33 lines
1,023 B
Markdown
33 lines
1,023 B
Markdown
# Secret Managers
|
|
liteLLM reads secrets from yoour secret manager, .env file
|
|
|
|
- [Infisical Secret Manager](#infisical-secret-manager)
|
|
- [.env Files](#env-files)
|
|
|
|
For expected format of secrets see [supported LLM models](https://litellm.readthedocs.io/en/latest/supported)
|
|
|
|
## Infisical Secret Manager
|
|
Integrates with [Infisical's Secret Manager](https://infisical.com/) for secure storage and retrieval of API keys and sensitive data.
|
|
|
|
### Usage
|
|
liteLLM manages reading in your LLM API secrets/env variables from Infisical for you
|
|
|
|
```
|
|
import litellm
|
|
from infisical import InfisicalClient
|
|
|
|
litellm.secret_manager = InfisicalClient(token="your-token")
|
|
|
|
messages = [
|
|
{"role": "system", "content": "You are a helpful assistant."},
|
|
{"role": "user", "content": "What's the weather like today?"},
|
|
]
|
|
|
|
response = litellm.completion(model="gpt-3.5-turbo", messages=messages)
|
|
|
|
print(response)
|
|
```
|
|
|
|
|
|
## .env Files
|
|
If no secret manager client is specified, Litellm automatically uses the `.env` file to manage sensitive data.
|