forked from phoenix/litellm-mirror
add secret manager to docs
This commit is contained in:
parent
2ecd132a94
commit
05f0eba617
2 changed files with 35 additions and 0 deletions
33
docs/secret.md
Normal file
33
docs/secret.md
Normal file
|
@ -0,0 +1,33 @@
|
||||||
|
# Supported Secret Managers
|
||||||
|
liteLLM reads secrets from yoour secret manager, .env file
|
||||||
|
|
||||||
|
- [Infisical Secret Manager](#infisical-secret-manager)
|
||||||
|
- [.env Files](#env-files)
|
||||||
|
|
||||||
|
For expected format of secrets see [supported LLM models](./supported.mdsupported)
|
||||||
|
|
||||||
|
## Infisical Secret Manager
|
||||||
|
Integrates with [Infisical's Secret Manager](https://infisical.com/) for secure storage and retrieval of API keys and sensitive data.
|
||||||
|
|
||||||
|
### Usage
|
||||||
|
liteLLM manages reading in your LLM API secrets/env variables from Infisical for you
|
||||||
|
|
||||||
|
```
|
||||||
|
import litellm
|
||||||
|
from infisical import InfisicalClient
|
||||||
|
|
||||||
|
litellm.secret_manager = InfisicalClient(token="your-token")
|
||||||
|
|
||||||
|
messages = [
|
||||||
|
{"role": "system", "content": "You are a helpful assistant."},
|
||||||
|
{"role": "user", "content": "What's the weather like today?"},
|
||||||
|
]
|
||||||
|
|
||||||
|
response = litellm.completion(model="gpt-3.5-turbo", messages=messages)
|
||||||
|
|
||||||
|
print(response)
|
||||||
|
```
|
||||||
|
|
||||||
|
|
||||||
|
## .env Files
|
||||||
|
If no secret manager client is specified, Litellm automatically uses the `.env` file to manage sensitive data.
|
|
@ -7,6 +7,8 @@ nav:
|
||||||
- 🤖 Supported LLM APIs:
|
- 🤖 Supported LLM APIs:
|
||||||
- Supported Completion & Chat APIs: supported.md
|
- Supported Completion & Chat APIs: supported.md
|
||||||
- Supported Embedding APIs: supported_embedding.md
|
- Supported Embedding APIs: supported_embedding.md
|
||||||
|
- 🏃♂️ Fetching Inputs:
|
||||||
|
- Secret Managers: secret.md
|
||||||
- 💾 Callbacks - Logging Output:
|
- 💾 Callbacks - Logging Output:
|
||||||
- Quick Start: advanced.md
|
- Quick Start: advanced.md
|
||||||
- Output Integrations: client_integrations.md
|
- Output Integrations: client_integrations.md
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue