add secret manager to docs

This commit is contained in:
ishaan-jaff 2023-08-05 13:05:02 -07:00
parent 2ecd132a94
commit 05f0eba617
2 changed files with 35 additions and 0 deletions

33
docs/secret.md Normal file
View file

@ -0,0 +1,33 @@
# Supported Secret Managers
liteLLM reads secrets from yoour secret manager, .env file
- [Infisical Secret Manager](#infisical-secret-manager)
- [.env Files](#env-files)
For expected format of secrets see [supported LLM models](./supported.mdsupported)
## Infisical Secret Manager
Integrates with [Infisical's Secret Manager](https://infisical.com/) for secure storage and retrieval of API keys and sensitive data.
### Usage
liteLLM manages reading in your LLM API secrets/env variables from Infisical for you
```
import litellm
from infisical import InfisicalClient
litellm.secret_manager = InfisicalClient(token="your-token")
messages = [
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "What's the weather like today?"},
]
response = litellm.completion(model="gpt-3.5-turbo", messages=messages)
print(response)
```
## .env Files
If no secret manager client is specified, Litellm automatically uses the `.env` file to manage sensitive data.

View file

@ -7,6 +7,8 @@ nav:
- 🤖 Supported LLM APIs:
- Supported Completion & Chat APIs: supported.md
- Supported Embedding APIs: supported_embedding.md
- 🏃‍♂️ Fetching Inputs:
- Secret Managers: secret.md
- 💾 Callbacks - Logging Output:
- Quick Start: advanced.md
- Output Integrations: client_integrations.md