phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-24 18:24:20 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

docs(simple_proxy.md): add loading api keys from key vault to proxy docs

Browse source
This commit is contained in:
Krrish Dholakia 2023-11-25 12:15:05 -08:00
parent c9fdf25c94
commit f9ac71a45a
1 changed files with 17 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

17
docs/my-website/docs/simple_proxy.md
View file

@ -761,6 +761,23 @@ model_list:
```shell
$ litellm --config /path/to/config.yaml
```
### Load API Keys from Vault
If you have secrets saved in Azure Vault, etc. and don't want to expose them in the config.yaml, here's how to load model-specific keys from the environment.
```yaml
model_list:
- model_name: gpt-4-team1
litellm_params: # params for litellm.completion() - https://docs.litellm.ai/docs/completion/input#input---request-body
model: azure/chatgpt-v-2
api_base: https://openai-gpt-4-test-v-1.openai.azure.com/
api_version: "2023-05-15"
api_key: os.environ/<MY-AZURE-DEPLOYMENT-KEY>
```
s/o to [@David Manouchehri](https://www.linkedin.com/in/davidmanouchehri/) for helping with this.
### Load Balancing - Multiple Instances of 1 model
If you have multiple instances of the same model,