forked from phoenix/litellm-mirror
feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx
This commit is contained in:
parent
c9d7437d16
commit
48f19cf839
8 changed files with 194 additions and 20 deletions
|
@ -5,6 +5,9 @@ LiteLLM allows you to specify the following:
|
|||
* API Base
|
||||
* API Version
|
||||
* API Type
|
||||
* Project
|
||||
* Location
|
||||
* Token
|
||||
|
||||
Useful Helper functions:
|
||||
* [`check_valid_key()`](#check_valid_key)
|
||||
|
@ -43,6 +46,24 @@ os.environ['AZURE_API_TYPE'] = "azure" # [OPTIONAL]
|
|||
os.environ['OPENAI_API_BASE'] = "https://openai-gpt-4-test2-v-12.openai.azure.com/"
|
||||
```
|
||||
|
||||
### Setting Project, Location, Token
|
||||
|
||||
For cloud providers:
|
||||
- Azure
|
||||
- Bedrock
|
||||
- GCP
|
||||
- Watson AI
|
||||
|
||||
you might need to set additional parameters. LiteLLM provides a common set of params, that we map across all providers.
|
||||
|
||||
| | LiteLLM param | Watson | Vertex AI | Azure | Bedrock |
|
||||
|------|--------------|--------------|--------------|--------------|--------------|
|
||||
| Project | project | watsonx_project | vertex_project | n/a | n/a |
|
||||
| Region | region_name | watsonx_region_name | vertex_location | n/a | aws_region_name |
|
||||
| Token | token | watsonx_token or token | n/a | azure_ad_token | n/a |
|
||||
|
||||
If you want, you can call them by their provider-specific params as well.
|
||||
|
||||
## litellm variables
|
||||
|
||||
### litellm.api_key
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue