phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs

Browse source
This commit is contained in:
ishaan-jaff 2023-09-12 10:23:10 -07:00
parent e46dab5e92
commit fdf0dd0d11
1 changed files with 29 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

35
docs/my-website/docs/set_keys.md
View file

@ -8,7 +8,7 @@ LiteLLM allows you to specify the following:
You can set the API configs using: You can set the API configs using:
* Environment Variables * Environment Variables
* litellm.api_key [litellm variables] * litellm variables `litellm.api_key`
* Passing args to `completion()` * Passing args to `completion()`
# Setting API Keys, Base, and Version # Setting API Keys, Base, and Version
@ -31,16 +31,39 @@ os.environ["REPLICATE_API_KEY"] = "Your API Key"
os.environ["TOGETHERAI_API_KEY"] = "Your API Key" os.environ["TOGETHERAI_API_KEY"] = "Your API Key"
``` ```
### Setting API Base and API Version ### Setting API Base, API Version, API Type
```python ```python
AZURE_API_BASE = "https://openai-gpt-4-test-v-1.openai.azure.com/" # for azure openai
AZURE_API_VERSION = "2023-05-15" os.environ['AZURE_API_BASE'] = "https://openai-gpt-4-test2-v-12.openai.azure.com/"
os.environ['AZURE_API_VERSION'] = "2023-05-15"
os.environ['AZURE_API_TYPE'] = "your-custom-type"
# for openai
os.environ['OPENAI_API_BASE'] = "https://openai-gpt-4-test2-v-12.openai.azure.com/"
``` ```
### Setting API Version ## litellm variables
### litellm.api_key
This variable is checked for all providers
```python
import litellm
# openai call
litellm.api_key = "sk-OpenAIKey
response = litellm.completion(messages=messages, model="gpt-3.5-turbo")
# anthropic call
litellm.api_key = "sk-AnthropicKey
response = litellm.completion(messages=messages, model="claude-2")
```
### litellm.api_base
### litellm.provider_key (example litellm.openai_key)
## Dynamic API Key
You can pass the API key within `completion()` call: You can pass the API key within `completion()` call: