mirror of
https://github.com/BerriAI/litellm.git
synced 2025-04-24 10:14:26 +00:00
Merge b6e80121f1
into b82af5b826
This commit is contained in:
commit
950d3ba584
2 changed files with 24 additions and 0 deletions
|
@ -11,6 +11,12 @@ To call models hosted behind an openai proxy, make 2 changes:
|
|||
|
||||
2. **Do NOT** add anything additional to the base url e.g. `/v1/embedding`. LiteLLM uses the openai-client to make these calls, and that automatically adds the relevant endpoints.
|
||||
|
||||
::warning
|
||||
|
||||
API Base URLs need to include `/v1` postfix. e.g. `https://api.openai.com/v1`
|
||||
|
||||
::
|
||||
|
||||
|
||||
## Usage - completion
|
||||
```python
|
||||
|
|
|
@ -1,6 +1,24 @@
|
|||
# Voyage AI
|
||||
https://docs.voyageai.com/embeddings/
|
||||
|
||||
## Proxy settings
|
||||
|
||||
| Model Settings | Value |
|
||||
| -------------- |--------------------------------------------------------------|
|
||||
| Provider | OpenAI-Compatible Endpoint |
|
||||
| API Base | https://api.voyageai.com/v1 |
|
||||
| Model Name | e.g. voyage-3-large |
|
||||
| LiteLLM Model Name | e.g. voyage/voyage-3-large |
|
||||
| Custom LLM Provider | voyage (can not be set on creation, only on model edit page) |
|
||||
|
||||
|
||||
:: info
|
||||
|
||||
It's important that the API Base includes the `/v1` postfix and that the LiteLLM Model Name includes the `voyage/` prefix.
|
||||
|
||||
::
|
||||
|
||||
|
||||
## API Key
|
||||
```python
|
||||
# env variable
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue