From 12060cbd9d4f89a0eda1803ecee6cfa0011ce057 Mon Sep 17 00:00:00 2001 From: Lucas Raschek Date: Thu, 13 Mar 2025 00:39:05 +0100 Subject: [PATCH 1/3] Add OpenAI Compatible Docs and Extend Voyage setting --- .../docs/providers/openai_compatible.md | 6 ++++++ docs/my-website/docs/providers/voyage.md | 16 ++++++++++++++++ 2 files changed, 22 insertions(+) diff --git a/docs/my-website/docs/providers/openai_compatible.md b/docs/my-website/docs/providers/openai_compatible.md index c7f9bf6f40..f7bc06ff62 100644 --- a/docs/my-website/docs/providers/openai_compatible.md +++ b/docs/my-website/docs/providers/openai_compatible.md @@ -11,6 +11,12 @@ To call models hosted behind an openai proxy, make 2 changes: 2. **Do NOT** add anything additional to the base url e.g. `/v1/embedding`. LiteLLM uses the openai-client to make these calls, and that automatically adds the relevant endpoints. +::warning + +API Base URLs need to include `/v1` postfix. e.g. `https://api.openai.com/v1` + +:: + ## Usage - completion ```python diff --git a/docs/my-website/docs/providers/voyage.md b/docs/my-website/docs/providers/voyage.md index 6ab6b1846f..b9ef86b521 100644 --- a/docs/my-website/docs/providers/voyage.md +++ b/docs/my-website/docs/providers/voyage.md @@ -1,6 +1,22 @@ # Voyage AI https://docs.voyageai.com/embeddings/ +## Proxy settings + +| Model Settings | Value | +| -------------- | ----- | +| API Base | https://api.voyageai.com/v1 | +| Model Name | e.g. voyage-3-large | +| LiteLLM Model Name | e.g. openai/voyage-3-large | + + +:: info + + It's important that the API Base includes the `/v1` postfix and that the LiteLLM Model Name includes the `openai/` prefix. + +:: + + ## API Key ```python # env variable From 306da4d9b816bc5a8fb8f6607308f8bc21fabdf1 Mon Sep 17 00:00:00 2001 From: Lucas Raschek Date: Thu, 13 Mar 2025 00:41:41 +0100 Subject: [PATCH 2/3] Add Provider --- docs/my-website/docs/providers/voyage.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/my-website/docs/providers/voyage.md b/docs/my-website/docs/providers/voyage.md index b9ef86b521..3c0fb7733f 100644 --- a/docs/my-website/docs/providers/voyage.md +++ b/docs/my-website/docs/providers/voyage.md @@ -5,6 +5,7 @@ https://docs.voyageai.com/embeddings/ | Model Settings | Value | | -------------- | ----- | +| Provider | OpenAI-Compatible Endpoint | | API Base | https://api.voyageai.com/v1 | | Model Name | e.g. voyage-3-large | | LiteLLM Model Name | e.g. openai/voyage-3-large | From b6e80121f1300c8792103d436ca5105b03d8562a Mon Sep 17 00:00:00 2001 From: Lucas Raschek Date: Thu, 13 Mar 2025 02:07:58 +0100 Subject: [PATCH 3/3] Update Config --- docs/my-website/docs/providers/voyage.md | 15 ++++++++------- 1 file changed, 8 insertions(+), 7 deletions(-) diff --git a/docs/my-website/docs/providers/voyage.md b/docs/my-website/docs/providers/voyage.md index 3c0fb7733f..1d0748139c 100644 --- a/docs/my-website/docs/providers/voyage.md +++ b/docs/my-website/docs/providers/voyage.md @@ -3,17 +3,18 @@ https://docs.voyageai.com/embeddings/ ## Proxy settings -| Model Settings | Value | -| -------------- | ----- | -| Provider | OpenAI-Compatible Endpoint | -| API Base | https://api.voyageai.com/v1 | -| Model Name | e.g. voyage-3-large | -| LiteLLM Model Name | e.g. openai/voyage-3-large | +| Model Settings | Value | +| -------------- |--------------------------------------------------------------| +| Provider | OpenAI-Compatible Endpoint | +| API Base | https://api.voyageai.com/v1 | +| Model Name | e.g. voyage-3-large | +| LiteLLM Model Name | e.g. voyage/voyage-3-large | +| Custom LLM Provider | voyage (can not be set on creation, only on model edit page) | :: info - It's important that the API Base includes the `/v1` postfix and that the LiteLLM Model Name includes the `openai/` prefix. + It's important that the API Base includes the `/v1` postfix and that the LiteLLM Model Name includes the `voyage/` prefix. ::