From c12d6c3fe80e1b5e704d9846b246c059defadce7 Mon Sep 17 00:00:00 2001 From: ishaan-jaff Date: Sat, 25 Nov 2023 11:52:59 -0800 Subject: [PATCH] (docs) custom openai embedding --- .../docs/embedding/supported_embedding.md | 14 ++++++++++++++ 1 file changed, 14 insertions(+) diff --git a/docs/my-website/docs/embedding/supported_embedding.md b/docs/my-website/docs/embedding/supported_embedding.md index 8c122770a7..009e5337bc 100644 --- a/docs/my-website/docs/embedding/supported_embedding.md +++ b/docs/my-website/docs/embedding/supported_embedding.md @@ -103,6 +103,20 @@ print(response) h/t to [Mikko](https://www.linkedin.com/in/mikkolehtimaki/) for this integration +## OpenAI Compatible Embedding Models +Use this for calling `/embedding` endpoints on OpenAI Compatible Servers, example https://github.com/xorbitsai/inference + +**Note add `openai/` prefix to model so litellm knows to route to OpenAI** + +### Usage +```python +from litellm import embedding +response = embedding( + model = "openai/", # add `openai/` prefix to model so litellm knows to route to OpenAI + api_base="http://0.0.0.0:8000/" # set API Base of your Custom OpenAI Endpoint + input=["good morning from litellm"] +) +``` ## Bedrock Embedding