diff --git a/docs/my-website/docs/proxy/embedding.md b/docs/my-website/docs/proxy/embedding.md index a8c88c57e..e1a7677f9 100644 --- a/docs/my-website/docs/proxy/embedding.md +++ b/docs/my-website/docs/proxy/embedding.md @@ -148,11 +148,13 @@ print(query_result[:5]) ## Supported Models -### Create Config.yaml +See supported Embedding Providers & Models [here](https://docs.litellm.ai/docs/embedding/supported_embedding) + +#### Create Config.yaml -For HF LiteLLM Proxy supports all [Feature-Extraction Embedding models](https://huggingface.co/models?pipeline_tag=feature-extraction) +LiteLLM Proxy supports all Feature-Extraction Embedding models. ```yaml model_list: @@ -170,10 +172,71 @@ model_list: ``` + + + + +```yaml +model_list: + - model_name: azure-embedding-model # model group + litellm_params: + model: azure/azure-embedding-model # model name for litellm.embedding(model=azure/azure-embedding-model) call + api_base: your-azure-api-base + api_key: your-api-key + api_version: 2023-07-01-preview +``` + + + + + +```yaml +model_list: +- model_name: text-embedding-ada-002 # model group + litellm_params: + model: text-embedding-ada-002 # model name for litellm.embedding(model=text-embedding-ada-002) + api_key: your-api-key-1 +- model_name: text-embedding-ada-002 + litellm_params: + model: text-embedding-ada-002 + api_key: your-api-key-2 +``` + + + + + +

Use this for calling /embedding endpoints on OpenAI Compatible Servers.

+ +**Note add `openai/` prefix to `litellm_params`: `model` so litellm knows to route to OpenAI** + +```yaml +model_list: +- model_name: text-embedding-ada-002 # model group + litellm_params: + model: openai/ # model name for litellm.embedding(model=text-embedding-ada-002) + api_base: +``` +
-### Make Request +#### Start Proxy +```shell +litellm --config config.yaml +``` + +#### Make Request +Sends Request to `deployed-codebert-base` + +```shell +curl --location 'http://0.0.0.0:8000/embeddings' \ + --header 'Content-Type: application/json' \ + --data ' { + "model": "deployed-codebert-base", + "input": ["write a litellm poem"] + }' +```