From 97f64750352a3acab0f7fe548e03901d25335895 Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Thu, 21 Dec 2023 07:53:56 +0530 Subject: [PATCH] docs(health.md): add docs on health checks for embedding models --- docs/my-website/docs/proxy/health.md | 19 ++++++++++++++++++- 1 file changed, 18 insertions(+), 1 deletion(-) diff --git a/docs/my-website/docs/proxy/health.md b/docs/my-website/docs/proxy/health.md index 5dffd7100..d724bdaca 100644 --- a/docs/my-website/docs/proxy/health.md +++ b/docs/my-website/docs/proxy/health.md @@ -59,4 +59,21 @@ $ litellm /path/to/config.yaml 3. Query health endpoint: ``` curl --location 'http://0.0.0.0:8000/health' -``` \ No newline at end of file +``` + +## Embedding Models + +We need some way to know if the model is an embedding model when running checks, if you have this in your config, specifying mode it makes an embedding health check + +```yaml +model_list: + - model_name: azure-embedding-model + litellm_params: + model: azure/azure-embedding-model + api_base: os.environ/AZURE_API_BASE + api_key: os.environ/AZURE_API_KEY + api_version: "2023-07-01-preview" + model_info: + mode: embedding # 👈 ADD THIS +``` +