forked from phoenix/litellm-mirror
docs(health.md): add docs on health checks for embedding models
This commit is contained in:
parent
f6407aaf74
commit
97f6475035
1 changed files with 18 additions and 1 deletions
|
@ -60,3 +60,20 @@ $ litellm /path/to/config.yaml
|
||||||
```
|
```
|
||||||
curl --location 'http://0.0.0.0:8000/health'
|
curl --location 'http://0.0.0.0:8000/health'
|
||||||
```
|
```
|
||||||
|
|
||||||
|
## Embedding Models
|
||||||
|
|
||||||
|
We need some way to know if the model is an embedding model when running checks, if you have this in your config, specifying mode it makes an embedding health check
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
model_list:
|
||||||
|
- model_name: azure-embedding-model
|
||||||
|
litellm_params:
|
||||||
|
model: azure/azure-embedding-model
|
||||||
|
api_base: os.environ/AZURE_API_BASE
|
||||||
|
api_key: os.environ/AZURE_API_KEY
|
||||||
|
api_version: "2023-07-01-preview"
|
||||||
|
model_info:
|
||||||
|
mode: embedding # 👈 ADD THIS
|
||||||
|
```
|
||||||
|
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue