docs(health.md): add text completion health check tutorial to docs

This commit is contained in:
Krrish Dholakia 2024-01-12 00:32:06 +05:30
parent d895979065
commit cbdb8d68a3

View file

@ -77,3 +77,18 @@ model_list:
mode: embedding # 👈 ADD THIS mode: embedding # 👈 ADD THIS
``` ```
## Text Completion Models
We need some way to know if the model is a text completion model when running checks, if you have this in your config, specifying mode it makes an embedding health check
```yaml
model_list:
- model_name: azure-text-completion
litellm_params:
model: azure/text-davinci-003
api_base: os.environ/AZURE_API_BASE
api_key: os.environ/AZURE_API_KEY
api_version: "2023-07-01-preview"
model_info:
mode: completion # 👈 ADD THIS
```