phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 10:44:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(Bug Fix) Add health check support for realtime models (#7453)

Browse source 
* add mode: realtime

* add _realtime_health_check

* test_realtime_health_check

* azure _realtime_health_check

* _realtime_health_check

* Realtime Models

* fix code quality
This commit is contained in:
Ishaan Jaff 2024-12-28 18:15:00 -08:00 • committed by GitHub
parent 5c1e8b60d4
commit 4e65722a00
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
6 changed files with 110 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

8
litellm/main.py
View file

@ -5153,7 +5153,13 @@ async def ahealth_check( # noqa: PLR0915
model_params: dict,
mode: Optional[
Literal[
"completion", "embedding", "image_generation", "chat", "batch", "rerank"
"completion",
"embedding",
"image_generation",
"chat",
"batch",
"rerank",
"realtime",
]
] = None,
prompt: Optional[str] = None,