phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

feat - load proxy models on proxy startup events

Browse source
This commit is contained in:
Ishaan Jaff 2024-04-13 13:28:58 -07:00
parent d849810445
commit 28cc9a11c4
1 changed files with 5 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

5
litellm/proxy/proxy_server.py
View file

@ -3186,6 +3186,11 @@ async def startup_event():
seconds=30, seconds=30,
args=[prisma_client, proxy_logging_obj], args=[prisma_client, proxy_logging_obj],
) )
# this will load all existing models on proxy startup
await proxy_config.add_deployment(
prisma_client=prisma_client, proxy_logging_obj=proxy_logging_obj
)
scheduler.start() scheduler.start()