phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

Merge pull request #2942 from BerriAI/litellm_fix_router_loading

Browse source 
Router Async Improvements
This commit is contained in:
Krish Dholakia 2024-04-10 20:16:53 -07:00 • committed by GitHub
commit 83e7ed94ce
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
10 changed files with 746 additions and 60 deletions
Download patch file Download diff file Expand all files Collapse all files

1
litellm/proxy/proxy_server.py
View file

@ -2335,6 +2335,7 @@ class ProxyConfig:
"background_health_checks", False
)
health_check_interval = general_settings.get("health_check_interval", 300)
router_params: dict = {
"cache_responses": litellm.cache
!= None, # cache if user passed in cache values