phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix(router.py): skip setting model_group response headers for now

Browse source 
current implementation increases redis cache calls by 3x
This commit is contained in:
Krrish Dholakia 2024-09-28 18:40:17 -07:00
parent 6e590e4949
commit bc6ed7a06f
4 changed files with 43 additions and 89 deletions
Download patch file Download diff file Expand all files Collapse all files

1
litellm/caching.py
View file

@ -1860,6 +1860,7 @@ class DualCache(BaseCache):
Returns - int - the incremented value
"""
traceback.print_stack()
try:
result: int = value
if self.in_memory_cache is not None: