phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

Merge pull request #4681 from BerriAI/litellm_mem_usage

Browse source 
[Fix] Reduce Mem Usage - only set ttl for requests to 2 mins
This commit is contained in:
Ishaan Jaff 2024-07-12 18:31:19 -07:00 • committed by GitHub
commit cf5f11cc84
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/proxy/utils.py
View file

@ -282,7 +282,7 @@ class ProxyLogging:
key="request_status:{}".format(litellm_call_id), key="request_status:{}".format(litellm_call_id),
value=status, value=status,
local_only=True, local_only=True,
ttl=3600, ttl=120,
) )
# The actual implementation of the function # The actual implementation of the function