phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix(utils.py): exclude s3 caching from individual item caching for embedding list

Browse source 
can't bulk upload to s3, so this will slow down calls

https://github.com/BerriAI/litellm/pull/1417
This commit is contained in:
Krrish Dholakia 2024-01-13 16:19:30 +05:30
parent fb53d18d6a
commit 3c02ad8b95
2 changed files with 14 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

4
litellm/caching.py
View file

@ -444,9 +444,9 @@ class Cache:
"""
if type == "redis":
self.cache: BaseCache = RedisCache(host, port, password, **kwargs)
if type == "local":
elif type == "local":
self.cache = InMemoryCache()
if type == "s3":
elif type == "s3":
self.cache = S3Cache(
s3_bucket_name=s3_bucket_name,
s3_region_name=s3_region_name,