phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 10:44:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat(vertex_ai_context_caching.py): check gemini cache, if key already exists

Browse source
This commit is contained in:
Krrish Dholakia 2024-08-26 20:28:18 -07:00
parent b0cc1df2d6
commit 0eea01dae9
6 changed files with 171 additions and 56 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/caching.py
View file

@ -2236,7 +2236,7 @@ class Cache:
if self.namespace is not None and isinstance(self.cache, RedisCache):
self.cache.namespace = self.namespace
def get_cache_key(self, *args, **kwargs):
def get_cache_key(self, *args, **kwargs) -> str:
"""
Get the cache key for the given arguments.