(refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208)

* use folder for caching

* fix importing caching

* fix clickhouse pyright

* fix linting

* fix correctly pass kwargs and args

* fix test case for embedding

* fix linting

* fix embedding caching logic

* fix refactor handle utils.py

* fix test_embedding_caching_azure_individual_items_reordered
This commit is contained in:
Ishaan Jaff 2024-10-14 16:34:01 +05:30 committed by GitHub
parent 49f6a7660b
commit ba56e37244
96 changed files with 690 additions and 489 deletions

View file

@ -65,7 +65,7 @@ from litellm.utils import (
)
from ._logging import verbose_logger
from .caching import disable_cache, enable_cache, update_cache
from .caching.caching import disable_cache, enable_cache, update_cache
from .llms import (
aleph_alpha,
baseten,