(refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208)

Browse source

* use folder for caching

* fix importing caching

* fix clickhouse pyright

* fix linting

* fix correctly pass kwargs and args

* fix test case for embedding

* fix linting

* fix embedding caching logic

* fix refactor handle utils.py

* fix test_embedding_caching_azure_individual_items_reordered

...

This commit is contained in:

Ishaan Jaff 2024-10-14 16:34:01 +05:30 • committed by GitHub

parent 20e50d7002

commit 4d1b4beb3d

No known key found for this signature in database

GPG key ID: B5690EEEBB952194

96 changed files with 690 additions and 489 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

2903

litellm/caching/caching.py Normal file

View file

File diff suppressed because it is too large Load diff