3 commits

Author	SHA1	Message	Date
Krish Dholakia	9160d80fa5	LiteLLM Minor Fixes & Improvements (11/12/2024) (#6705) ... * fix(caching): convert arg to equivalent kwargs in llm caching handler prevent unexpected errors * fix(caching_handler.py): don't pass args to caching * fix(caching): remove all *args from caching.py * fix(caching): consistent function signatures + abc method * test(caching_unit_tests.py): add unit tests for llm caching ensures coverage for common caching scenarios across different implementations * refactor(litellm_logging.py): move to using cache key from hidden params instead of regenerating one * fix(router.py): drop redis password requirement * fix(proxy_server.py): fix faulty slack alerting check * fix(langfuse.py): avoid copying functions/thread lock objects in metadata fixes metadata copy error when parent otel span in metadata * test: update test	2024-11-12 22:50:51 +05:30
Ishaan Jaff	441adad3ae	(router_strategy/) ensure all async functions use async cache methods (#6489) ... * fix router strat * use async set / get cache in router_strategy * add coverage for router strategy * fix imports * fix batch_get_cache * use async methods for least busy * fix least busy use async methods * fix test_dual_cache_increment * test async_get_available_deployment when routing_strategy="least-busy"	2024-10-29 21:07:17 +05:30
Ishaan Jaff	d9e7818e6b	(Testing) Add unit testing for DualCache - ensure in memory cache is used when expected (#6471) ... * test test_dual_cache_get_set * unit testing for dual cache * fix async_set_cache_sadd * test_dual_cache_local_only	2024-10-29 08:42:57 +05:30