Ishaan Jaff e47ebefced (feat) - provider budget improvements - ensure provider budgets work with multiple proxy instances + improve latency to ~90ms (#6886) ... * use 1 file for duration_in_seconds * add to readme.md * re use duration_in_seconds * fix importing _extract_from_regex, get_last_day_of_month * fix import * update provider budget routing * fix - remove dup test * add support for using in multi instance environments * test_in_memory_redis_sync_e2e * test_in_memory_redis_sync_e2e * fix test_in_memory_redis_sync_e2e * fix code quality check * fix test provider budgets * working provider budget tests * add fixture for provider budget routing * fix router testing for provider budgets * add comments on provider budget routing * use RedisPipelineIncrementOperation * add redis async_increment_pipeline * use redis async_increment_pipeline * use lower value for testing * use redis async_increment_pipeline * use consistent key name for increment op * add handling for budget windows * fix typing async_increment_pipeline * fix set attr * add clear doc strings * unit testing for provider budgets * test_redis_increment_pipeline		2024-11-24 16:36:19 -08:00
..
integrations	(Feat) Add langsmith key based logging (#6682)	2024-11-11 13:58:06 -08:00
llms	(Perf / latency improvement) improve pass through endpoint latency to ~50ms (before PR was 400ms) (#6874)	2024-11-22 18:47:26 -08:00
adapter.py	feat(anthropic_adapter.py): support for translating anthropic params to openai format	2024-07-10 00:32:28 -07:00
caching.py	(feat) - provider budget improvements - ensure provider budgets work with multiple proxy instances + improve latency to ~90ms (#6886)	2024-11-24 16:36:19 -08:00
completion.py	LiteLLM Minor Fixes and Improvements (09/12/2024) (#5658)	2024-09-12 23:04:06 -07:00
embedding.py	Removed config dict type definition	2024-05-17 10:39:00 +08:00
files.py	Fix file type handling of uppercase extensions	2024-06-13 15:00:16 -07:00
guardrails.py	LiteLLM Minor Fixes & Improvements (10/15/2024) (#6242)	2024-10-16 07:32:06 -07:00
rerank.py	LiteLLM Minor Fixes & Improvement (11/14/2024) (#6730)	2024-11-15 01:02:54 +05:30
router.py	(feat) provider budget routing improvements (#6827)	2024-11-19 21:25:08 -08:00
services.py	Litellm perf improvements 3 (#6573)	2024-11-05 03:51:26 +05:30
utils.py	Litellm dev 11 23 2024 (#6881)	2024-11-23 22:37:16 +05:30