Ishaan Jaff 2459f9735d (feat) Add Tag-based budgets on litellm router / proxy (#7236) ... * add BudgetConfig * add _get_tags_from_request_kwargs * test_tag_budgets_e2e_test_expect_to_fail * add a check for request tags * fix _async_get_cache_keys_for_router_budget_limiting * fix test * fix _sync_in_memory_spend_with_redis * _async_get_cache_keys_for_router_budget_limiting * fix _init_tag_budgets * fix type casting * docs show error for tag budget limit hit * fix _get_tags_from_request_kwargs * fix undo change		2024-12-14 17:28:36 -08:00
..
integrations	Code Quality Improvement - use vertex_ai/ as folder name for vertexAI (#7166)	2024-12-11 00:32:41 -08:00
llms	Litellm dev 12 11 2024 v2 (#7215)	2024-12-13 12:49:57 -08:00
passthrough_endpoints	(docs) Simplify /vertex_ai/ pass through docs (#6910)	2024-11-25 23:57:50 -08:00
adapter.py	feat(anthropic_adapter.py): support for translating anthropic params to openai format	2024-07-10 00:32:28 -07:00
caching.py	(feat) - provider budget improvements - ensure provider budgets work with multiple proxy instances + improve latency to ~90ms (#6886)	2024-11-24 16:36:19 -08:00
completion.py	LiteLLM Minor Fixes and Improvements (09/12/2024) (#5658)	2024-09-12 23:04:06 -07:00
embedding.py	Removed config dict type definition	2024-05-17 10:39:00 +08:00
files.py	Fix file type handling of uppercase extensions	2024-06-13 15:00:16 -07:00
guardrails.py	LiteLLM Minor Fixes & Improvements (10/15/2024) (#6242)	2024-10-16 07:32:06 -07:00
rerank.py	LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037)	2024-12-05 00:02:31 -08:00
router.py	fix(main.py): fix retries being multiplied when using openai sdk (#7221)	2024-12-14 11:56:55 -08:00
services.py	Litellm perf improvements 3 (#6573)	2024-11-05 03:51:26 +05:30
utils.py	(feat) Add Tag-based budgets on litellm router / proxy (#7236)	2024-12-14 17:28:36 -08:00