2778 commits

Author	SHA1	Message	Date
Krrish Dholakia	6889a4c0dd	fix(utils.py): predibase exception mapping - map 424 as a badrequest error	2024-06-25 13:47:38 -07:00
Krrish Dholakia	cccc55213b	fix(router.py): improve error message returned for fallbacks	2024-06-25 11:27:20 -07:00
Krrish Dholakia	0396d484fb	feat(router.py): support mock testing content policy + context window fallbacks	2024-06-25 10:58:19 -07:00
Ishaan Jaff	b9f83f48ba	Merge pull request #4364 from BerriAI/litellm_use_tracemalloc_mem_usage ... [Feat] add endpoint to debug memory util	2024-06-25 10:32:52 -07:00
Ishaan Jaff	a9d1be71ff	Merge pull request #4395 from BerriAI/litelm_use_spend_calc_aliases ... Fix /spend/calculate use model_group_alias when set	2024-06-24 21:15:05 -07:00
Ishaan Jaff	9e7d8ba910	/spend/calculate use model aliases on this endpoint	2024-06-24 21:14:00 -07:00
Krish Dholakia	9902947521	Merge pull request #4390 from BerriAI/litellm_langfuse_router_logging ... Log rejected router requests to langfuse	2024-06-24 21:13:45 -07:00
Ishaan Jaff	37f2712bba	Merge pull request #4389 from BerriAI/litellm_allow_user_to_define_public_routes ... [Feat-Enterprise] - Allow setting custom public routes	2024-06-24 20:23:35 -07:00
Krish Dholakia	5d570e7c6c	Merge pull request #4392 from BerriAI/litellm_gemini_content_policy_errors ... fix(vertex_httpx.py): cover gemini content violation (on prompt)	2024-06-24 20:00:06 -07:00
Ishaan Jaff	2aa0ce50b5	fix importing litellm	2024-06-24 19:58:53 -07:00
Ishaan Jaff	bd2298eba4	example cofnig with public routes	2024-06-24 19:51:23 -07:00
Ishaan Jaff	5e1403cd0a	add helper to check route_in_additonal_public_routes	2024-06-24 19:50:35 -07:00
Ishaan Jaff	11117665e1	test - spend/calculate endpoints	2024-06-24 19:32:52 -07:00
Krrish Dholakia	1ff0129a94	fix(vertex_httpx.py): cover gemini content violation (on prompt)	2024-06-24 19:13:56 -07:00
Ishaan Jaff	02ffed2545	feat - refactor /spend/calculate	2024-06-24 19:05:34 -07:00
Krrish Dholakia	a4bea47a2d	fix(router.py): log rejected router requests to langfuse ... Fixes issue where rejected requests weren't being logged	2024-06-24 17:52:01 -07:00
Ishaan Jaff	5309be2456	example config with public routes	2024-06-24 17:46:38 -07:00
Ishaan Jaff	2f90759db5	feat - allow user to define public routes	2024-06-24 17:45:13 -07:00
Krrish Dholakia	f5fbdf0fee	fix(router.py): use user-defined model_input_tokens for pre-call filter checks	2024-06-24 17:25:26 -07:00
Krrish Dholakia	bab4a6c5df	feat(internal_user_endpoints.py): expose /user/delete endpoint	2024-06-24 13:29:26 -07:00
Ishaan Jaff	dd048cf342	Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug ... [Fix] - Admin UI login bug	2024-06-24 08:19:37 -07:00
Ishaan Jaff	acbcfef5af	fix ui login bug	2024-06-24 07:54:08 -07:00
Krish Dholakia	0454c0781a	Merge branch 'main' into litellm_azure_content_filter_fallbacks	2024-06-22 21:28:29 -07:00
Krrish Dholakia	cea630022e	fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions ... Fixes https://github.com/BerriAI/litellm/issues/4338	2024-06-22 21:26:15 -07:00
Krish Dholakia	961e7ac95d	Merge branch 'main' into litellm_dynamic_tpm_limits	2024-06-22 19:14:59 -07:00
Krrish Dholakia	2c7a80d08d	fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback ... Exception maps azure content filter response exceptions	2024-06-22 19:10:15 -07:00
Ishaan Jaff	3105eaebc3	feat - add debug_utils	2024-06-22 16:12:42 -07:00
Krrish Dholakia	bae7377128	docs(team_budgets.md): fix script ... /	2024-06-22 15:42:05 -07:00
Krrish Dholakia	fc4e900a23	docs(team_budgets.md): update docs with script for testing dynamic rate limiting	2024-06-22 15:26:58 -07:00
Krrish Dholakia	a31a05d45d	feat(dynamic_rate_limiter.py): working e2e	2024-06-22 14:41:22 -07:00
Ishaan Jaff	ab38a90be0	fix /audio/speech	2024-06-22 13:45:34 -07:00
Ishaan Jaff	c4f6b903b3	ui - new build	2024-06-22 09:13:34 -07:00
Ishaan Jaff	c86efa55a5	use hash of master key encode the jwt	2024-06-22 08:58:31 -07:00
Ishaan Jaff	03d1d9229d	ui - use cookies to return JWTs	2024-06-22 08:50:26 -07:00
Krrish Dholakia	532f24bfb7	refactor: instrument 'dynamic_rate_limiting' callback on proxy	2024-06-22 00:32:29 -07:00
Krish Dholakia	f192b76ed4	Merge pull request #4344 from BerriAI/litellm_refactor_langfuse_slack_trace_url ... refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url	2024-06-21 23:37:38 -07:00
Krrish Dholakia	068e8dff5b	feat(dynamic_rate_limiter.py): passing base case	2024-06-21 22:46:46 -07:00
Ishaan Jaff	b4d95e740e	fix get_logging_payload	2024-06-21 20:42:28 -07:00
Krrish Dholakia	a028600932	feat(dynamic_rate_limiter.py): update cache with active project	2024-06-21 20:25:40 -07:00
Krrish Dholakia	2545da777b	feat(dynamic_rate_limiter.py): initial commit for dynamic rate limiting ... Closes https://github.com/BerriAI/litellm/issues/4124	2024-06-21 18:41:31 -07:00
Ishaan Jaff	662cb5a5ec	ui - new build	2024-06-21 18:12:12 -07:00
Ishaan Jaff	29c2155796	fix cost tracking by tags	2024-06-21 16:49:57 -07:00
Krrish Dholakia	2584120012	refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url ... gets the url from logging object	2024-06-21 16:12:25 -07:00
Ishaan Jaff	eb8a9b2654	fix - /moderation don't require a model	2024-06-21 16:00:43 -07:00
Ishaan Jaff	cc11cedf02	Merge pull request #4340 from BerriAI/litellm_show_cache_hit_stats ... [Feat] Admin UI - Show Cache hit stats	2024-06-21 15:34:11 -07:00
Krrish Dholakia	941574a921	fix(proxy/utils.py): fix add langfuse trace id to alert ... Fixing the import after refactor	2024-06-21 14:55:09 -07:00
Ishaan Jaff	35c07306df	show correct key aliases on ui	2024-06-21 14:36:38 -07:00
Krrish Dholakia	5912decd19	fix(proxy/utils.py): fix bool on check	2024-06-21 14:29:38 -07:00
Ishaan Jaff	10e88a939d	backend - new endpoint to show cache hit stats	2024-06-21 13:08:54 -07:00
Ishaan Jaff	12f4fb3a42	fix refactor - add batches endpoints proxy server.py	2024-06-21 07:55:53 -07:00