1823 commits

Author	SHA1	Message	Date
Ishaan Jaff	976ce2b286	init guardrails on proxy	2024-07-03 14:18:12 -07:00
Ishaan Jaff	424825be48	Merge pull request #4518 from BerriAI/litellm_fix_background_health_checks ... [Fix-Proxy] Background health checks use deep copy of model list for _run_background_health_check	2024-07-02 16:42:34 -07:00
Krrish Dholakia	d09a78d7fd	fix(slack_alerting.py): use in-memory cache for checking request status	2024-07-02 13:01:59 -07:00
Ishaan Jaff	46eb95da23	use deep copy of router for _run_background_health_check	2024-07-02 11:29:24 -07:00
Ishaan Jaff	51e02464a2	Merge pull request #4479 from BerriAI/litellm_fix_admin_ui_login_issue ... [Fix] Admin UI - fix error users we're seeing when logging in (use correct user_id when creating key for admin ui)	2024-06-29 20:00:45 -07:00
Ishaan Jaff	f5177e276a	fix - use correct user_id when creating key for admin ui	2024-06-29 14:36:58 -07:00
Ishaan Jaff	6396c30a7b	fix error logs store exception in DB	2024-06-29 12:15:14 -07:00
Ishaan Jaff	cf9636cc59	fix support pass through endpoints	2024-06-28 15:06:51 -07:00
Krish Dholakia	fa1cb7d903	Merge branch 'main' into litellm_response_cost_headers	2024-06-27 21:33:09 -07:00
Ishaan Jaff	6fdbe82bfb	Merge pull request #4447 from BerriAI/litellm_fix_error_on_v2_model_info ... [fix] error message on /v2/model info when no models exist	2024-06-27 16:33:19 -07:00
Ishaan Jaff	096ec0aade	fix error message on v2/model info	2024-06-27 16:29:11 -07:00
Ishaan Jaff	fde80eb117	fix secret redaction logic	2024-06-27 13:19:54 -07:00
Krrish Dholakia	be5d918211	fix(utils.py): return 'response_cost' in completion call ... Closes https://github.com/BerriAI/litellm/issues/4335	2024-06-26 17:55:57 -07:00
Ishaan Jaff	14220712be	init secret detection callback	2024-06-25 16:25:14 -07:00
Ishaan Jaff	3bce8a2395	Merge pull request #4364 from BerriAI/litellm_use_tracemalloc_mem_usage ... [Feat] add endpoint to debug memory util	2024-06-25 10:32:52 -07:00
Ishaan Jaff	26790352db	Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug ... [Fix] - Admin UI login bug	2024-06-24 08:19:37 -07:00
Ishaan Jaff	f59804d04b	fix ui login bug	2024-06-24 07:54:08 -07:00
Krrish Dholakia	4055381cdb	fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions ... Fixes https://github.com/BerriAI/litellm/issues/4338	2024-06-22 21:26:15 -07:00
Krish Dholakia	63d0defa6d	Merge branch 'main' into litellm_dynamic_tpm_limits	2024-06-22 19:14:59 -07:00
Ishaan Jaff	016e19270a	feat - add debug_utils	2024-06-22 16:12:42 -07:00
Krrish Dholakia	8843b0dc77	feat(dynamic_rate_limiter.py): working e2e	2024-06-22 14:41:22 -07:00
Ishaan Jaff	0960f8cfd5	use hash of master key encode the jwt	2024-06-22 08:58:31 -07:00
Ishaan Jaff	7065c9838f	ui - use cookies to return JWTs	2024-06-22 08:50:26 -07:00
Krrish Dholakia	8f95381276	refactor: instrument 'dynamic_rate_limiting' callback on proxy	2024-06-22 00:32:29 -07:00
Ishaan Jaff	aa3f2b3cf9	fix cost tracking by tags	2024-06-21 16:49:57 -07:00
Ishaan Jaff	f4db69a275	fix - /moderation don't require a model	2024-06-21 16:00:43 -07:00
Ishaan Jaff	7cba8f6de5	backend - new endpoint to show cache hit stats	2024-06-21 13:08:54 -07:00
Ishaan Jaff	5dd5cc7d87	fix refactor - add batches endpoints proxy server.py	2024-06-21 07:55:53 -07:00
Ishaan Jaff	a428857d95	Merge pull request #4322 from BerriAI/litellm_bug_fix_spend_tracking ... [Fix] user field and user_api_key_* is sometimes omitted randomly	2024-06-20 21:10:13 -07:00
Ishaan Jaff	beb67dca38	fix update_cache function	2024-06-20 17:27:25 -07:00
Ishaan Jaff	e7180dc624	fix don't store bad api key in user api key cache	2024-06-20 16:55:12 -07:00
Krrish Dholakia	477ed99896	feat(router.py): allow user to call specific deployment via id ... Allows easier health checks for specific deployments by just passing in model id	2024-06-19 13:02:46 -07:00
Krish Dholakia	ea2f27e472	Merge branch 'main' into litellm_aws_kms_fixes	2024-06-19 09:30:54 -07:00
Krrish Dholakia	aeeaadfaa6	fix(router.py): support adding models across multiple orgs, with 1 model definition	2024-06-18 19:57:10 -07:00
Krrish Dholakia	6fcad5f199	fix(proxy_server.py): track team spend for cached team object ... fixes issue where team budgets for jwt tokens weren't asserted	2024-06-18 17:10:12 -07:00
John HU	ec5e26a848	fix: strip llm credential before returning	2024-06-17 12:14:40 -07:00
Ishaan Jaff	b7c5700b54	fix- refactor proxy place internal user endpoints in sep file	2024-06-15 16:39:06 -07:00
Ishaan Jaff	a9649c0860	Merge pull request #4217 from BerriAI/litellm_refactor_proxy_server ... [Refactor-Proxy] Make proxy_server.py < 10K lines (move management, key, endpoints to their own files)	2024-06-15 16:27:31 -07:00
Ishaan Jaff	f3a7c52f60	fix - non sso ui sign up flow	2024-06-15 15:26:44 -07:00
Ishaan Jaff	abb544190a	fix - refactor key endpoints	2024-06-15 14:13:32 -07:00
Ishaan Jaff	9b655c9ef7	use directories for importing new endpoints	2024-06-15 13:35:21 -07:00
Ishaan Jaff	0f8dbe5ed4	refactor health endpoints	2024-06-15 12:39:04 -07:00
Ishaan Jaff	2dcc484e5d	fix swagger	2024-06-15 12:22:16 -07:00
Ishaan Jaff	b1599c3f40	refactor spend endpoints	2024-06-15 12:17:33 -07:00
Ishaan Jaff	749af8278b	fix test	2024-06-15 11:46:15 -07:00
Ishaan Jaff	897f6bc7ea	feat - refactor team endpoints	2024-06-15 11:40:36 -07:00
Ishaan Jaff	4bc2bfb176	fix - proxy refactor user_api_key_auth	2024-06-15 10:33:58 -07:00
Ishaan Jaff	f16a9a6d92	fix send emails to team members	2024-06-14 20:11:16 -07:00
Ishaan Jaff	3c56bfbc5a	send team_alias on team budget alerts	2024-06-14 17:00:43 -07:00
Krish Dholakia	c373f104cc	Merge branch 'main' into litellm_redis_cache_usage	2024-06-13 22:07:21 -07:00