1296 commits

Author	SHA1	Message	Date
Ishaan Jaff	9f43761000	fix - show alerts on /completions endpoint	2024-05-15 15:45:21 -07:00
Ishaan Jaff	c00d232900	Merge pull request #3655 from BerriAI/litellm_only_show_debug_info_server_side ... Fix Proxy Server - only show API base, Model server log exceptions, not on client side	2024-05-15 14:20:14 -07:00
Ishaan Jaff	1a11b151b7	fix - show litellm debug info in errors	2024-05-15 14:18:12 -07:00
Ishaan Jaff	2e81347607	fix - don't raise hanging request alert for /completions	2024-05-15 10:27:02 -07:00
Krrish Dholakia	51a02de4cf	refactor(proxy_server.py): update doc string for /user/update	2024-05-15 08:25:14 -07:00
Ishaan Jaff	e7af8d61cd	fix check_request_disconnected = None case	2024-05-14 20:38:32 -07:00
Ishaan Jaff	4466982507	feat - cancel tasks when fast api request is cancelled	2024-05-14 19:58:51 -07:00
Ishaan Jaff	787c02c8db	fix - return success spend reset	2024-05-14 11:38:39 -07:00
Ishaan Jaff	7e56e27226	fix security for global_spend_reset	2024-05-14 11:04:50 -07:00
Ishaan Jaff	3686789c36	feat - reset spend per team, api_key	2024-05-13 18:23:23 -07:00
Ishaan Jaff	6ea5a276f8	backend - show spend per tag by time	2024-05-13 17:13:48 -07:00
Ishaan Jaff	12cf9d71c7	feat - /spend/report endpoint	2024-05-13 15:01:02 -07:00
Ishaan Jaff	9d4b727913	fix - show team based spend reports	2024-05-13 13:56:48 -07:00
Ishaan Jaff	21845bc061	Merge pull request #3609 from BerriAI/litellm_send_daily_spend_report ... [Feat] send weekly spend reports by Team/Tag	2024-05-13 12:45:37 -07:00
Ishaan Jaff	40b2f33a80	fix - only schedule spend alerting when db is not none	2024-05-13 12:30:54 -07:00
Ishaan Jaff	aac81c59b5	test - weekly / monthly spend report alerts on /health/services	2024-05-13 10:50:26 -07:00
Ishaan Jaff	4a679bb640	schedule weekly/monthly spend reports	2024-05-13 10:44:19 -07:00
Ishaan Jaff	07247452c5	feat - show monthly spend reports	2024-05-13 10:10:44 -07:00
Ishaan Jaff	50f3677989	feat - _get_weekly_spend_reports	2024-05-13 09:26:51 -07:00
Krrish Dholakia	c3293474dd	fix(proxy_server.py): return 'allowed-model-region' in headers	2024-05-13 08:48:16 -07:00
Ishaan Jaff	514c5737f8	Merge pull request #3587 from BerriAI/litellm_proxy_use_batch_completions_model_csv ... [Feat] Use csv values for proxy batch completions (OpenAI Python compatible)	2024-05-13 07:55:12 -07:00
Krrish Dholakia	b4684d5132	fix(proxy_server.py): linting fix	2024-05-11 22:05:01 -07:00
Ishaan Jaff	d4288b134b	fix - use csv list for batch completions	2024-05-11 14:24:48 -07:00
Ishaan Jaff	bf909a89f8	Merge pull request #3585 from BerriAI/litellm_router_batch_comp ... [Litellm Proxy + litellm.Router] - Pass the same message/prompt to N models	2024-05-11 13:51:45 -07:00
Ishaan Jaff	b8c7bbcb9f	support batch /chat/completions on proxy	2024-05-11 13:24:25 -07:00
Krish Dholakia	bbe1300c5b	Merge branch 'main' into feat/add-azure-content-filter	2024-05-11 09:30:38 -07:00
Ishaan Jaff	933f8ed16b	fix - proxy_server.py	2024-05-10 13:47:35 -07:00
Nick Wong	d3a228d03b	added changes from upstream ... Merge branch 'main' into fix/error-on-get-user-role	2024-05-09 16:14:14 -07:00
Nick Wong	c42f1ce2c6	removed extra default dict return, which causes error if user_role is a string	2024-05-09 16:13:26 -07:00
Krrish Dholakia	927d36148f	feat(proxy_server.py): expose new /team/list endpoint ... Closes https://github.com/BerriAI/litellm/issues/3523	2024-05-09 13:21:00 -07:00
Krrish Dholakia	e3f25a4a1f	fix(auth_checks.py): fix 'get_end_user_object' ... await cache get	2024-05-09 13:05:56 -07:00
Krish Dholakia	8ad979cdfe	Merge branch 'main' into litellm_region_based_routing	2024-05-08 22:19:51 -07:00
Krrish Dholakia	3d18897d69	feat(router.py): enable filtering model group by 'allowed_model_region'	2024-05-08 22:10:17 -07:00
Krrish Dholakia	db666b01e5	feat(proxy_server.py): add CRUD endpoints for 'end_user' management ... allow admin to specify region + default models for end users	2024-05-08 18:50:36 -07:00
Ishaan Jaff	6d955ef457	Merge branch 'main' into ui_show_spend_end_user	2024-05-08 18:29:25 -07:00
Ishaan Jaff	a38d9e35fd	feat - get price by end_user	2024-05-08 18:19:27 -07:00
Ishaan Jaff	1eea4d1c90	fix /global/spend/end_users	2024-05-08 17:03:38 -07:00
Krrish Dholakia	6575143460	feat(proxy_server.py): return litellm version in response headers	2024-05-08 16:00:08 -07:00
Krish Dholakia	91bb7cd261	Merge pull request #3437 from msabramo/add-engines-model-chat-completions-endpoint ... Add `/engines/{model}/chat/completions` endpoint	2024-05-08 14:30:39 -07:00
Krish Dholakia	0e709fdc21	Merge branch 'main' into litellm_ui_fixes_6	2024-05-07 22:01:04 -07:00
Krrish Dholakia	fbcda918de	feat(ui/model_dashboard.tsx): show if model is config or db model	2024-05-07 21:34:18 -07:00
Krrish Dholakia	5a16bec6a1	feat(model_dashboard.tsx): allow user to edit input cost per token for model on ui ... also contains fixes for `/model/update`	2024-05-07 20:57:21 -07:00
Krrish Dholakia	312249ca44	feat(ui/model_dashboard.tsx): show if model is config or db model	2024-05-07 18:29:14 -07:00
Krish Dholakia	2aaaa5e1b4	Merge pull request #3506 from BerriAI/litellm_reintegrate_langfuse_url_slack_alert ... feat(slack_alerting.py): reintegrate langfuse trace url for slack alerts	2024-05-07 15:03:29 -07:00
Krrish Dholakia	f210318bf1	fix(proxy_server.py): return budget duration in user response object	2024-05-07 13:47:32 -07:00
Krrish Dholakia	f2766fddbf	fix(proxy_server.py): fix /v1/models bug where it would return empty list ... handle 'all-team-models' being set for a given key	2024-05-07 13:43:15 -07:00
Krrish Dholakia	872470ff1f	feat(slack_alerting.py): reintegrate langfuse trace url for slack alerts ... this ensures langfuse trace url returned in llm api exception err	2024-05-07 12:58:49 -07:00
Ishaan Jaff	bfef424b39	fix don't let slack alert block /model/new	2024-05-06 20:47:29 -07:00
Ishaan Jaff	eb84c69ec6	fix - /model/new	2024-05-06 20:45:17 -07:00
Krish Dholakia	aa62d891a0	Merge branch 'main' into litellm_slack_daily_reports	2024-05-06 19:31:20 -07:00