Ishaan Jaff
|
9f43761000
|
fix - show alerts on /completions endpoint
|
2024-05-15 15:45:21 -07:00 |
|
Krrish Dholakia
|
6a357b4275
|
feat(proxy_server.py): Enabling Admin to control general settings on proxy ui
|
2024-05-15 15:26:57 -07:00 |
|
Ishaan Jaff
|
c00d232900
|
Merge pull request #3655 from BerriAI/litellm_only_show_debug_info_server_side
Fix Proxy Server - only show API base, Model server log exceptions, not on client side
|
2024-05-15 14:20:14 -07:00 |
|
Ishaan Jaff
|
1a11b151b7
|
fix - show litellm debug info in errors
|
2024-05-15 14:18:12 -07:00 |
|
Ishaan Jaff
|
2e81347607
|
fix - don't raise hanging request alert for /completions
|
2024-05-15 10:27:02 -07:00 |
|
Krrish Dholakia
|
5dcf3d672c
|
feat(proxy_server.py): new /end_user/info endpoint
get spend for a specific end-user
|
2024-05-15 09:50:52 -07:00 |
|
Krrish Dholakia
|
51a02de4cf
|
refactor(proxy_server.py): update doc string for /user/update
|
2024-05-15 08:25:14 -07:00 |
|
Ishaan Jaff
|
e7af8d61cd
|
fix check_request_disconnected = None case
|
2024-05-14 20:38:32 -07:00 |
|
Ishaan Jaff
|
4466982507
|
feat - cancel tasks when fast api request is cancelled
|
2024-05-14 19:58:51 -07:00 |
|
Ishaan Jaff
|
787c02c8db
|
fix - return success spend reset
|
2024-05-14 11:38:39 -07:00 |
|
Ishaan Jaff
|
7e56e27226
|
fix security for global_spend_reset
|
2024-05-14 11:04:50 -07:00 |
|
Ishaan Jaff
|
3686789c36
|
feat - reset spend per team, api_key
|
2024-05-13 18:23:23 -07:00 |
|
Ishaan Jaff
|
6ea5a276f8
|
backend - show spend per tag by time
|
2024-05-13 17:13:48 -07:00 |
|
Ishaan Jaff
|
12cf9d71c7
|
feat - /spend/report endpoint
|
2024-05-13 15:01:02 -07:00 |
|
Ishaan Jaff
|
9d4b727913
|
fix - show team based spend reports
|
2024-05-13 13:56:48 -07:00 |
|
Ishaan Jaff
|
21845bc061
|
Merge pull request #3609 from BerriAI/litellm_send_daily_spend_report
[Feat] send weekly spend reports by Team/Tag
|
2024-05-13 12:45:37 -07:00 |
|
Ishaan Jaff
|
40b2f33a80
|
fix - only schedule spend alerting when db is not none
|
2024-05-13 12:30:54 -07:00 |
|
Ishaan Jaff
|
aac81c59b5
|
test - weekly / monthly spend report alerts on /health/services
|
2024-05-13 10:50:26 -07:00 |
|
Ishaan Jaff
|
4a679bb640
|
schedule weekly/monthly spend reports
|
2024-05-13 10:44:19 -07:00 |
|
Ishaan Jaff
|
07247452c5
|
feat - show monthly spend reports
|
2024-05-13 10:10:44 -07:00 |
|
Ishaan Jaff
|
50f3677989
|
feat - _get_weekly_spend_reports
|
2024-05-13 09:26:51 -07:00 |
|
Krrish Dholakia
|
c3293474dd
|
fix(proxy_server.py): return 'allowed-model-region' in headers
|
2024-05-13 08:48:16 -07:00 |
|
Ishaan Jaff
|
514c5737f8
|
Merge pull request #3587 from BerriAI/litellm_proxy_use_batch_completions_model_csv
[Feat] Use csv values for proxy batch completions (OpenAI Python compatible)
|
2024-05-13 07:55:12 -07:00 |
|
Krrish Dholakia
|
b4684d5132
|
fix(proxy_server.py): linting fix
|
2024-05-11 22:05:01 -07:00 |
|
Ishaan Jaff
|
d4288b134b
|
fix - use csv list for batch completions
|
2024-05-11 14:24:48 -07:00 |
|
Ishaan Jaff
|
bf909a89f8
|
Merge pull request #3585 from BerriAI/litellm_router_batch_comp
[Litellm Proxy + litellm.Router] - Pass the same message/prompt to N models
|
2024-05-11 13:51:45 -07:00 |
|
Ishaan Jaff
|
b8c7bbcb9f
|
support batch /chat/completions on proxy
|
2024-05-11 13:24:25 -07:00 |
|
Krish Dholakia
|
bbe1300c5b
|
Merge branch 'main' into feat/add-azure-content-filter
|
2024-05-11 09:30:38 -07:00 |
|
Krrish Dholakia
|
9e9f5d41d9
|
fix(proxy_server.py): check + get end-user obj even for master key calls
fixes issue where region-based routing wasn't working for end-users if master key was given
|
2024-05-10 16:54:51 -07:00 |
|
Ishaan Jaff
|
933f8ed16b
|
fix - proxy_server.py
|
2024-05-10 13:47:35 -07:00 |
|
Nick Wong
|
d3a228d03b
|
added changes from upstream
Merge branch 'main' into fix/error-on-get-user-role
|
2024-05-09 16:14:14 -07:00 |
|
Nick Wong
|
c42f1ce2c6
|
removed extra default dict return, which causes error if user_role is a string
|
2024-05-09 16:13:26 -07:00 |
|
Krrish Dholakia
|
927d36148f
|
feat(proxy_server.py): expose new /team/list endpoint
Closes https://github.com/BerriAI/litellm/issues/3523
|
2024-05-09 13:21:00 -07:00 |
|
Krrish Dholakia
|
e3f25a4a1f
|
fix(auth_checks.py): fix 'get_end_user_object'
await cache get
|
2024-05-09 13:05:56 -07:00 |
|
Krish Dholakia
|
8ad979cdfe
|
Merge branch 'main' into litellm_region_based_routing
|
2024-05-08 22:19:51 -07:00 |
|
Krrish Dholakia
|
3d18897d69
|
feat(router.py): enable filtering model group by 'allowed_model_region'
|
2024-05-08 22:10:17 -07:00 |
|
Krrish Dholakia
|
db666b01e5
|
feat(proxy_server.py): add CRUD endpoints for 'end_user' management
allow admin to specify region + default models for end users
|
2024-05-08 18:50:36 -07:00 |
|
Ishaan Jaff
|
6d955ef457
|
Merge branch 'main' into ui_show_spend_end_user
|
2024-05-08 18:29:25 -07:00 |
|
Ishaan Jaff
|
a38d9e35fd
|
feat - get price by end_user
|
2024-05-08 18:19:27 -07:00 |
|
Ishaan Jaff
|
1eea4d1c90
|
fix /global/spend/end_users
|
2024-05-08 17:03:38 -07:00 |
|
Krrish Dholakia
|
6575143460
|
feat(proxy_server.py): return litellm version in response headers
|
2024-05-08 16:00:08 -07:00 |
|
Krish Dholakia
|
91bb7cd261
|
Merge pull request #3437 from msabramo/add-engines-model-chat-completions-endpoint
Add `/engines/{model}/chat/completions` endpoint
|
2024-05-08 14:30:39 -07:00 |
|
Krish Dholakia
|
0e709fdc21
|
Merge branch 'main' into litellm_ui_fixes_6
|
2024-05-07 22:01:04 -07:00 |
|
Krrish Dholakia
|
fbcda918de
|
feat(ui/model_dashboard.tsx): show if model is config or db model
|
2024-05-07 21:34:18 -07:00 |
|
Krrish Dholakia
|
5a16bec6a1
|
feat(model_dashboard.tsx): allow user to edit input cost per token for model on ui
also contains fixes for `/model/update`
|
2024-05-07 20:57:21 -07:00 |
|
Krrish Dholakia
|
312249ca44
|
feat(ui/model_dashboard.tsx): show if model is config or db model
|
2024-05-07 18:29:14 -07:00 |
|
Krish Dholakia
|
2aaaa5e1b4
|
Merge pull request #3506 from BerriAI/litellm_reintegrate_langfuse_url_slack_alert
feat(slack_alerting.py): reintegrate langfuse trace url for slack alerts
|
2024-05-07 15:03:29 -07:00 |
|
Krrish Dholakia
|
f210318bf1
|
fix(proxy_server.py): return budget duration in user response object
|
2024-05-07 13:47:32 -07:00 |
|
Krrish Dholakia
|
f2766fddbf
|
fix(proxy_server.py): fix /v1/models bug where it would return empty list
handle 'all-team-models' being set for a given key
|
2024-05-07 13:43:15 -07:00 |
|
Krrish Dholakia
|
872470ff1f
|
feat(slack_alerting.py): reintegrate langfuse trace url for slack alerts
this ensures langfuse trace url returned in llm api exception err
|
2024-05-07 12:58:49 -07:00 |
|