Commit graph

143 commits

Author SHA1 Message Date
Krish Dholakia
e4493248ae
Litellm dev 12 06 2024 (#7067)
* fix(edit_budget_modal.tsx): call `/budget/update` endpoint instead of `/budget/new`

allows updating existing budget on ui

* fix(user_api_key_auth.py): support cost tracking for end user via jwt field

* fix(presidio.py): support pii masking on sync logging callbacks

enables masking before logging to langfuse

* feat(utils.py): support retry policy logic inside '.completion()'

Fixes https://github.com/BerriAI/litellm/issues/6623

* fix(utils.py): support retry by retry policy on async logic as well

* fix(handle_jwt.py): set leeway default leeway value

* test: fix test to handle jwt audience claim
2024-12-06 22:44:18 -08:00
Krish Dholakia
424b8b0231
Litellm dev 11 23 2024 (#6881)
* build(ui/create_key_button.tsx): support adding tags for cost tracking/routing when making key

* LiteLLM Minor Fixes & Improvements (11/23/2024)  (#6870)

* feat(pass_through_endpoints/): support logging anthropic/gemini pass through calls to langfuse/s3/etc.

* fix(utils.py): allow disabling end user cost tracking with new param

Allows proxy admin to disable cost tracking for end user - keeps prometheus metrics small

* docs(configs.md): add disable_end_user_cost_tracking reference to docs

* feat(key_management_endpoints.py): add support for restricting access to `/key/generate` by team/proxy level role

Enables admin to restrict key creation, and assign team admins to handle distributing keys

* test(test_key_management.py): add unit testing for personal / team key restriction checks

* docs: add docs on restricting key creation

* docs(finetuned_models.md): add new guide on calling finetuned models

* docs(input.md): cleanup anthropic supported params

Closes https://github.com/BerriAI/litellm/issues/6856

* test(test_embedding.py): add test for passing extra headers via embedding

* feat(cohere/embed): pass client to async embedding

* feat(rerank.py): add `/v1/rerank` if missing for cohere base url

Closes https://github.com/BerriAI/litellm/issues/6844

* fix(main.py): pass extra_headers param to openai

Fixes https://github.com/BerriAI/litellm/issues/6836

* fix(litellm_logging.py): don't disable global callbacks when dynamic callbacks are set

Fixes issue where global callbacks - e.g. prometheus were overriden when langfuse was set dynamically

* fix(handler.py): fix linting error

* fix: fix typing

* build: add conftest to proxy_admin_ui_tests/

* test: fix test

* fix: fix linting errors

* test: fix test

* fix: fix pass through testing

* feat(key_management_endpoints.py): allow proxy_admin to enforce params on key creation

allows admin to force team keys to have tags

* build(ui/): show teams in leftnav + allow team admin to add new members

* build(ui/): show created tags in dropdown

makes it easier for admin to add tags to keys

* test(test_key_management.py): fix test

* test: fix test

* fix playwright e2e ui test

* fix e2e ui testing deps

* fix: fix linting errors

* fix e2e ui testing

* fix e2e ui testing, only run e2e ui testing in playwright

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2024-11-23 22:37:16 +05:30
Ishaan Jaff
fb9fb3467d
(UI) Delete Internal Users on Admin UI (#6442)
* add /user/delete call

* ui show modal asking if you want to delete user

* fix delete user modal
2024-10-26 11:41:37 +04:00
Ishaan Jaff
47d36e3c79
ui networking list all teams (#5851) 2024-09-23 13:16:18 -07:00
Ishaan Jaff
d100b32573
[SSO-UI] Set new sso users as internal_view role users (#5824)
* use /user/list endpoint on admin ui

* sso insert user with role when user does not exist

* add sso sign in test

* linting fix

* rename self serve doc

* add doc for self serve flow

* test - sso sign in default values

* add test for /user/list endpoint
2024-09-21 16:43:52 -07:00
Ishaan Jaff
a6100d7ea9
ui fix correct team not loading (#5804)
* ui fix correct team not loading

* ui fix
2024-09-20 08:08:56 -07:00
Ishaan Jaff
e6018a464f
[ Proxy - User Management]: If user assigned to a team don't show Default Team (#5791)
* rename endpoint to ui_settings

* ui allow DEFAULT_TEAM_DISABLED

* fix logic

* docs Set `default_team_disabled: true` on your litellm config.yaml
2024-09-19 17:13:58 -07:00
Ishaan Jaff
5d9f2e7115 working regen flow 2024-09-06 14:10:02 -07:00
Ishaan Jaff
40c018272c working regenerate key flow 2024-08-26 18:28:26 -07:00
Krrish Dholakia
6fc6df134f feat(ui): for adding pass-through endpoints 2024-08-15 21:58:11 -07:00
Ishaan Jaff
d85762b32f ui - handle session expired on ui 2024-08-13 17:09:56 -07:00
Krrish Dholakia
e67a239520 fix(teams.tsx): reduce network calls to /team/info 2024-08-10 15:24:23 -07:00
Krrish Dholakia
1080c7014e build(ui): allow admin_viewer to view teams tab
Allows admin viewe role to see available teams on proxy ui
2024-08-02 16:19:40 -07:00
Ishaan Jaff
896026c468 switch off prod logs on ui 2024-07-30 13:23:45 -07:00
Ishaan Jaff
7f847f194d swithc off console log in prod 2024-07-30 13:02:55 -07:00
Ishaan Jaff
6f34998cab ui new build 2024-07-29 21:20:27 -07:00
Ishaan Jaff
d71dc1acaf ui use setGlobalLitellmHeaderName 2024-07-29 16:58:56 -07:00
Ishaan Jaff
548adea8cf add litellm_header_name endpoint 2024-07-26 21:04:31 -07:00
Ishaan Jaff
90824e2d21 ui new build 2024-07-19 11:00:13 -07:00
Ishaan Jaff
210043ff9e ui - only show 1 message when session expires + redirect 2024-07-19 10:47:53 -07:00
Ishaan Jaff
f3dddd234d ui - get, set, delete allowed ip addresses 2024-07-09 15:43:44 -07:00
Ishaan Jaff
19baac7a36 fix don't spam model hub when model list is not defined 2024-07-06 10:39:16 -07:00
Ishaan Jaff
5d0bb0b9ae fix - don't spam users when model list not defined 2024-07-06 10:36:14 -07:00
Ishaan Jaff
fd43ddfa0e ui fix - load litellm model list 2024-07-06 10:12:14 -07:00
Ishaan Jaff
829ac3a0d0 ui - add new cache hits page 2024-06-21 13:10:40 -07:00
Ishaan Jaff
8579030393 fix modelCostMap on ui 2024-06-12 19:57:52 -07:00
Ishaan Jaff
18b28a1631 fix - don't raise error when logout url does not load 2024-06-12 19:30:37 -07:00
Ishaan Jaff
fad063df6e ui -set custom base url and logout url 2024-06-07 19:00:09 -07:00
Krrish Dholakia
e78cf92610 feat(create_user_button.tsx): allow admin to invite user to proxy via invite-links
makes it easier for proxy admin to debug what different roles can/can't do
2024-06-05 15:55:39 -07:00
Ishaan Jaff
9e6256b688 ui - filter analytics by customer 2024-06-03 20:41:31 -07:00
Ishaan Jaff
7a1610327f ui - view all end-users on admin ui 2024-06-03 20:26:09 -07:00
Ishaan Jaff
b980bd9367 ui - update model metrics by api key / service 2024-06-03 19:48:01 -07:00
Ishaan Jaff
67312204d7 feat - clea up usage tab 2024-06-03 15:42:37 -07:00
Ishaan Jaff
991d418984 ui - working filter by tag 2024-06-03 14:15:51 -07:00
Ishaan Jaff
92d8e62072 ui - new build 2024-05-31 16:20:45 -07:00
Ishaan Jaff
f9862be049
Merge branch 'main' into litellm_invite_link_flow_2 2024-05-31 08:14:52 -07:00
Ishaan Jaff
1f41fda21d fix -show num rate limit errors 2024-05-30 20:50:52 -07:00
Ishaan Jaff
14a5df71d1 fix adminGlobalActivityExceptions 2024-05-30 18:08:20 -07:00
Ishaan Jaff
b10006876d fix - edit user role on admin ui 2024-05-30 16:11:58 -07:00
Krrish Dholakia
293d5cf1f2 feat: e2e flow complete - admin can invite new users to proxy via invite links
Completes https://github.com/BerriAI/litellm/issues/3863
2024-05-27 23:19:30 -07:00
Krrish Dholakia
4516daec90 feat(model_hub.tsx): enable admin to expose a public model hub 2024-05-27 17:45:45 -07:00
Krrish Dholakia
f69f372135 feat(model_hub/page.tsx): public model hub page for users
allow admin to expose a public model hub page for users to see available models w/ params
2024-05-27 14:28:05 -07:00
Ishaan Jaff
5b46726f7d working model hub 2024-05-26 14:43:34 -07:00
Ishaan Jaff
58c8d4ba71 v0 model hub 2024-05-26 14:01:32 -07:00
Krrish Dholakia
a9a1447513 feat(ui): allow admin to configure slack alerting thresholds on ui 2024-05-25 21:01:19 -07:00
Ishaan Jaff
9035d4d6af ui - show global activity 2024-05-25 12:22:10 -07:00
Ishaan Jaff
93024ccff3 ui - show api requests, num tokens 2024-05-25 10:37:28 -07:00
Ishaan Jaff
443d88b744 feat - ui view spend per provider 2024-05-25 09:29:54 -07:00
Krrish Dholakia
f04e4b921b feat(ui/model_dashboard.tsx): add databricks models via admin ui 2024-05-23 20:28:54 -07:00
Krish Dholakia
3400596dd2
Merge pull request #3787 from BerriAI/litellm_set_budgets_ui_2
feat(proxy_server.py): enable admin to set tpm/rpm limits for end-users via UI
2024-05-22 18:22:51 -07:00