Commit graph

50 commits

Author SHA1 Message Date
Ishaan Jaff
8325de8bf0 don't show test key page to internal user 2025-03-11 11:07:42 -07:00
Krish Dholakia
9fc7bd0493 UI - new API Playground for testing LiteLLM translation (#9073)
* feat: initial commit - enable dev to see translated request

* feat(utils.py): expose new endpoint - `/utils/transform_request` to see the raw request sent by litellm

* feat(transform_request.tsx): allow user to see their transformed request

* refactor(litellm_logging.py): return raw request in 3 parts - api_base, headers, request body

easier to render each individually on UI vs. extracting from combined string

* feat: transform_request.tsx

working e2e raw request viewing

* fix(litellm_logging.py): fix transform viewing for bedrock models

* fix(litellm_logging.py): don't return sensitive headers in raw request headers

prevent accidental leak

* feat(transform_request.tsx): style improvements
2025-03-07 19:39:31 -08:00
Ishaan Jaff
7c8e37fc84 (UI) - Allow Internal Users to View their own logs (#8933)
* ui fix leftnav, allow internal users to view their own logs

* pass user_id in uiSpendLogs call

* ui filter logs for internal user

* fix internal users page

* ui show correct message when store prompts is disabled

* fix internal user logs

* test_ui_view_spend_logs_with_user_id

* test spend management endpoint
2025-03-01 17:26:02 -08:00
Taha Ali
b70981b8fb Add UI Support for Admins to Call /cache/ping and View Cache Analytics (#8475) (#8519)
* [Bug] UI: Newly created key does not display on the View Key Page (#8039)

- Fixed issue where all keys appeared blank for admin users.
- Implemented filtering of data via team settings to ensure all keys are displayed correctly.

* Fix:
- Updated the validator to allow model editing when `keyTeam.team_alias === "Default Team"`.
- Ensured other teams still follow the original validation rules.

* - added some classes in global.css
- added text wrap in output of request,response and metadata in index.tsx
- fixed styles of table in table.tsx

* - added full payload when we open single log entry
- added Combined Info Card in index.tsx

* fix: keys not showing on refresh for internal user

* merge

* main merge

* cache page

* ca remove

* terms change

* fix:places caching inside exp
2025-02-13 15:01:16 -08:00
Krrish Dholakia
92edd85fc8 feat(guardrails.tsx): show configured guardrails on proxy ui
'
2025-02-10 22:13:58 -08:00
Krrish Dholakia
444d7f4ed1 feat(leftnav.tsx): initial commit adding guardrails tab on UI
allow proxy admin to see currently set up guardrails
2025-02-10 22:13:54 -08:00
Ishaan Jaff
dfd5407c0d rename ui tab to ExperimentOutlined 2025-01-17 19:22:32 -08:00
Ishaan Jaff
16673ab488 (UI - View SpendLogs Table) (#7842)
* litellm log messages / responses

* add messages/response to schema.prisma

* add support for logging messages / responses in DB

* test_spend_logs_payload_with_prompts_enabled

* _get_messages_for_spend_logs_payload

* ui_view_spend_logs endpoint

* add tanstack and moment

* add uiSpendLogsCall

* ui view logs table

* ui view spendLogs table

* ui_view_spend_logs

* fix code quality

* test_spend_logs_payload_with_prompts_enabled

* _get_messages_for_spend_logs_payload

* test_spend_logs_payload_with_prompts_enabled

* test_spend_logs_payload_with_prompts_enabled

* ui view spend logs

* minor ui fix

* ui - update leftnav

* ui - clean up ui

* fix leftnav

* ui fix navbar

* ui fix moving chat ui tab
2025-01-17 18:53:45 -08:00
Krish Dholakia
b77832a793 Litellm dev 01 08 2025 p1 (#7640)
* feat(ui_sso.py): support reading team ids from sso token

* feat(ui_sso.py): working upsert sso user teams membership in litellm - if team exists

Adds user to relevant teams, if user is part of teams and team exists on litellm

* fix(ui_sso.py): safely handle add team member task

* build(ui/): support setting team id when creating team on UI

* build(ui/): teams.tsx

allow setting team id on ui

* build(circle_ci/requirements.txt): add fastapi-sso to ci/cd testing

* fix: fix linting errors
2025-01-08 22:08:20 -08:00
Krish Dholakia
ebe113810b Create and view organizations + assign org admins on the Proxy UI (#7557)
* feat: initial commit for new 'organizations' tab on ui

* build(ui/): create generic card for rendering complete org data table

can be reused in teams as well

simplifies things

* build(ui/): display created orgs on ui

* build(ui/): support adding orgs via UI

* build(ui/): add org in selection dropdown

* build(organizations.tsx): allow assigning org admins

* build(ui/): show org members on ui

* build(ui/): cleanup + show actual models on org dropdown

* build(ui/): explain user roles within organization
2025-01-04 17:31:24 -08:00
Ishaan Jaff
f6074c9af0 (UI fix) UI does not reload when you login / open a new tab (#6909)
* store current page on url

* update menu history
2024-11-25 22:41:45 -08:00
Krish Dholakia
c9318e08ad Litellm dev 11 23 2024 (#6881)
* build(ui/create_key_button.tsx): support adding tags for cost tracking/routing when making key

* LiteLLM Minor Fixes & Improvements (11/23/2024)  (#6870)

* feat(pass_through_endpoints/): support logging anthropic/gemini pass through calls to langfuse/s3/etc.

* fix(utils.py): allow disabling end user cost tracking with new param

Allows proxy admin to disable cost tracking for end user - keeps prometheus metrics small

* docs(configs.md): add disable_end_user_cost_tracking reference to docs

* feat(key_management_endpoints.py): add support for restricting access to `/key/generate` by team/proxy level role

Enables admin to restrict key creation, and assign team admins to handle distributing keys

* test(test_key_management.py): add unit testing for personal / team key restriction checks

* docs: add docs on restricting key creation

* docs(finetuned_models.md): add new guide on calling finetuned models

* docs(input.md): cleanup anthropic supported params

Closes https://github.com/BerriAI/litellm/issues/6856

* test(test_embedding.py): add test for passing extra headers via embedding

* feat(cohere/embed): pass client to async embedding

* feat(rerank.py): add `/v1/rerank` if missing for cohere base url

Closes https://github.com/BerriAI/litellm/issues/6844

* fix(main.py): pass extra_headers param to openai

Fixes https://github.com/BerriAI/litellm/issues/6836

* fix(litellm_logging.py): don't disable global callbacks when dynamic callbacks are set

Fixes issue where global callbacks - e.g. prometheus were overriden when langfuse was set dynamically

* fix(handler.py): fix linting error

* fix: fix typing

* build: add conftest to proxy_admin_ui_tests/

* test: fix test

* fix: fix linting errors

* test: fix test

* fix: fix pass through testing

* feat(key_management_endpoints.py): allow proxy_admin to enforce params on key creation

allows admin to force team keys to have tags

* build(ui/): show teams in leftnav + allow team admin to add new members

* build(ui/): show created tags in dropdown

makes it easier for admin to add tags to keys

* test(test_key_management.py): fix test

* test: fix test

* fix playwright e2e ui test

* fix e2e ui testing deps

* fix: fix linting errors

* fix e2e ui testing

* fix e2e ui testing, only run e2e ui testing in playwright

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2024-11-23 22:37:16 +05:30
Ishaan Jaff
5ef2d55c99 (Admin UI) - Remain on Current Tab when user clicks refresh (#6777)
* UI - fix, remain on current tab after refresh

* leftnav - remain on current tab after refresh
2024-11-16 19:55:41 -08:00
Ishaan Jaff
2b91a79c7a fix allow internal user and internal viewer to view usage 2024-09-05 10:16:25 -07:00
Krrish Dholakia
1c2decbfdd feat(ui): for adding pass-through endpoints 2024-08-15 21:58:11 -07:00
Krrish Dholakia
cbad9e7502 build(ui): allow admin_viewer to view teams tab
Allows admin viewe role to see available teams on proxy ui
2024-08-02 16:19:40 -07:00
Ishaan Jaff
a331a8bb1f ui - rename api_key -> virtual key 2024-07-19 15:49:12 -07:00
Ishaan Jaff
fe63d38453 ui - allow admin viewer to view caching 2024-07-16 17:16:49 -07:00
Ishaan Jaff
144b9d10b1 fix text hierarhcy 2024-07-09 16:04:03 -07:00
Ishaan Jaff
c1c2b7fede move caching up on left nav 2024-06-21 14:28:15 -07:00
Ishaan Jaff
1a22ee9152 ui - add new cache hits page 2024-06-21 13:10:40 -07:00
Ishaan Jaff
95d1fd3a08 only show proxy admin viewer uage panel 2024-05-31 17:42:37 -07:00
Ishaan Jaff
8e44182717 Merge pull request #3904 from BerriAI/litellm_ui_edit_users
[Admin UI] Edit `Internal Users`
2024-05-29 17:49:36 -07:00
Krrish Dholakia
d6d61f2fdb docs(customers.md): tutorial for setting customer budgets on proxy 2024-05-29 17:46:47 -07:00
Ishaan Jaff
49f4ff03a0 ui - edit user flow 2024-05-29 15:50:51 -07:00
Ishaan Jaff
5d444acbc8 v0 model hub 2024-05-26 14:01:32 -07:00
Krrish Dholakia
5c0cb8c326 feat(proxy_server.py): enable admin to create/delete budgets for end-users 2024-05-22 16:20:06 -07:00
Krrish Dholakia
50f5241a4e build(add-fallbacks-on-UI): allows admin to add fallbacks on the UI 2024-04-24 15:40:02 -07:00
Ishaan Jaff
9d4fbad352 ui - clean up order 2024-04-22 13:44:37 -07:00
Ishaan Jaff
f849f73eac ui - clean up chat ui 2024-04-20 19:04:01 -07:00
Ishaan Jaff
9914662861 ui - show team name on the top 2024-04-20 19:00:38 -07:00
Ishaan Jaff
5870be9e03 ui - non admin flow 2024-04-19 16:45:13 -07:00
Ishaan Jaff
eb0eb71851 ui - view router settings on admin ui 2024-04-16 14:47:28 -07:00
Ishaan Jaff
9d9133d5d9 ui - add slack alerting 2024-04-08 20:10:50 -07:00
Krrish Dholakia
fa98df1849 build(ui): ui cleanup 2024-04-08 18:09:53 -07:00
Ishaan Jaff
85013f7e86 v0 - add a set callbacks page 2024-04-08 14:22:26 -07:00
Ishaan Jaff
e43712c73b (ui) improvements 2024-03-29 11:51:23 -07:00
Ishaan Jaff
a14c262b0f (fix) leftnav 2024-03-29 10:17:14 -07:00
Ishaan Jaff
9ca0be9732 (fix) left nav 2024-03-29 09:57:57 -07:00
Krrish Dholakia
1af40ef3b4 fix: stability fixes for ui 2024-02-29 12:50:27 -08:00
Krrish Dholakia
486079a2a0 build(ui): fix admin viewer issue 2024-02-29 09:56:26 -08:00
Krrish Dholakia
a785f65c4f fix([WIP]): allow proxy admin to add users to view global spend 2024-02-27 18:32:06 -08:00
Krrish Dholakia
22a6ad946e build(ui): enable admin to create teams, add members, create keys for teams 2024-02-24 22:06:00 -08:00
Krrish Dholakia
ef83d793f0 build(ui): add stubbed teams page 2024-02-24 16:14:21 -08:00
Krrish Dholakia
7d7fae7ab3 build(ui): show users the teams they're in 2024-02-24 12:42:01 -08:00
ishaan-jaff
7cc0de46e1 (ui) show user table on admin UI 2024-02-20 15:34:10 -08:00
ishaan-jaff
e55903f75d (ui) commit work 2024-02-13 19:37:43 -08:00
ishaan-jaff
ee9bcf947b v0 chat playground 2024-02-13 18:18:33 -08:00
ishaan-jaff
2c50204b1a (ui) show models page 2024-02-12 15:00:16 -08:00
Krrish Dholakia
ecbcb45d7a feat(proxy_server.py): show admin global spend as time series data 2024-02-09 16:31:35 -08:00