Commit graph

1676 commits

Author SHA1 Message Date
Krish Dholakia
f6a262122b
Merge pull request #4054 from BerriAI/litellm_aws_kms_support
feat(aws_secret_manager.py): Support AWS KMS for Master Key encrption
2024-06-07 08:49:25 -07:00
Ishaan Jaff
78a6604295 fix open_telemetry_logger 2024-06-06 22:30:49 -07:00
Ishaan Jaff
b734cca43e fix service logger for OTEL 2024-06-06 22:12:45 -07:00
Ishaan Jaff
b551462518 feat -v0 parent_otel_span in basic db reads 2024-06-06 19:49:18 -07:00
Krrish Dholakia
a2da2a8f16 feat(aws_secret_manager.py): allows user to keep a hash of the proxy master key in their env 2024-06-06 15:32:51 -07:00
Krrish Dholakia
7ddca8d834 fix(proxy_server.py): fix backoff attempt logging
make sure backoff uses our logging handler to log info to
2024-06-06 14:08:31 -07:00
Krrish Dholakia
6cca5612d2 refactor: replace 'traceback.print_exc()' with logging library
allows error logs to be in json format for otel logging
2024-06-06 13:47:43 -07:00
Ishaan Jaff
aaf35c7966 feat - enforce enforced_params as a premium feature 2024-06-06 09:03:31 -07:00
Ishaan Jaff
8e8509d848
Merge pull request #4030 from BerriAI/litellm_audit_logs_premium
[Feat] Audit Logs for Key, User, ProxyModel CRUD operations
2024-06-05 19:36:35 -07:00
Ishaan Jaff
9d5ac193af feat - add audit logs for key create, update delete 2024-06-05 18:59:34 -07:00
Ishaan Jaff
7e89b242ba fix /team/new 2024-06-05 18:34:20 -07:00
Ishaan Jaff
5bd658493f feat - working audit logs for create, update delete team 2024-06-05 17:50:27 -07:00
Krish Dholakia
ff7291abba
Merge pull request #4028 from BerriAI/litellm_user_invite_links
feat(create_user_button.tsx): allow admin to invite user to proxy via user-email/pwd invite-links
2024-06-05 16:32:24 -07:00
Ishaan Jaff
27d652ac78 feat - audit logs 2024-06-05 16:16:27 -07:00
Krrish Dholakia
7bef67c486 fix(proxy_server.py): allow internal_user with permissions to create/view/delete their own keys 2024-06-05 16:10:37 -07:00
Krrish Dholakia
e78cf92610 feat(create_user_button.tsx): allow admin to invite user to proxy via invite-links
makes it easier for proxy admin to debug what different roles can/can't do
2024-06-05 15:55:39 -07:00
Ishaan Jaff
de623df7da
Merge pull request #4021 from BerriAI/litellm_fix_div_byzero
[Admin UI] Analytics - fix div by 0 error on /model/metrics
2024-06-05 13:22:10 -07:00
Ishaan Jaff
19ac01a0d7 fix - only log cache credentials in debug mode 2024-06-05 09:58:45 -07:00
Ishaan Jaff
32b664c009 ui - fix div by 0 error on /model/metrics 2024-06-05 08:51:54 -07:00
Ishaan Jaff
edb34a5439
Merge pull request #4016 from BerriAI/litellm_fix_internal_user_login
[Fix] Admin UI Internal Users
2024-06-04 21:34:38 -07:00
Ishaan Jaff
d7c6e019b8 fix- proxy - handle case when unknown role 2024-06-04 21:13:04 -07:00
Krish Dholakia
2d9a251147
Merge pull request #4012 from BerriAI/litellm_assistants_streaming
feat(assistants/main.py): add assistants api streaming support
2024-06-04 20:58:02 -07:00
Ishaan Jaff
0773596235 fix - improve logic for all_available_callbacks 2024-06-04 18:08:27 -07:00
Krrish Dholakia
fb12bc70c4 docs(assistants.md): update assistants doc with azure tutorial 2024-06-04 16:53:07 -07:00
Krrish Dholakia
f3d78532f9 feat(assistants/main.py): add assistants api streaming support 2024-06-04 16:30:35 -07:00
Ishaan Jaff
e96d2e3b1b fix otel logging fixes 2024-06-04 08:53:33 -07:00
Ishaan Jaff
c1bac5e89d feat - use inlcusive analytics on proxy 2024-06-03 20:49:21 -07:00
Ishaan Jaff
016b8294b0 feat - filter analytics by customer 2024-06-03 20:42:17 -07:00
Ishaan Jaff
f7f1ce9345 feat - get all unique end_users 2024-06-03 20:19:12 -07:00
Ishaan Jaff
17d421fc70 feat - backend changes for filtering by api key 2024-06-03 19:30:12 -07:00
Ishaan Jaff
73cc3067cd feat - filter model metrics by api key 2024-06-03 18:53:01 -07:00
Ishaan Jaff
45cb899687 fix - working filter by tag query 2024-06-03 15:12:09 -07:00
Ishaan Jaff
2ac8f1c6ec get all tags on ui 2024-06-03 14:21:35 -07:00
Ishaan Jaff
3d98a462ae feat - return all tag names 2024-06-03 14:02:03 -07:00
Krrish Dholakia
64ad3f8137 feat(proxy_server.py): log litellm api version on llm api calls
Closes https://github.com/BerriAI/litellm/issues/3673
2024-06-01 19:49:57 -07:00
Krrish Dholakia
7715267989 fix(router.py): simplify scheduler
move the scheduler poll queuing logic into the router class, making it easier to use
2024-06-01 16:09:57 -07:00
Krrish Dholakia
f75c15d6cd fix(proxy_server.py): security fix - fix sql injection attack on global spend logs 2024-06-01 14:16:41 -07:00
Krrish Dholakia
a0fb301b18 docs(assistants.md): add assistants api to docs 2024-06-01 10:30:07 -07:00
Krish Dholakia
8375e9621c
Merge pull request #3954 from BerriAI/litellm_simple_request_prioritization
feat(scheduler.py): add request prioritization scheduler
2024-05-31 23:29:09 -07:00
Krrish Dholakia
be0d473bb3 docs(proxy_server.py): add link to customize swagger docs on base url 2024-05-31 22:06:25 -07:00
Krrish Dholakia
f3c37f487a fix(proxy_server.py): fix naming conflict 2024-05-31 19:41:53 -07:00
Krrish Dholakia
f8d4be710e docs(scheduler.md): add request prioritization to docs 2024-05-31 19:35:47 -07:00
Krrish Dholakia
79287a7584 feat(scheduler.py): add request prioritization scheduler
allow user to set priority for a request
2024-05-31 18:51:13 -07:00
Ishaan Jaff
ffa16a2f6a fix include request_typ in key_generate requests 2024-05-31 18:46:59 -07:00
Krish Dholakia
08bae3185a
Merge pull request #3936 from BerriAI/litellm_assistants_api_proxy
feat(proxy_server.py): add assistants api endpoints to proxy server
2024-05-31 18:43:22 -07:00
Ishaan Jaff
78c31face5
Merge pull request #3953 from BerriAI/litellm_ui_allow_users_to_sign_in_with_links
UI  - allow users to sign in with with email/password
2024-05-31 18:36:30 -07:00
Ishaan Jaff
6623c1e017
Merge branch 'main' into litellm_ui_invite_for_spend_viewer 2024-05-31 18:36:07 -07:00
Ishaan Jaff
9243be6042 feat - allow sign in with user email and password 2024-05-31 18:34:01 -07:00
Ishaan Jaff
5539833a56 fix clean up flow for adding ui spend viewers 2024-05-31 17:57:50 -07:00
Ishaan Jaff
e17db30b67 fix - allow proxy_Admin_viewer /global/activity 2024-05-31 17:45:37 -07:00