Commit graph

1830 commits

Author SHA1 Message Date
Ishaan Jaff
522da0c4f8 feat - refactor /chat/completions to have a common helper 2024-06-07 12:18:53 -07:00
Ishaan Jaff
4828e2426f fix importing Span 2024-06-07 09:55:59 -07:00
Ishaan Jaff
74bf9e9972 fix - include litellm_parent_otel_span 2024-06-07 09:25:07 -07:00
Ishaan Jaff
0e7cda8c73 Merge pull request #4043 from BerriAI/litellm_enforce_params
[Feat] Enterprise - Enforce Params in request to LiteLLM Proxy
2024-06-07 08:52:46 -07:00
Krish Dholakia
2c70e55f77 Merge pull request #4054 from BerriAI/litellm_aws_kms_support
feat(aws_secret_manager.py): Support AWS KMS for Master Key encrption
2024-06-07 08:49:25 -07:00
Ishaan Jaff
f48d8fd6ae fix open_telemetry_logger 2024-06-06 22:30:49 -07:00
Ishaan Jaff
312521a0b3 fix service logger for OTEL 2024-06-06 22:12:45 -07:00
Ishaan Jaff
cb5ebba6fa feat -v0 parent_otel_span in basic db reads 2024-06-06 19:49:18 -07:00
Krrish Dholakia
a2ca3887d1 feat(aws_secret_manager.py): allows user to keep a hash of the proxy master key in their env 2024-06-06 15:32:51 -07:00
Krrish Dholakia
bb63046d8c fix(proxy_server.py): fix backoff attempt logging
make sure backoff uses our logging handler to log info to
2024-06-06 14:08:31 -07:00
Krrish Dholakia
e391e30285 refactor: replace 'traceback.print_exc()' with logging library
allows error logs to be in json format for otel logging
2024-06-06 13:47:43 -07:00
Ishaan Jaff
c88ba31fa0 feat - enforce enforced_params as a premium feature 2024-06-06 09:03:31 -07:00
Ishaan Jaff
9311c34977 Merge pull request #4030 from BerriAI/litellm_audit_logs_premium
[Feat] Audit Logs for Key, User, ProxyModel CRUD operations
2024-06-05 19:36:35 -07:00
Ishaan Jaff
eef70e6d02 feat - add audit logs for key create, update delete 2024-06-05 18:59:34 -07:00
Ishaan Jaff
70dd073dea fix /team/new 2024-06-05 18:34:20 -07:00
Ishaan Jaff
ed14b02b07 feat - working audit logs for create, update delete team 2024-06-05 17:50:27 -07:00
Krish Dholakia
ef6924f917 Merge pull request #4028 from BerriAI/litellm_user_invite_links
feat(create_user_button.tsx): allow admin to invite user to proxy via user-email/pwd invite-links
2024-06-05 16:32:24 -07:00
Ishaan Jaff
78e1f1659b feat - audit logs 2024-06-05 16:16:27 -07:00
Krrish Dholakia
312bfd637a fix(proxy_server.py): allow internal_user with permissions to create/view/delete their own keys 2024-06-05 16:10:37 -07:00
Krrish Dholakia
eb1f244b90 feat(create_user_button.tsx): allow admin to invite user to proxy via invite-links
makes it easier for proxy admin to debug what different roles can/can't do
2024-06-05 15:55:39 -07:00
Ishaan Jaff
327f18d1d3 Merge pull request #4021 from BerriAI/litellm_fix_div_byzero
[Admin UI] Analytics - fix div by 0 error on /model/metrics
2024-06-05 13:22:10 -07:00
Ishaan Jaff
1de3026dcd fix - only log cache credentials in debug mode 2024-06-05 09:58:45 -07:00
Ishaan Jaff
3a5ec5280e ui - fix div by 0 error on /model/metrics 2024-06-05 08:51:54 -07:00
Ishaan Jaff
790ff5f42f Merge pull request #4016 from BerriAI/litellm_fix_internal_user_login
[Fix] Admin UI Internal Users
2024-06-04 21:34:38 -07:00
Ishaan Jaff
6db0c55ace fix- proxy - handle case when unknown role 2024-06-04 21:13:04 -07:00
Krish Dholakia
7127e6bcd8 Merge pull request #4012 from BerriAI/litellm_assistants_streaming
feat(assistants/main.py): add assistants api streaming support
2024-06-04 20:58:02 -07:00
Ishaan Jaff
d222071fb1 fix - improve logic for all_available_callbacks 2024-06-04 18:08:27 -07:00
Krrish Dholakia
33532716ff docs(assistants.md): update assistants doc with azure tutorial 2024-06-04 16:53:07 -07:00
Krrish Dholakia
20cb525a5c feat(assistants/main.py): add assistants api streaming support 2024-06-04 16:30:35 -07:00
Ishaan Jaff
8c5795cba9 fix otel logging fixes 2024-06-04 08:53:33 -07:00
Ishaan Jaff
c3786a9545 feat - use inlcusive analytics on proxy 2024-06-03 20:49:21 -07:00
Ishaan Jaff
ddc8b158ef feat - filter analytics by customer 2024-06-03 20:42:17 -07:00
Ishaan Jaff
c39c744970 feat - get all unique end_users 2024-06-03 20:19:12 -07:00
Ishaan Jaff
f97f0b0462 feat - backend changes for filtering by api key 2024-06-03 19:30:12 -07:00
Ishaan Jaff
89a24da78e feat - filter model metrics by api key 2024-06-03 18:53:01 -07:00
Ishaan Jaff
74c8522067 fix - working filter by tag query 2024-06-03 15:12:09 -07:00
Ishaan Jaff
8336a6dcdc get all tags on ui 2024-06-03 14:21:35 -07:00
Ishaan Jaff
add8761a96 feat - return all tag names 2024-06-03 14:02:03 -07:00
Krrish Dholakia
d0c94edc50 feat(proxy_server.py): log litellm api version on llm api calls
Closes https://github.com/BerriAI/litellm/issues/3673
2024-06-01 19:49:57 -07:00
Krrish Dholakia
4ffbd80584 fix(router.py): simplify scheduler
move the scheduler poll queuing logic into the router class, making it easier to use
2024-06-01 16:09:57 -07:00
Krrish Dholakia
75385d13bf fix(proxy_server.py): security fix - fix sql injection attack on global spend logs 2024-06-01 14:16:41 -07:00
Krrish Dholakia
de62c5f565 docs(assistants.md): add assistants api to docs 2024-06-01 10:30:07 -07:00
Krish Dholakia
1529f665cc Merge pull request #3954 from BerriAI/litellm_simple_request_prioritization
feat(scheduler.py): add request prioritization scheduler
2024-05-31 23:29:09 -07:00
Krrish Dholakia
9ec585dfaf docs(proxy_server.py): add link to customize swagger docs on base url 2024-05-31 22:06:25 -07:00
Krrish Dholakia
7814ebd727 fix(proxy_server.py): fix naming conflict 2024-05-31 19:41:53 -07:00
Krrish Dholakia
27c2753aaf docs(scheduler.md): add request prioritization to docs 2024-05-31 19:35:47 -07:00
Krrish Dholakia
8ff137bce3 feat(scheduler.py): add request prioritization scheduler
allow user to set priority for a request
2024-05-31 18:51:13 -07:00
Ishaan Jaff
9a8fe64ab2 fix include request_typ in key_generate requests 2024-05-31 18:46:59 -07:00
Krish Dholakia
c049b6b4af Merge pull request #3936 from BerriAI/litellm_assistants_api_proxy
feat(proxy_server.py): add assistants api endpoints to proxy server
2024-05-31 18:43:22 -07:00
Ishaan Jaff
6b3be7a194 Merge pull request #3953 from BerriAI/litellm_ui_allow_users_to_sign_in_with_links
UI  - allow users to sign in with with email/password
2024-05-31 18:36:30 -07:00