Commit graph

1817 commits

Author SHA1 Message Date
Ishaan Jaff
de0e37ebfb feat - litellm_model_cost_map 2024-06-12 20:03:46 -07:00
Ishaan Jaff
be7340c5a9 fix - sso pass correct role for user 2024-06-12 19:37:58 -07:00
Ishaan Jaff
67938564b4 fix - comment on /user/new 2024-06-12 13:16:39 -07:00
Krrish Dholakia
77328e4a28 fix(parallel_request_limiter.py): use redis cache, if available for rate limiting across instances
Fixes https://github.com/BerriAI/litellm/issues/4148
2024-06-12 10:35:48 -07:00
Ishaan Jaff
206791f166 Merge pull request #4138 from BerriAI/litellm_log_management_endpoint_logs_otel
[FEAT]  log management endpoint logs to otel
2024-06-11 19:00:13 -07:00
Krrish Dholakia
499c4fca9f refactor(proxy_server.py): cleanup sensitive key debug log 2024-06-11 18:45:12 -07:00
Krish Dholakia
30d269f93a Merge pull request #4139 from BerriAI/litellm_fix_budget_exceeded_error_code
fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
2024-06-11 18:36:58 -07:00
Ishaan Jaff
8c63e6e493 fix linting error 2024-06-11 18:14:06 -07:00
Ishaan Jaff
f9fd962191 fix team endpoints 2024-06-11 18:10:20 -07:00
Ishaan Jaff
5d5d02156a fix - log mgmt data to OTEL 2024-06-11 18:05:10 -07:00
Ishaan Jaff
5f078edc13 fix http_request 2024-06-11 17:57:50 -07:00
Ishaan Jaff
714b4ee59d fix test new team 2024-06-11 17:48:11 -07:00
Krrish Dholakia
85c9ff6783 fix: more bug fixes 2024-06-11 17:41:59 -07:00
Ishaan Jaff
4859244e67 feat - otel log /team exceptions 2024-06-11 16:27:07 -07:00
Ishaan Jaff
1b73da1b21 fix refactor management endpoint utils 2024-06-11 16:16:10 -07:00
Krrish Dholakia
2a5a30fa7a fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
standardizes error code for budget exceeded errors to status code 400
2024-06-11 16:10:58 -07:00
Ishaan Jaff
9d78e1bd5f feat - log management endpoint logs to otel 2024-06-11 16:09:11 -07:00
Ishaan Jaff
5994ca572c Merge pull request #4133 from BerriAI/litellm_work_with_traceparents
[Feat] OTEL - allow propagating traceparent in headers
2024-06-11 14:27:08 -07:00
Ishaan Jaff
2d5904c9a5 feat - use traceparent to proporgate OTEL traces 2024-06-11 13:57:31 -07:00
Krrish Dholakia
c7da20af3f docs(ui.md): add okta sso support to docs 2024-06-11 13:17:41 -07:00
Krish Dholakia
b2cc37c971 Merge pull request #4084 from BerriAI/litellm_batch_add_team_members
fix(proxy_server.py): allow passing in a list of team members
2024-06-10 20:26:35 -07:00
Krish Dholakia
f3feffc9d4 Merge branch 'main' into litellm_aws_kms_fixes 2024-06-10 20:17:34 -07:00
Krrish Dholakia
bee79f0b70 fix(proxy_cli.py): support passing the database url as an encrypted kms key 2024-06-10 15:48:27 -07:00
Ishaan Jaff
24a5731b52 Merge pull request #4103 from BerriAI/litellm_log_auth_exceptions_to_otel
feat - log Proxy Server auth errors on OTEL
2024-06-10 14:10:02 -07:00
Ishaan Jaff
04e77ca823 feat - viewing spend report per customer / team 2024-06-10 12:58:24 -07:00
Ishaan Jaff
185da8fd61 feat - log exceptions to OTEL 2024-06-10 12:34:18 -07:00
Krrish Dholakia
b0d5b94040 fix(proxy/_types.py): fix validation check 2024-06-08 22:56:56 -07:00
Ishaan Jaff
90f5a801e4 [Feature]: Proxy: Support API-Key 2024-06-08 21:02:47 -07:00
Krrish Dholakia
cdf693a9bf fix(proxy_server.py): allow passing in a list of team members
allows batch adding members to a team by passing in a list. fixes concurrency issue caused by calling team/member_add in parallel
2024-06-08 19:03:45 -07:00
Ishaan Jaff
76488c57fc Merge pull request #4083 from BerriAI/litellm_act_on_behalf
[Feat] Enterprise - Attribute Management changes to Users in Audit Logs
2024-06-08 17:39:16 -07:00
Krrish Dholakia
b26de9b79f fix(proxy_server.py): return updated member list in /team/member_delete 2024-06-08 16:33:07 -07:00
Krrish Dholakia
493f573fc7 fix(proxy_server.py): fix team member delete endpoint
fixes issue in for loop, removing member from team
2024-06-08 16:27:33 -07:00
Ishaan Jaff
4252f2368b feat - support litellm_changed_by 2024-06-08 16:02:18 -07:00
Ishaan Jaff
eafbd7bc98 proxy - return base url and logout url 2024-06-07 19:01:23 -07:00
Ishaan Jaff
80def35a04 Merge pull request #4065 from BerriAI/litellm_use_common_func
[Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`
2024-06-07 14:02:17 -07:00
Ishaan Jaff
860c9b52b6 Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
5df327aca2 fix - refactor proxy server to use common func 2024-06-07 12:38:38 -07:00
Ishaan Jaff
522da0c4f8 feat - refactor /chat/completions to have a common helper 2024-06-07 12:18:53 -07:00
Ishaan Jaff
4828e2426f fix importing Span 2024-06-07 09:55:59 -07:00
Ishaan Jaff
74bf9e9972 fix - include litellm_parent_otel_span 2024-06-07 09:25:07 -07:00
Ishaan Jaff
0e7cda8c73 Merge pull request #4043 from BerriAI/litellm_enforce_params
[Feat] Enterprise - Enforce Params in request to LiteLLM Proxy
2024-06-07 08:52:46 -07:00
Krish Dholakia
2c70e55f77 Merge pull request #4054 from BerriAI/litellm_aws_kms_support
feat(aws_secret_manager.py): Support AWS KMS for Master Key encrption
2024-06-07 08:49:25 -07:00
Ishaan Jaff
f48d8fd6ae fix open_telemetry_logger 2024-06-06 22:30:49 -07:00
Ishaan Jaff
312521a0b3 fix service logger for OTEL 2024-06-06 22:12:45 -07:00
Ishaan Jaff
cb5ebba6fa feat -v0 parent_otel_span in basic db reads 2024-06-06 19:49:18 -07:00
Krrish Dholakia
a2ca3887d1 feat(aws_secret_manager.py): allows user to keep a hash of the proxy master key in their env 2024-06-06 15:32:51 -07:00
Krrish Dholakia
bb63046d8c fix(proxy_server.py): fix backoff attempt logging
make sure backoff uses our logging handler to log info to
2024-06-06 14:08:31 -07:00
Krrish Dholakia
e391e30285 refactor: replace 'traceback.print_exc()' with logging library
allows error logs to be in json format for otel logging
2024-06-06 13:47:43 -07:00
Ishaan Jaff
c88ba31fa0 feat - enforce enforced_params as a premium feature 2024-06-06 09:03:31 -07:00
Ishaan Jaff
9311c34977 Merge pull request #4030 from BerriAI/litellm_audit_logs_premium
[Feat] Audit Logs for Key, User, ProxyModel CRUD operations
2024-06-05 19:36:35 -07:00