Commit graph

2546 commits

Author SHA1 Message Date
Krrish Dholakia
345094a49d fix(utils.py): check if model info is for model with correct provider
Fixes issue where incorrect pricing was used for custom llm provider
2024-06-13 15:54:24 -07:00
Krrish Dholakia
46d57526c4 fix(http_handler.py): add retry logic on httpx.remoteprotocolerror 2024-06-13 14:05:29 -07:00
Ishaan Jaff
ec110976b8 fix config 2024-06-13 11:53:04 -07:00
Ishaan Jaff
eeb0e7d2be fix "/global/spend/report", 2024-06-13 08:51:49 -07:00
Krish Dholakia
05e21441a6
Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Ishaan Jaff
848d29fae7 ui - new build 2024-06-12 20:34:55 -07:00
Ishaan Jaff
8fd162136f feat - litellm_model_cost_map 2024-06-12 20:03:46 -07:00
Ishaan Jaff
2a32817963 ui - new build 2024-06-12 19:47:58 -07:00
Ishaan Jaff
4fc16a6bec
Merge pull request #4164 from BerriAI/litellm_fix_error_inernal_users_sso_saw
[Admin UI] Fix error Internal Users see when using SSO
2024-06-12 19:45:10 -07:00
Ishaan Jaff
8987f16507 fix - sso pass correct role for user 2024-06-12 19:37:58 -07:00
Ishaan Jaff
c510f6bb18 fix - error internal users see on SSO 2024-06-12 17:42:08 -07:00
Krrish Dholakia
3b913443fe feat(vertex_httpx.py): Moving to call vertex ai via httpx (instead of their sdk). Allows us to support all their api updates. 2024-06-12 16:47:00 -07:00
Ishaan Jaff
cb386fda20 test - making mistral embedding request on proxy 2024-06-12 15:10:20 -07:00
Ishaan Jaff
7eeef7ec1f feat - add mistral embedding config 2024-06-12 15:00:00 -07:00
Ishaan Jaff
d380697723 fix - comment on /user/new 2024-06-12 13:16:39 -07:00
Krrish Dholakia
76c9b715f2 fix(parallel_request_limiter.py): use redis cache, if available for rate limiting across instances
Fixes https://github.com/BerriAI/litellm/issues/4148
2024-06-12 10:35:48 -07:00
Krrish Dholakia
31cb1269f5 fix(proxy/_types.py): support logging k,v pairs to spend logs with spend_logs_metadata param 2024-06-12 08:42:35 -07:00
Ishaan Jaff
6d2134ad2a
Merge pull request #4138 from BerriAI/litellm_log_management_endpoint_logs_otel
[FEAT]  log management endpoint logs to otel
2024-06-11 19:00:13 -07:00
Krish Dholakia
75b0d7821b
Merge pull request #4139 from BerriAI/litellm_fix_budget_exceeded_error_code
fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
2024-06-11 18:36:58 -07:00
Ishaan Jaff
995b1e7315 fix when user_api_key_dict is None 2024-06-11 18:33:15 -07:00
Ishaan Jaff
b10ac0d1f3 fix linting error 2024-06-11 18:14:06 -07:00
Ishaan Jaff
fba7d2e623 fix team endpoints 2024-06-11 18:10:20 -07:00
Ishaan Jaff
7ad981b85c fix - log mgmt data to OTEL 2024-06-11 18:05:10 -07:00
Ishaan Jaff
51b78422df fix http_request 2024-06-11 17:57:50 -07:00
Ishaan Jaff
479a39cebd fix test new team 2024-06-11 17:48:11 -07:00
Krrish Dholakia
a1ca70a8a7 fix: more bug fixes 2024-06-11 17:41:59 -07:00
Ishaan Jaff
30f74aa471 fix import error 2024-06-11 17:17:57 -07:00
Ishaan Jaff
427f2ee1fa feat - otel log /team exceptions 2024-06-11 16:27:07 -07:00
Ishaan Jaff
f2abac748e fix refactor management endpoint utils 2024-06-11 16:16:10 -07:00
Krrish Dholakia
c27ae34a39 fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
standardizes error code for budget exceeded errors to status code 400
2024-06-11 16:10:58 -07:00
Ishaan Jaff
13cb49688a feat - log management endpoint logs to otel 2024-06-11 16:09:11 -07:00
Ishaan Jaff
5eb2822d31
Merge pull request #4133 from BerriAI/litellm_work_with_traceparents
[Feat] OTEL - allow propagating traceparent in headers
2024-06-11 14:27:08 -07:00
Ishaan Jaff
d7f1445615 doc - OTEL trace propogation 2024-06-11 14:25:33 -07:00
Ishaan Jaff
d829e6a297 test - propogate trace IDs across services 2024-06-11 14:00:25 -07:00
Ishaan Jaff
7ce1289548 feat - use traceparent to proporgate OTEL traces 2024-06-11 13:57:31 -07:00
Krrish Dholakia
a8ea7c6d31 docs(ui.md): add okta sso support to docs 2024-06-11 13:17:41 -07:00
Ishaan Jaff
1af3d34d8b fix OTEL semantic conventions does not exist 2024-06-11 12:28:38 -07:00
Ishaan Jaff
a7e9e5b3cb ui - new build 2024-06-10 21:11:33 -07:00
Krish Dholakia
55a20c7cce
Merge pull request #4084 from BerriAI/litellm_batch_add_team_members
fix(proxy_server.py): allow passing in a list of team members
2024-06-10 20:26:35 -07:00
Krrish Dholakia
b2c9b5bbf4 feat(proxy/_logging.py): support controlling log level when json logs=True
allow user to control log level when json_logs=True
2024-06-10 17:33:43 -07:00
Ishaan Jaff
c98739284d
Merge pull request #4103 from BerriAI/litellm_log_auth_exceptions_to_otel
feat - log Proxy Server auth errors on OTEL
2024-06-10 14:10:02 -07:00
Ishaan Jaff
f00fa12e69 feat - viewing spend report per customer / team 2024-06-10 12:58:24 -07:00
Ishaan Jaff
a27f7e2817 feat - log exceptions to OTEL 2024-06-10 12:34:18 -07:00
Krrish Dholakia
d066e0e152 fix(proxy/_types.py): fix validation check 2024-06-08 22:56:56 -07:00
Ishaan Jaff
8de7074614 [Feature]: Proxy: Support API-Key 2024-06-08 21:02:47 -07:00
Krish Dholakia
b4fc4abb76
Merge pull request #4080 from BerriAI/litellm_predibase_exception_mapping
fix(utils.py): improved predibase exception mapping
2024-06-08 20:27:44 -07:00
Krrish Dholakia
def648ed3f fix(proxy_server.py): allow passing in a list of team members
allows batch adding members to a team by passing in a list. fixes concurrency issue caused by calling team/member_add in parallel
2024-06-08 19:03:45 -07:00
Ishaan Jaff
95eb762cc7
Merge pull request #4083 from BerriAI/litellm_act_on_behalf
[Feat] Enterprise - Attribute Management changes to Users in Audit Logs
2024-06-08 17:39:16 -07:00
Ishaan Jaff
ae8889f4fa fix schema.prisma 2024-06-08 17:39:04 -07:00
Krrish Dholakia
dddd4a73fe fix(proxy_server.py): return updated member list in /team/member_delete 2024-06-08 16:33:07 -07:00