Commit graph

9699 commits

Author SHA1 Message Date
Ishaan Jaff
92708a2737
Merge pull request #4841 from BerriAI/litellm_anthropic_cost_tracking
[Feat] - /v1/messages support usage tracking on spendLogs
2024-07-23 16:37:42 -07:00
Ishaan Jaff
78eb5164df fix DB accept null values for api_base, user, etc 2024-07-23 16:33:04 -07:00
Ishaan Jaff
a71b60d005 Pass litellm proxy specific metadata 2024-07-23 15:31:30 -07:00
Ishaan Jaff
4c1ee1e282 fix add better debugging _PROXY_track_cost_callback 2024-07-23 15:25:46 -07:00
Ishaan Jaff
c3d90f9aee test_anthropic_completion_input_translation_with_metadata 2024-07-23 15:23:58 -07:00
David Manouchehri
2dcd9a5567
(test - azure): Add test for Azure OIDC auth. 2024-07-23 19:12:40 +00:00
Krrish Dholakia
f64a3309d1 fix(utils.py): support raw response headers for streaming requests 2024-07-23 11:58:58 -07:00
Krrish Dholakia
dcb974dd1e feat(utils.py): support passing openai response headers to client, if enabled
Allows openai/openai-compatible provider response headers to be sent to client, if 'return_response_headers' is enabled
2024-07-23 11:30:52 -07:00
Ishaan Jaff
b137207ae6 doc alert_to_webhook_url 2024-07-23 11:04:15 -07:00
Ishaan Jaff
aba600a892 fix triton linting 2024-07-23 11:03:34 -07:00
Ishaan Jaff
1355932bf4
Merge pull request #3905 from giritatavarty-8451/litellm_triton_chatcompletion_support
Litellm triton chatcompletion support - Resubmit of #3895
2024-07-23 10:30:26 -07:00
Ishaan Jaff
0ec2e9aa27 feat alert_to_webhook_url 2024-07-23 10:09:24 -07:00
Ishaan Jaff
d116ff280e feat - set alert_to_webhook_url 2024-07-23 10:08:21 -07:00
Ishaan Jaff
c1593c0cd1 update alert_to_webhook_url 2024-07-23 10:07:08 -07:00
Ishaan Jaff
69091f31df feat - add success_Callback per request 2024-07-23 08:43:01 -07:00
Ishaan Jaff
24ae0119d1 add debug logging for team callback settings 2024-07-23 08:41:05 -07:00
Ishaan Jaff
1a33c40713 add endpoint to disable logging for a team 2024-07-23 08:38:23 -07:00
Krish Dholakia
e770ac48a2
Merge branch 'main' into litellm_braintrust_integration 2024-07-22 22:40:39 -07:00
Krish Dholakia
c4db6aa15e
Merge pull request #4810 from BerriAI/litellm_team_modify_guardrails
feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails
2024-07-22 22:32:24 -07:00
Krrish Dholakia
1a83935aa4 fix(proxy/utils.py): add stronger typing for litellm params in failure call logging 2024-07-22 21:31:39 -07:00
Ishaan Jaff
290628d66b
Merge pull request #4831 from BerriAI/litellm_api_control_team_logging
[Feat] - API Endpoints to control logging callbacks per Team
2024-07-22 21:22:14 -07:00
Krrish Dholakia
548e4f53f8 feat(redact_messages.py): allow remove sensitive key information before passing to logging integration 2024-07-22 20:58:02 -07:00
Ishaan Jaff
2e5da5ea18 GET endpoint to get team callbacks 2024-07-22 20:46:20 -07:00
Ishaan Jaff
447bab4d46 only allow unique callbacks for team callbacks 2024-07-22 20:43:42 -07:00
Krrish Dholakia
0b9e93d863 fix(main.py): check if anthropic api base ends with required url
Fixes https://github.com/BerriAI/litellm/issues/4803
2024-07-22 20:36:35 -07:00
Ishaan Jaff
5ed82ba5ce feat add return types on team/callback 2024-07-22 20:35:27 -07:00
Ishaan Jaff
dcd8f7ebf2 control team callbacks using API 2024-07-22 18:29:21 -07:00
Ishaan Jaff
c9e2f977dd feat - return team_metadata in user_api_key_auth 2024-07-22 18:21:50 -07:00
Ishaan Jaff
c34c123fe3 feat - add endpoint to set team callbacks 2024-07-22 18:18:09 -07:00
Krrish Dholakia
f4a388f217 fix(openai.py): check if error body is a dictionary before indexing in 2024-07-22 18:12:04 -07:00
Ishaan Jaff
ff768e7571 types - AddTeamCallback 2024-07-22 18:11:59 -07:00
Krrish Dholakia
92b1262caa test(test_braintrust.py): add testing for braintrust integration 2024-07-22 18:05:11 -07:00
Krrish Dholakia
e4ab50e1a1 feat(braintrust_logging.py): working braintrust logging for successful calls 2024-07-22 17:04:55 -07:00
Ishaan Jaff
69e52e0a47 test - openai content policy errors 2024-07-22 16:24:03 -07:00
Ishaan Jaff
8f9638f2c1 fix raise correct provider on content policy violation 2024-07-22 16:03:15 -07:00
Ishaan Jaff
15c109f023 fix checking if _known_custom_logger_compatible_callbacks 2024-07-22 15:43:43 -07:00
Ishaan Jaff
d8d08a1ba3 set _known_custom_logger_compatible_callbacks in _init 2024-07-22 15:38:46 -07:00
Ishaan Jaff
a0600a30d8 fix using arize as success callback 2024-07-22 15:32:49 -07:00
Krrish Dholakia
1ce029c80e feat(braintrust.py): initial commit for braintrust integration 2024-07-22 15:06:15 -07:00
Ishaan Jaff
55f0728a7e
Merge pull request #4827 from BerriAI/litellm_use_anthropic_sdk_proxy
[Fix-Proxy] Allow non admin keys to access /v1/messages Anthropic Routes
2024-07-22 14:49:29 -07:00
Ishaan Jaff
9345c5de2a add test for anthropic routes 2024-07-22 14:48:22 -07:00
Ishaan Jaff
673105c88f update tests 2024-07-22 14:44:47 -07:00
Ishaan Jaff
b64755d2a1 check is_llm_api_route 2024-07-22 14:43:30 -07:00
Ishaan Jaff
b54b1d958b track anthropic_routes 2024-07-22 14:41:12 -07:00
Krrish Dholakia
2f65c950fe fix(vertex_httpx.py): Change non-blocking vertex error to warning
Fixes https://github.com/BerriAI/litellm/issues/4825
2024-07-22 14:00:33 -07:00
Ishaan Jaff
41e6c4a573 feat - arize ai log llm i/o 2024-07-22 13:47:58 -07:00
Ishaan Jaff
0436eba2fa otel - log to arize ai 2024-07-22 13:40:42 -07:00
Ishaan Jaff
cdc8b4f037 test - arize ai basic logging 2024-07-22 11:30:24 -07:00
Ishaan Jaff
1a5aaee386 add arize.py 2024-07-22 11:27:51 -07:00
Ishaan Jaff
68f8fe87e4 feat - arize ai open inference types 2024-07-22 11:07:48 -07:00