Commit graph

9496 commits

Author SHA1 Message Date
Krrish Dholakia
ae693424e4 fix(__init__.py): update init 2024-07-23 17:55:28 -07:00
Krrish Dholakia
7df94100e8 build(model_prices_and_context_window.json): add model pricing for vertex ai llama 3.1 api 2024-07-23 17:36:07 -07:00
Krrish Dholakia
83ef52e180 feat(vertex_ai_llama.py): vertex ai llama3.1 api support
Initial working commit for vertex ai llama 3.1 api support
2024-07-23 17:07:30 -07:00
Krrish Dholakia
f64a3309d1 fix(utils.py): support raw response headers for streaming requests 2024-07-23 11:58:58 -07:00
Krrish Dholakia
dcb974dd1e feat(utils.py): support passing openai response headers to client, if enabled
Allows openai/openai-compatible provider response headers to be sent to client, if 'return_response_headers' is enabled
2024-07-23 11:30:52 -07:00
Ishaan Jaff
b137207ae6 doc alert_to_webhook_url 2024-07-23 11:04:15 -07:00
Ishaan Jaff
aba600a892 fix triton linting 2024-07-23 11:03:34 -07:00
Ishaan Jaff
1355932bf4
Merge pull request #3905 from giritatavarty-8451/litellm_triton_chatcompletion_support
Litellm triton chatcompletion support - Resubmit of #3895
2024-07-23 10:30:26 -07:00
Ishaan Jaff
0ec2e9aa27 feat alert_to_webhook_url 2024-07-23 10:09:24 -07:00
Ishaan Jaff
d116ff280e feat - set alert_to_webhook_url 2024-07-23 10:08:21 -07:00
Ishaan Jaff
c1593c0cd1 update alert_to_webhook_url 2024-07-23 10:07:08 -07:00
Ishaan Jaff
69091f31df feat - add success_Callback per request 2024-07-23 08:43:01 -07:00
Ishaan Jaff
24ae0119d1 add debug logging for team callback settings 2024-07-23 08:41:05 -07:00
Ishaan Jaff
1a33c40713 add endpoint to disable logging for a team 2024-07-23 08:38:23 -07:00
Krish Dholakia
e770ac48a2
Merge branch 'main' into litellm_braintrust_integration 2024-07-22 22:40:39 -07:00
Krish Dholakia
c4db6aa15e
Merge pull request #4810 from BerriAI/litellm_team_modify_guardrails
feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails
2024-07-22 22:32:24 -07:00
Krrish Dholakia
1a83935aa4 fix(proxy/utils.py): add stronger typing for litellm params in failure call logging 2024-07-22 21:31:39 -07:00
Ishaan Jaff
290628d66b
Merge pull request #4831 from BerriAI/litellm_api_control_team_logging
[Feat] - API Endpoints to control logging callbacks per Team
2024-07-22 21:22:14 -07:00
Krrish Dholakia
548e4f53f8 feat(redact_messages.py): allow remove sensitive key information before passing to logging integration 2024-07-22 20:58:02 -07:00
Ishaan Jaff
2e5da5ea18 GET endpoint to get team callbacks 2024-07-22 20:46:20 -07:00
Ishaan Jaff
447bab4d46 only allow unique callbacks for team callbacks 2024-07-22 20:43:42 -07:00
Krrish Dholakia
0b9e93d863 fix(main.py): check if anthropic api base ends with required url
Fixes https://github.com/BerriAI/litellm/issues/4803
2024-07-22 20:36:35 -07:00
Ishaan Jaff
5ed82ba5ce feat add return types on team/callback 2024-07-22 20:35:27 -07:00
Ishaan Jaff
dcd8f7ebf2 control team callbacks using API 2024-07-22 18:29:21 -07:00
Ishaan Jaff
c9e2f977dd feat - return team_metadata in user_api_key_auth 2024-07-22 18:21:50 -07:00
Ishaan Jaff
c34c123fe3 feat - add endpoint to set team callbacks 2024-07-22 18:18:09 -07:00
Krrish Dholakia
f4a388f217 fix(openai.py): check if error body is a dictionary before indexing in 2024-07-22 18:12:04 -07:00
Ishaan Jaff
ff768e7571 types - AddTeamCallback 2024-07-22 18:11:59 -07:00
Krrish Dholakia
92b1262caa test(test_braintrust.py): add testing for braintrust integration 2024-07-22 18:05:11 -07:00
Krrish Dholakia
e4ab50e1a1 feat(braintrust_logging.py): working braintrust logging for successful calls 2024-07-22 17:04:55 -07:00
Ishaan Jaff
69e52e0a47 test - openai content policy errors 2024-07-22 16:24:03 -07:00
Ishaan Jaff
8f9638f2c1 fix raise correct provider on content policy violation 2024-07-22 16:03:15 -07:00
Ishaan Jaff
15c109f023 fix checking if _known_custom_logger_compatible_callbacks 2024-07-22 15:43:43 -07:00
Ishaan Jaff
d8d08a1ba3 set _known_custom_logger_compatible_callbacks in _init 2024-07-22 15:38:46 -07:00
Ishaan Jaff
a0600a30d8 fix using arize as success callback 2024-07-22 15:32:49 -07:00
Krrish Dholakia
1ce029c80e feat(braintrust.py): initial commit for braintrust integration 2024-07-22 15:06:15 -07:00
Ishaan Jaff
55f0728a7e
Merge pull request #4827 from BerriAI/litellm_use_anthropic_sdk_proxy
[Fix-Proxy] Allow non admin keys to access /v1/messages Anthropic Routes
2024-07-22 14:49:29 -07:00
Ishaan Jaff
9345c5de2a add test for anthropic routes 2024-07-22 14:48:22 -07:00
Ishaan Jaff
673105c88f update tests 2024-07-22 14:44:47 -07:00
Ishaan Jaff
b64755d2a1 check is_llm_api_route 2024-07-22 14:43:30 -07:00
Ishaan Jaff
b54b1d958b track anthropic_routes 2024-07-22 14:41:12 -07:00
Krrish Dholakia
2f65c950fe fix(vertex_httpx.py): Change non-blocking vertex error to warning
Fixes https://github.com/BerriAI/litellm/issues/4825
2024-07-22 14:00:33 -07:00
Ishaan Jaff
41e6c4a573 feat - arize ai log llm i/o 2024-07-22 13:47:58 -07:00
Ishaan Jaff
0436eba2fa otel - log to arize ai 2024-07-22 13:40:42 -07:00
Ishaan Jaff
cdc8b4f037 test - arize ai basic logging 2024-07-22 11:30:24 -07:00
Ishaan Jaff
1a5aaee386 add arize.py 2024-07-22 11:27:51 -07:00
Ishaan Jaff
68f8fe87e4 feat - arize ai open inference types 2024-07-22 11:07:48 -07:00
Ishaan Jaff
c7f72cbbde feat - add support to init arize ai 2024-07-22 10:58:20 -07:00
Krish Dholakia
227f55f370
Revert "Fix: use Bedrock region from environment variables before other region definitions" 2024-07-22 07:40:24 -07:00
Ishaan Jaff
48c365976f fix bedrock embedding test 2024-07-20 20:05:22 -07:00