Commit graph

3006 commits

Author SHA1 Message Date
Krish Dholakia
4e230f0a2e
Merge pull request #3844 from BerriAI/litellm_region_based_alerts
feat(slack_alerting.py): enable provider-region based alerting
2024-05-25 21:03:16 -07:00
Ishaan Jaff
7cc63a77c6 fix - router debug logs 2024-05-25 17:23:37 -07:00
Krrish Dholakia
c2f19d631e feat(slack_alerting.py): enable provider-region based alerting 2024-05-25 16:55:46 -07:00
Ishaan Jaff
59cb306d47 fix - __team_info 2024-05-25 15:36:20 -07:00
Ishaan Jaff
e2d3c0c846 fix - updating team 2024-05-25 15:31:25 -07:00
Ishaan Jaff
22d8eaab93 test - new_team 2024-05-25 15:20:49 -07:00
Krrish Dholakia
d2e14ca833 fix(bedrock_httpx.py): fix bedrock ptu model id str encoding
Fixes https://github.com/BerriAI/litellm/issues/3805
2024-05-25 10:54:01 -07:00
Krrish Dholakia
00af8e350f fix(bedrock_httpx.py): support bedrock ptu's
Fixes https://github.com/BerriAI/litellm/issues/3805
2024-05-24 23:02:04 -07:00
Krrish Dholakia
281906ff33 fix(vertex_ai.py): handle nested content dictionary for assistant message
openai allows the assistant content message to also be a list of dictionaries, handle that
2024-05-24 22:47:47 -07:00
Ishaan Jaff
0083776a14
Revert "Log errors in Traceloop Integration" 2024-05-24 21:25:17 -07:00
Ishaan Jaff
b2feb9a8ec ci / cd - run again 2024-05-24 21:13:50 -07:00
Ishaan Jaff
2e5c625f8b ci/cd run again 2024-05-24 20:56:52 -07:00
Ishaan Jaff
9d3b2e7e0d test alerting 2024-05-24 20:54:17 -07:00
Krish Dholakia
d25ed9c4d3
Merge pull request #3828 from BerriAI/litellm_outage_alerting
fix(slack_alerting.py): support region based outage alerting
2024-05-24 19:13:17 -07:00
Krrish Dholakia
8dec87425e feat(slack_alerting.py): refactor region outage alerting to do model based alerting instead
Unable to extract azure region from api base, makes sense to start with model alerting and then move to region
2024-05-24 19:10:33 -07:00
Krrish Dholakia
2cdb0584d1 fix(slack_alerting.py): fixes for outage alerting 2024-05-24 17:17:17 -07:00
Krrish Dholakia
f8350b9461 fix(slack_alerting.py): support region based outage alerting 2024-05-24 16:59:16 -07:00
Krish Dholakia
bcd7534153
Merge pull request #3780 from nirga/traceloop-failures
Log errors in Traceloop Integration
2024-05-24 14:23:26 -07:00
Nir Gazit
7c279e05a7 fix(traceloop): log errors 2024-05-24 22:05:31 +03:00
Krish Dholakia
391a31c0ce
Merge pull request #3812 from afbarbaro/main
Fix issue with delta being None when Deferred / Async Content Filter is enabled on Azure OpenAI
2024-05-24 10:05:08 -07:00
Andres Barbaro
8165dd6b5a Update test 2024-05-24 11:48:35 -05:00
Ishaan Jaff
466accd4f5
Merge pull request #3462 from ffreemt/main
Add return_exceptions to batch_completion (retry)
2024-05-24 09:19:10 -07:00
Andres Barbaro
2e5278990d Improve test 2024-05-24 11:11:43 -05:00
Andres Barbaro
638984b764 Remove unnecessary import 2024-05-24 11:00:29 -05:00
Andres Barbaro
565a7f1ce2 Add test to validate chunks with no delta are processed correctly 2024-05-24 10:57:35 -05:00
Ishaan Jaff
18f8287e29 ci/cd run again 2024-05-23 21:23:13 -07:00
ffreemt
86d46308bf Make return-exceptions as default behavior in litellm.batch_completion 2024-05-24 11:09:11 +08:00
Krish Dholakia
c14584722e
Merge pull request #3808 from BerriAI/litellm_databricks_api
feat(databricks.py): adds databricks support - completion, async, streaming
2024-05-23 19:23:19 -07:00
Krrish Dholakia
43353c28b3 feat(databricks.py): add embedding model support 2024-05-23 18:22:03 -07:00
Krrish Dholakia
d2229dcd21 feat(databricks.py): adds databricks support - completion, async, streaming
Closes https://github.com/BerriAI/litellm/issues/2160
2024-05-23 16:29:46 -07:00
Ishaan Jaff
82cc144e11 test_lakera_prompt_injection_detection 2024-05-23 15:26:01 -07:00
Ishaan Jaff
6d267fc7ad test - openai moderation response 2024-05-23 13:24:46 -07:00
Krrish Dholakia
84f3690453 test(test_key_generate_prisma.py): fix tests with unique team id 2024-05-23 08:46:44 -07:00
Krrish Dholakia
a33b9221da fix(proxy_server.py): fix admin allowed routes 2024-05-22 20:55:21 -07:00
Ishaan Jaff
b6b86dc539 ci/cd run again 2024-05-22 20:19:05 -07:00
Ishaan Jaff
288303f797 (ci/cd) run again - new ui build 2024-05-22 20:04:10 -07:00
Ishaan Jaff
97f8cb63f2 (ci/cd) run again 2024-05-22 20:00:41 -07:00
Krish Dholakia
beb61702c3
Merge branch 'main' into litellm_filter_invalid_params 2024-05-21 20:42:21 -07:00
Krish Dholakia
febd57dc81
Merge pull request #3768 from BerriAI/litellm_lowest_latency_ttft_routing
feat(lowest_latency.py): route by time to first token, for streaming requests (if available)
2024-05-21 19:11:02 -07:00
Krrish Dholakia
0001b3208d test(test_alangfuse.py): skip langfuse test 2024-05-21 19:00:12 -07:00
Krrish Dholakia
207924d08f test(test_streaming.py): retry if openai is inconsistent with stream options 2024-05-21 18:51:24 -07:00
Krrish Dholakia
20ad1a5189 test(test_router_caching.py): fix caching tests 2024-05-21 18:07:46 -07:00
Krrish Dholakia
bfde1357dd test(test_router_caching.py): fix test 2024-05-21 18:05:05 -07:00
Krrish Dholakia
f3d29a6b4a feat(anthropic.py): support anthropic 'tool_choice' param
Closes https://github.com/BerriAI/litellm/issues/3752
2024-05-21 17:50:44 -07:00
Krrish Dholakia
124fb18ce7 test(test_logfire.py): skip logfire tests - breaking on ci/cd 2024-05-21 17:37:16 -07:00
Krrish Dholakia
8dede0c351 test(test_logfire.py): skip logfire tests 2024-05-21 17:36:17 -07:00
Krrish Dholakia
d5fd3095e4 test(test_logfire.py): skip logfire tests 2024-05-21 17:34:55 -07:00
Krrish Dholakia
cc41db018f test(test_router.py): fix testing 2024-05-21 17:31:31 -07:00
Krrish Dholakia
988970f4c2 feat(router.py): Fixes https://github.com/BerriAI/litellm/issues/3769 2024-05-21 17:24:51 -07:00
Krrish Dholakia
eea1edb973 test(test_alangfuse.py): skip test for this pr 2024-05-21 14:08:05 -07:00