Commit graph

3006 commits

Author SHA1 Message Date
Krrish Dholakia
2b3da449c8 feat(lowest_latency.py): route by time to first token, for streaming requests (if available)
Closes https://github.com/BerriAI/litellm/issues/3574
2024-05-21 13:08:17 -07:00
Krish Dholakia
8596bf0ddf
Merge pull request #3756 from elisalimli/main
Revert "Revert "Logfire Integration""
2024-05-21 09:31:36 -07:00
Krish Dholakia
2cda5a2bc3
Merge pull request #3412 from sumanth13131/usage-based-routing-ttl-on-cache
usage-based-routing-ttl-on-cache
2024-05-21 07:58:41 -07:00
alisalim17
01bb26bbba Revert "Revert "Logfire Integration""
This reverts commit b04a8d878a.
2024-05-21 11:07:40 +04:00
Ishaan Jaff
f20184cd49 (ci/cd) run again 2024-05-20 18:50:17 -07:00
Krish Dholakia
707cf24472
Merge branch 'main' into litellm_webhook_support 2024-05-20 18:41:58 -07:00
Krrish Dholakia
9804eabcd5 test(test_alerting.py): fix testing 2024-05-20 17:01:34 -07:00
Krrish Dholakia
867f9300e3 fix(slack_alerting.py): cleanup webhook event 2024-05-20 16:55:01 -07:00
Ishaan Jaff
0ddaf320ef fix test - retry claude-3 image error 3 times 2024-05-20 16:17:09 -07:00
Krrish Dholakia
cba2b729b2 test(test_alerting.py): testing fixes 2024-05-20 15:37:35 -07:00
Krrish Dholakia
da0e5d1b8d feat(slack_alerting.py): support webhook for budget alerts
Closes https://github.com/BerriAI/litellm/issues/3743
2024-05-20 15:30:56 -07:00
Ishaan Jaff
91a89eb4ed
Merge pull request #3739 from BerriAI/litellm_add_imagen_support
[FEAT] Async VertexAI Image Generation
2024-05-20 14:14:43 -07:00
Krrish Dholakia
1384ee3c57 fix(slack_alerting.py): prevent alert spam within 24 hr period for budget alerts
Closes https://github.com/BerriAI/litellm/issues/3738
2024-05-20 13:35:19 -07:00
Ishaan Jaff
518db13982 add parameter mapping with vertex ai 2024-05-20 13:28:20 -07:00
Ishaan Jaff
571d4cf569 test - fix test_aimage_generation_vertex_ai 2024-05-20 12:10:28 -07:00
Ishaan Jaff
6ddc9873e5 test vertex image gen test 2024-05-20 11:14:16 -07:00
Ishaan Jaff
2da89a0c8e fix vertex test 2024-05-20 10:51:25 -07:00
Ishaan Jaff
2519879e67 add ImageObject 2024-05-20 10:45:37 -07:00
Ishaan Jaff
24951d44a4 feat - working httpx requests vertex ai image gen 2024-05-20 09:51:15 -07:00
Ishaan Jaff
5ba5f15b56 test - test_aimage_generation_vertex_ai 2024-05-20 08:14:43 -07:00
Krish Dholakia
bb85a5e6b2
Merge pull request #3729 from BerriAI/litellm_vertex_history
fix(vertex_ai.py): support passing in result of tool call to vertex
2024-05-20 07:33:05 -07:00
Krrish Dholakia
45c46a84d0 fix(vertex_ai.py): support passing system instructions to vertex ai 2024-05-20 06:18:19 -07:00
Krish Dholakia
c94ce069f7
Merge pull request #3724 from BerriAI/litellm_gpt_4_response_format_drop_params
fix(utils.py): drop response_format if 'drop_params=True' for gpt-4
2024-05-19 12:35:13 -07:00
Krrish Dholakia
65aacc0c1a fix(vertex_ai.py): use chat_messages_with_history for async + streaming calls 2024-05-19 12:30:24 -07:00
Krrish Dholakia
f9ab72841a fix(vertex_ai.py): passing all tests on 'test_amazing_vertex_completion.py 2024-05-19 12:22:21 -07:00
Krrish Dholakia
a2c66ed4fb fix(vertex_ai.py): support passing in result of tool call to vertex
Fixes https://github.com/BerriAI/litellm/issues/3709
2024-05-19 11:34:07 -07:00
Krrish Dholakia
12942c39db fix(utils.py): drop response_format if 'drop_params=True' for gpt-4 2024-05-18 13:02:48 -07:00
Krish Dholakia
5e5179e476
Merge branch 'main' into litellm_model_id_fix 2024-05-17 22:36:17 -07:00
Krrish Dholakia
5d3fe52a08 test: fix test 2024-05-17 22:35:34 -07:00
Krrish Dholakia
1cecdc4690 fix(utils.py): fix replicate completion cost calculation 2024-05-17 22:18:57 -07:00
Ishaan Jaff
c8a1cf6ce2 (ci/cd) run again 2024-05-17 22:07:21 -07:00
Krrish Dholakia
a75b865ebc test(test_config.py): fix test 2024-05-17 22:00:44 -07:00
Krish Dholakia
3a06fe2818
Merge branch 'main' into litellm_bedrock_anthropic_fix 2024-05-17 17:47:32 -07:00
Krrish Dholakia
4682802444 fix(bedrock_httpx.py): raise better timeout exception 2024-05-17 17:16:36 -07:00
Krrish Dholakia
5d24a72b7e fix(bedrock_httpx.py): support mapping for bedrock cohere command r text 2024-05-17 16:13:49 -07:00
Krrish Dholakia
21f2ba6f1f fix(bedrock_httpx.py): logging fixes 2024-05-16 23:20:51 -07:00
Krrish Dholakia
92c2e2af6a fix(bedrock_httpx.py): add async support for bedrock amazon, meta, mistral models 2024-05-16 22:39:25 -07:00
Krrish Dholakia
0293f7766a fix(bedrock_httpx.py): move bedrock ai21 calls to being async 2024-05-16 22:21:30 -07:00
Krrish Dholakia
180bc46ca4 fix(bedrock_httpx.py): move anthropic bedrock calls to httpx
Fixing https://github.com/BerriAI/litellm/issues/2921
2024-05-16 21:51:55 -07:00
Ishaan Jaff
12d2dcd48c ci/cd run again 2024-05-16 21:15:06 -07:00
Ishaan Jaff
ee98074273 ci/cd run again 2024-05-16 18:35:43 -07:00
Ishaan Jaff
729e34ffea (ci/cd) fix - assert len(completed_str) 2024-05-16 18:06:48 -07:00
Krrish Dholakia
709373b15c fix(replicate.py): move replicate calls to being completely async
Closes https://github.com/BerriAI/litellm/issues/3128
2024-05-16 17:24:08 -07:00
Krrish Dholakia
a2a5884df1 fix(utils.py): allow passing in custom pricing to completion_cost as params 2024-05-16 16:24:44 -07:00
Ishaan Jaff
97324800ec
Merge pull request #3694 from BerriAI/litellm_allow_setting_anthropic_beta
[Feat] Support Anthropic `tools-2024-05-16` - Set Custom Anthropic Custom Headers
2024-05-16 15:48:26 -07:00
Ishaan Jaff
e19e475c9f test - setting extra headers for anthropic tool use 2024-05-16 14:41:26 -07:00
Ishaan Jaff
a2ef089667 fix - choices index for gemini/ provider 2024-05-16 13:52:46 -07:00
Ishaan Jaff
0a816b2c45
Merge pull request #3682 from BerriAI/litellm_token_counter_endpoint
[Feat] `token_counter` endpoint
2024-05-16 13:39:23 -07:00
Ishaan Jaff
4a5e6aa43c test - token count response 2024-05-16 13:20:01 -07:00
Krish Dholakia
ea976d8c30
Merge pull request #3663 from msabramo/msabramo/allow-non-admins-to-use-openai-routes
Allow non-admins to use `/engines/{model}/chat/completions`
2024-05-16 12:17:50 -07:00