Commit graph

1814 commits

Author SHA1 Message Date
Ishaan Jaff
339c5d17ed add initial support for volcengine 2024-06-26 16:53:44 -07:00
Ishaan Jaff
392d68e7b9 fix handle_openai_chat_completion_chunk 2024-06-26 16:01:50 -07:00
Ishaan Jaff
0368c89dd8 forward otel traceparent in request headers 2024-06-26 12:31:28 -07:00
Ishaan Jaff
b85c48ff17 add fireworks ai param mapping 2024-06-26 06:43:18 -07:00
Krrish Dholakia
c70d4ffafb fix(router.py): set cooldown_time: per model 2024-06-25 16:51:55 -07:00
Krrish Dholakia
91bbef4bcd fix(predibase.py): support json schema on predibase 2024-06-25 16:03:47 -07:00
Krrish Dholakia
1e51b8894f fix(utils.py): predibase exception mapping - map 424 as a badrequest error 2024-06-25 13:47:38 -07:00
Krrish Dholakia
193af5f23b fix(utils.py): add coverage for anthropic content policy error - vertex ai 2024-06-25 11:47:39 -07:00
Ishaan Jaff
8ddc9a5ca4 Merge pull request #4405 from BerriAI/litellm_update_mock_completion
[Fix] - use `n` in mock completion responses
2024-06-25 11:20:30 -07:00
Ishaan Jaff
9372505e4e fix using mock completion 2024-06-25 11:14:40 -07:00
Ishaan Jaff
ca372f7599 feat - add param mapping for nvidia nim 2024-06-25 09:13:08 -07:00
Krrish Dholakia
efaffd84e1 fix(utils.py): catch 422-status errors 2024-06-24 19:41:48 -07:00
Krrish Dholakia
40bd069c39 fix(utils.py): fix exception_mapping check for errors
If exception already mapped - don't attach traceback to it
2024-06-24 16:55:19 -07:00
Krrish Dholakia
4055381cdb fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-22 21:26:15 -07:00
Krish Dholakia
63d0defa6d Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
e2332051a1 fix(utils.py): support streamingchoices in 'get_response_string 2024-06-22 15:45:52 -07:00
Krrish Dholakia
8f95381276 refactor: instrument 'dynamic_rate_limiting' callback on proxy 2024-06-22 00:32:29 -07:00
Krrish Dholakia
03c7692c81 fix(utils.py): Fix anthropic tool calling exception mapping
Fixes https://github.com/BerriAI/litellm/issues/4348
2024-06-21 21:20:49 -07:00
Krrish Dholakia
40c9ecd470 fix(utils.py): improve coverage for anthropic exception mapping 2024-06-21 21:15:10 -07:00
Ishaan Jaff
5a20680469 fix ContentPolicyViolationError mapping 2024-06-21 16:11:42 -07:00
Krrish Dholakia
60b4249767 fix(utils.py): re-integrate separate gemini optional param mapping (google ai studio)
Fixes https://github.com/BerriAI/litellm/issues/4333
2024-06-21 09:01:32 -07:00
Krrish Dholakia
f0a5ca3522 fix(utils.py): add extra body params for text completion calls 2024-06-21 08:28:38 -07:00
Wonseok Lee (Jack)
86d87a3f38 Merge branch 'main' into feat/friendliai 2024-06-21 10:50:03 +09:00
Krish Dholakia
35c57f9b3e Merge pull request #4313 from BerriAI/litellm_drop_specific_params
fix(utils.py): allow dropping specific openai params
2024-06-20 15:15:19 -07:00
Krrish Dholakia
5c81688f3c fix(utils.py): add new error string to context window exception mapping 2024-06-20 12:01:11 -07:00
Krrish Dholakia
9dd5c9fdf9 fix(utils.py): allow dropping specific openai params 2024-06-20 11:48:06 -07:00
Krrish Dholakia
bc01a66e44 fix(utils.py): add together ai exception mapping 2024-06-20 11:29:57 -07:00
Krish Dholakia
63277d4b7a Merge pull request #4295 from BerriAI/litellm_gemini_pricing_2
Vertex AI - character based cost calculation
2024-06-19 19:17:09 -07:00
Krrish Dholakia
84043f4fd4 fix(litellm_logging.py): initialize global variables
Fixes https://github.com/BerriAI/litellm/issues/4281
2024-06-19 18:39:45 -07:00
Krrish Dholakia
edfe550165 feat(llm_cost_calc/google.py): do character based cost calculation for vertex ai
Calculate cost for vertex ai responses using characters in query/response

 Closes https://github.com/BerriAI/litellm/issues/4165
2024-06-19 17:18:42 -07:00
Ishaan Jaff
6ac9792cad add ft:gpt4 2024-06-19 16:49:45 -07:00
Ishaan Jaff
6865def404 fix remove get_or_generate_uuid 2024-06-19 14:10:35 -07:00
Ishaan Jaff
4590195a06 Merge pull request #4282 from BerriAI/litellm_add_openrouter_exception_mapping
feat - add open router exception mapping
2024-06-19 12:25:12 -07:00
Krish Dholakia
ea2f27e472 Merge branch 'main' into litellm_aws_kms_fixes 2024-06-19 09:30:54 -07:00
Ishaan Jaff
ad2736ca2b feat - add open router exception mapping 2024-06-19 08:40:08 -07:00
Tom Usher
f9b5e56d46 Return output_vector_size in get_model_info 2024-06-19 14:09:20 +01:00
Krish Dholakia
4c5eb58fc9 Merge pull request #4266 from BerriAI/litellm_gemini_image_url
Support 'image url' to vertex ai / google ai studio gemini models
2024-06-18 20:39:25 -07:00
Krish Dholakia
fb01094d8b Merge pull request #4271 from BerriAI/litellm_vertex_httpx_fix
fix(vertex_httpx.py): Correctly handle Vertex content policy violation error
2024-06-18 20:19:46 -07:00
Ishaan Jaff
8a36a5e297 fix - log langfuse prompt 2024-06-18 19:25:51 -07:00
Krrish Dholakia
71e882f4a2 fix(vertex_httpx.py): re-raise vertex content policy violation error
Fixes https://github.com/BerriAI/litellm/issues/4270
2024-06-18 19:00:35 -07:00
Ishaan Jaff
c2c3353e01 fix - mock completion request 2024-06-18 17:08:54 -07:00
Krrish Dholakia
772b4f6614 fix(openai.py): deepinfra function calling - drop_params support for unsupported tool choice value 2024-06-18 16:19:57 -07:00
Krrish Dholakia
f745245ad5 fix(support-passing-image-url-to-gemini-via-vertex-ai): Closes https://github.com/BerriAI/litellm/issues/4262 2024-06-18 10:55:58 -07:00
Ishaan Jaff
fed9a994e4 fix exception mapping for vertex ai 2024-06-18 08:38:36 -07:00
Krish Dholakia
6f94456f40 Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 19:50:56 -07:00
Ishaan Jaff
0c7665c71f fix maintain older usage of logfire 2024-06-17 19:42:39 -07:00
Ishaan Jaff
d89de2fd72 fix logfire 2024-06-17 19:21:35 -07:00
Krrish Dholakia
e43918add5 fix(utils.py): return cost above 128k from get_model_info 2024-06-17 19:15:02 -07:00
Krrish Dholakia
cc1ec55e5b fix(vertex_httpx.py): check if model supports system messages before sending separately 2024-06-17 17:32:38 -07:00
Krish Dholakia
18d9dcc4db Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 17:28:50 -07:00