phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 03:04:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
13766 commits 2484 branches 894 tags 536 MiB
Commit graph

1615 commits

Author SHA1 Message Date
Krrish Dholakia
d421486a45 fix(token_counter.py): New `get_modified_max_tokens' helper func 
Fixes https://github.com/BerriAI/litellm/issues/4439
 2024-06-27 15:38:09 -07:00
Krrish Dholakia
23a1f21f86 fix(utils.py): add new special token for cleanup 2024-06-26 22:52:50 -07:00
Ishaan Jaff
8ecf15185b
Merge pull request #4423 from BerriAI/litellm_forward_traceparent_otel 
[Fix] Forward OTEL Traceparent Header to provider
 2024-06-26 17:16:23 -07:00
Ishaan Jaff
d213f81b4c add initial support for volcengine 2024-06-26 16:53:44 -07:00
Ishaan Jaff
57852bada9 fix handle_openai_chat_completion_chunk 2024-06-26 16:01:50 -07:00
Ishaan Jaff
b16b846711 forward otel traceparent in request headers 2024-06-26 12:31:28 -07:00
Ishaan Jaff
1cfe03c820 add fireworks ai param mapping 2024-06-26 06:43:18 -07:00
Krrish Dholakia
d98e00d1e0 fix(router.py): set cooldown_time: per model 2024-06-25 16:51:55 -07:00
Krrish Dholakia
e813e984f7 fix(predibase.py): support json schema on predibase 2024-06-25 16:03:47 -07:00
Krrish Dholakia
6889a4c0dd fix(utils.py): predibase exception mapping - map 424 as a badrequest error 2024-06-25 13:47:38 -07:00
Krrish Dholakia
6e02ac0056 fix(utils.py): add coverage for anthropic content policy error - vertex ai 2024-06-25 11:47:39 -07:00
Ishaan Jaff
2bd993039b
Merge pull request #4405 from BerriAI/litellm_update_mock_completion 
[Fix] - use `n` in mock completion responses
 2024-06-25 11:20:30 -07:00
Ishaan Jaff
ccf1bbc5d7 fix using mock completion 2024-06-25 11:14:40 -07:00
Ishaan Jaff
07829514d1 feat - add param mapping for nvidia nim 2024-06-25 09:13:08 -07:00
Krrish Dholakia
d182ea0f77 fix(utils.py): catch 422-status errors 2024-06-24 19:41:48 -07:00
Krrish Dholakia
123477b55a fix(utils.py): fix exception_mapping check for errors 
If exception already mapped - don't attach traceback to it
 2024-06-24 16:55:19 -07:00
Krrish Dholakia
cea630022e fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions 
Fixes https://github.com/BerriAI/litellm/issues/4338
 2024-06-22 21:26:15 -07:00
Krish Dholakia
961e7ac95d
Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
c4b1540ce0 fix(utils.py): support streamingchoices in 'get_response_string 2024-06-22 15:45:52 -07:00
Krrish Dholakia
532f24bfb7 refactor: instrument 'dynamic_rate_limiting' callback on proxy 2024-06-22 00:32:29 -07:00
Krrish Dholakia
5e893ed13e fix(utils.py): Fix anthropic tool calling exception mapping 
Fixes https://github.com/BerriAI/litellm/issues/4348
 2024-06-21 21:20:49 -07:00
Krrish Dholakia
000d678445 fix(utils.py): improve coverage for anthropic exception mapping 2024-06-21 21:15:10 -07:00
Ishaan Jaff
4e795dad81 fix ContentPolicyViolationError mapping 2024-06-21 16:11:42 -07:00
Krrish Dholakia
16941eee43 fix(utils.py): re-integrate separate gemini optional param mapping (google ai studio) 
Fixes https://github.com/BerriAI/litellm/issues/4333
 2024-06-21 09:01:32 -07:00
Krrish Dholakia
fdb7101aaf fix(utils.py): add extra body params for text completion calls 2024-06-21 08:28:38 -07:00
Wonseok Lee (Jack)
c4c7d1b367
Merge branch 'main' into feat/friendliai 2024-06-21 10:50:03 +09:00
Krish Dholakia
c8a40eca05
Merge pull request #4313 from BerriAI/litellm_drop_specific_params 
fix(utils.py): allow dropping specific openai params
 2024-06-20 15:15:19 -07:00
Krrish Dholakia
5cb0c1ad70 fix(utils.py): add new error string to context window exception mapping 2024-06-20 12:01:11 -07:00
Krrish Dholakia
a0f08e0dad fix(utils.py): allow dropping specific openai params 2024-06-20 11:48:06 -07:00
Krrish Dholakia
d6eb986b8e fix(utils.py): add together ai exception mapping 2024-06-20 11:29:57 -07:00
Krish Dholakia
71716bec48
Merge pull request #4295 from BerriAI/litellm_gemini_pricing_2 
Vertex AI - character based cost calculation
 2024-06-19 19:17:09 -07:00
Krrish Dholakia
682ec33aa0 fix(litellm_logging.py): initialize global variables 
Fixes https://github.com/BerriAI/litellm/issues/4281
 2024-06-19 18:39:45 -07:00
Krrish Dholakia
16da21e839 feat(llm_cost_calc/google.py): do character based cost calculation for vertex ai 
Calculate cost for vertex ai responses using characters in query/response

 Closes https://github.com/BerriAI/litellm/issues/4165
 2024-06-19 17:18:42 -07:00
Ishaan Jaff
3c6785c207 add ft:gpt4 2024-06-19 16:49:45 -07:00
Ishaan Jaff
8c07f3edf4 fix remove get_or_generate_uuid 2024-06-19 14:10:35 -07:00
Ishaan Jaff
f5ebc1a042
Merge pull request #4282 from BerriAI/litellm_add_openrouter_exception_mapping 
feat - add open router exception mapping
 2024-06-19 12:25:12 -07:00
Krish Dholakia
3a3b3667ee
Merge branch 'main' into litellm_aws_kms_fixes 2024-06-19 09:30:54 -07:00
Ishaan Jaff
5982fd88f9 feat - add open router exception mapping 2024-06-19 08:40:08 -07:00
Krish Dholakia
0c2c02ba8d
Merge pull request #4266 from BerriAI/litellm_gemini_image_url 
Support 'image url' to vertex ai / google ai studio gemini models
 2024-06-18 20:39:25 -07:00
Krish Dholakia
d96ffe8075
Merge pull request #4271 from BerriAI/litellm_vertex_httpx_fix 
fix(vertex_httpx.py): Correctly handle Vertex content policy violation error
 2024-06-18 20:19:46 -07:00
Ishaan Jaff
a26a023ff8 fix - log langfuse prompt 2024-06-18 19:25:51 -07:00
Krrish Dholakia
f41c443abb fix(vertex_httpx.py): re-raise vertex content policy violation error 
Fixes https://github.com/BerriAI/litellm/issues/4270
 2024-06-18 19:00:35 -07:00
Ishaan Jaff
2d15a3c586 fix - mock completion request 2024-06-18 17:08:54 -07:00
Krrish Dholakia
5ad095ad9d fix(openai.py): deepinfra function calling - drop_params support for unsupported tool choice value 2024-06-18 16:19:57 -07:00
Krrish Dholakia
3f7252c422 fix(support-passing-image-url-to-gemini-via-vertex-ai): Closes https://github.com/BerriAI/litellm/issues/4262 2024-06-18 10:55:58 -07:00
Ishaan Jaff
8f3bd0780b fix exception mapping for vertex ai 2024-06-18 08:38:36 -07:00
Krish Dholakia
63216f42b8
Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 19:50:56 -07:00
Ishaan Jaff
c93463b535 fix maintain older usage of logfire 2024-06-17 19:42:39 -07:00
Ishaan Jaff
4a75e57b6f fix logfire 2024-06-17 19:21:35 -07:00
Krrish Dholakia
fca2ffb480 fix(utils.py): return cost above 128k from get_model_info 2024-06-17 19:15:02 -07:00