phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 03:04:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
15030 commits 2484 branches 894 tags 536 MiB
Commit graph

1705 commits

Author SHA1 Message Date
Ishaan Jaff
ccf1bbc5d7 fix using mock completion 2024-06-25 11:14:40 -07:00
Ishaan Jaff
07829514d1 feat - add param mapping for nvidia nim 2024-06-25 09:13:08 -07:00
Krrish Dholakia
d182ea0f77 fix(utils.py): catch 422-status errors 2024-06-24 19:41:48 -07:00
Krrish Dholakia
123477b55a fix(utils.py): fix exception_mapping check for errors 
If exception already mapped - don't attach traceback to it
 2024-06-24 16:55:19 -07:00
Krrish Dholakia
cea630022e fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions 
Fixes https://github.com/BerriAI/litellm/issues/4338
 2024-06-22 21:26:15 -07:00
Krish Dholakia
961e7ac95d
Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
c4b1540ce0 fix(utils.py): support streamingchoices in 'get_response_string 2024-06-22 15:45:52 -07:00
Krrish Dholakia
532f24bfb7 refactor: instrument 'dynamic_rate_limiting' callback on proxy 2024-06-22 00:32:29 -07:00
Krrish Dholakia
5e893ed13e fix(utils.py): Fix anthropic tool calling exception mapping 
Fixes https://github.com/BerriAI/litellm/issues/4348
 2024-06-21 21:20:49 -07:00
Krrish Dholakia
000d678445 fix(utils.py): improve coverage for anthropic exception mapping 2024-06-21 21:15:10 -07:00
Ishaan Jaff
4e795dad81 fix ContentPolicyViolationError mapping 2024-06-21 16:11:42 -07:00
Krrish Dholakia
16941eee43 fix(utils.py): re-integrate separate gemini optional param mapping (google ai studio) 
Fixes https://github.com/BerriAI/litellm/issues/4333
 2024-06-21 09:01:32 -07:00
Krrish Dholakia
fdb7101aaf fix(utils.py): add extra body params for text completion calls 2024-06-21 08:28:38 -07:00
Wonseok Lee (Jack)
c4c7d1b367
Merge branch 'main' into feat/friendliai 2024-06-21 10:50:03 +09:00
Krish Dholakia
c8a40eca05
Merge pull request #4313 from BerriAI/litellm_drop_specific_params 
fix(utils.py): allow dropping specific openai params
 2024-06-20 15:15:19 -07:00
Krrish Dholakia
5cb0c1ad70 fix(utils.py): add new error string to context window exception mapping 2024-06-20 12:01:11 -07:00
Krrish Dholakia
a0f08e0dad fix(utils.py): allow dropping specific openai params 2024-06-20 11:48:06 -07:00
Krrish Dholakia
d6eb986b8e fix(utils.py): add together ai exception mapping 2024-06-20 11:29:57 -07:00
Krish Dholakia
71716bec48
Merge pull request #4295 from BerriAI/litellm_gemini_pricing_2 
Vertex AI - character based cost calculation
 2024-06-19 19:17:09 -07:00
Krrish Dholakia
682ec33aa0 fix(litellm_logging.py): initialize global variables 
Fixes https://github.com/BerriAI/litellm/issues/4281
 2024-06-19 18:39:45 -07:00
Krrish Dholakia
16da21e839 feat(llm_cost_calc/google.py): do character based cost calculation for vertex ai 
Calculate cost for vertex ai responses using characters in query/response

 Closes https://github.com/BerriAI/litellm/issues/4165
 2024-06-19 17:18:42 -07:00
Ishaan Jaff
3c6785c207 add ft:gpt4 2024-06-19 16:49:45 -07:00
Ishaan Jaff
8c07f3edf4 fix remove get_or_generate_uuid 2024-06-19 14:10:35 -07:00
Ishaan Jaff
f5ebc1a042
Merge pull request #4282 from BerriAI/litellm_add_openrouter_exception_mapping 
feat - add open router exception mapping
 2024-06-19 12:25:12 -07:00
Krish Dholakia
3a3b3667ee
Merge branch 'main' into litellm_aws_kms_fixes 2024-06-19 09:30:54 -07:00
Ishaan Jaff
5982fd88f9 feat - add open router exception mapping 2024-06-19 08:40:08 -07:00
Tom Usher
17482ded74 Return output_vector_size in get_model_info 2024-06-19 14:09:20 +01:00
Krish Dholakia
0c2c02ba8d
Merge pull request #4266 from BerriAI/litellm_gemini_image_url 
Support 'image url' to vertex ai / google ai studio gemini models
 2024-06-18 20:39:25 -07:00
Krish Dholakia
d96ffe8075
Merge pull request #4271 from BerriAI/litellm_vertex_httpx_fix 
fix(vertex_httpx.py): Correctly handle Vertex content policy violation error
 2024-06-18 20:19:46 -07:00
Ishaan Jaff
a26a023ff8 fix - log langfuse prompt 2024-06-18 19:25:51 -07:00
Krrish Dholakia
f41c443abb fix(vertex_httpx.py): re-raise vertex content policy violation error 
Fixes https://github.com/BerriAI/litellm/issues/4270
 2024-06-18 19:00:35 -07:00
Ishaan Jaff
2d15a3c586 fix - mock completion request 2024-06-18 17:08:54 -07:00
Krrish Dholakia
5ad095ad9d fix(openai.py): deepinfra function calling - drop_params support for unsupported tool choice value 2024-06-18 16:19:57 -07:00
Krrish Dholakia
3f7252c422 fix(support-passing-image-url-to-gemini-via-vertex-ai): Closes https://github.com/BerriAI/litellm/issues/4262 2024-06-18 10:55:58 -07:00
Ishaan Jaff
8f3bd0780b fix exception mapping for vertex ai 2024-06-18 08:38:36 -07:00
Krish Dholakia
63216f42b8
Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 19:50:56 -07:00
Ishaan Jaff
c93463b535 fix maintain older usage of logfire 2024-06-17 19:42:39 -07:00
Ishaan Jaff
4a75e57b6f fix logfire 2024-06-17 19:21:35 -07:00
Krrish Dholakia
fca2ffb480 fix(utils.py): return cost above 128k from get_model_info 2024-06-17 19:15:02 -07:00
Krrish Dholakia
3d9ef689e7 fix(vertex_httpx.py): check if model supports system messages before sending separately 2024-06-17 17:32:38 -07:00
Krish Dholakia
a80520004e
Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 17:28:50 -07:00
Ishaan Jaff
fc23399b6f
Merge pull request #4247 from BerriAI/litellm_add_codestral_fim 
[Feat] Add Codestral FIM API
 2024-06-17 16:35:47 -07:00
Krish Dholakia
02d9d96141
Merge pull request #4245 from BerriAI/litellm_gemini_pricing_token_counter 
VertexAI/Gemini: Calculate cost based on context window
 2024-06-17 16:35:23 -07:00
Ishaan Jaff
2ce032405d test - codestral streaming 2024-06-17 14:17:25 -07:00
Ishaan Jaff
364492297d feat - add fim codestral api 2024-06-17 13:46:03 -07:00
Krrish Dholakia
be66800a98 feat(main.py): initial commit - refactoring google ai studio to just use vertex httpx 
Uses the same calling logic for google ai studio/vertex ai. Simplifies logic, gives google ai studio integration all of vertex
ai features.
 2024-06-17 13:31:46 -07:00
Ishaan Jaff
ad47fee181 feat add text completion config for mistral text 2024-06-17 12:48:46 -07:00
Krish Dholakia
fcea4c22ad
Merge pull request #4228 from CodeVigilanteOfficial/fix_rce_eval 
Update utils.py (fix dangerous code)
 2024-06-17 12:43:29 -07:00
Krrish Dholakia
f597aa432b feat(cost_calculator.py): add cost calculating for dynamic context window (vertex ai / google ai studio) 2024-06-17 12:38:10 -07:00
Ishaan Jaff
5f76f96e4d working chat, text for codestral 2024-06-17 11:30:22 -07:00