phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
11363 commits 1603 branches 645 tags 320 MiB
Commit graph

1344 commits

Author SHA1 Message Date
Ishaan Jaff
6762d07c7f
Merge pull request #3330 from BerriAI/litellm_rdct_msgs 
[Feat] Redact Logging Messages/Response content on Logging Providers with `litellm.turn_off_message_logging=True`
 2024-04-27 11:25:09 -07:00
Ishaan Jaff
4ce27e1219 fix - sentry data redaction 2024-04-27 11:23:08 -07:00
Krrish Dholakia
48f19cf839 feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx 2024-04-27 11:06:18 -07:00
Ishaan Jaff
b2111a97e2 fix use redact_message_input_output_from_logging 2024-04-27 10:51:17 -07:00
Ishaan Jaff
10da35675f feat- turn off message logging 2024-04-27 10:03:07 -07:00
Tejas Ravishankar
8ff9555bcf
fix: duplicate mention of VERTEXAI_PROJECT environment variable causing confusion 2024-04-27 17:47:28 +04:00
Krish Dholakia
2d976cfabc
Merge pull request #3270 from simonsanvil/feature/watsonx-integration 
(feat) add IBM watsonx.ai as an llm provider
 2024-04-27 05:48:34 -07:00
Krrish Dholakia
9eb75cc159 test(test_streaming.py): fix test 2024-04-25 20:22:18 -07:00
Krrish Dholakia
486c8ccc30 fix(utils.py): handle pydantic v1 2024-04-25 20:01:36 -07:00
Krrish Dholakia
850b056df5 fix(utils.py): add more logging to identify ci/cd issue 2024-04-25 19:57:24 -07:00
Krish Dholakia
40b6b4794b
Merge pull request #3310 from BerriAI/litellm_langfuse_error_logging_2 
fix(proxy/utils.py): log rejected proxy requests to langfuse
 2024-04-25 19:49:59 -07:00
Krrish Dholakia
885de2e3c6 fix(proxy/utils.py): log rejected proxy requests to langfuse 2024-04-25 19:26:27 -07:00
Krish Dholakia
69280177a3
Merge pull request #3308 from BerriAI/litellm_fix_streaming_n 
fix(utils.py): fix the response object returned when n>1 for stream=true
 2024-04-25 18:36:54 -07:00
Krrish Dholakia
86a3d24d75 fix(utils.py): pass through 'response_format' for mistral 2024-04-25 18:27:41 -07:00
Krrish Dholakia
1ebc7bb3b7 fix(utils.py): handle finish reason logic 2024-04-25 18:18:00 -07:00
Krrish Dholakia
9f5ba67f5d fix(utils.py): return logprobs as an object not dict 2024-04-25 17:55:18 -07:00
Krrish Dholakia
6c5c7cca3d fix(utils.py): fix the response object returned when n>1 for stream=true 
Fixes https://github.com/BerriAI/litellm/issues/3276
 2024-04-25 13:27:29 -07:00
Krish Dholakia
435a4b5ed4
Merge pull request #3267 from BerriAI/litellm_openai_streaming_fix 
fix(utils.py): fix streaming to not return usage dict
 2024-04-24 21:08:33 -07:00
Krrish Dholakia
dacadbf624 fix(utils.py): fix anthropic streaming return usage tokens 2024-04-24 20:56:10 -07:00
Krrish Dholakia
495aebb582 fix(utils.py): fix setattr error 2024-04-24 20:19:27 -07:00
Ishaan Jaff
ca4fd85296 fix show api_base, model in timeout errors 2024-04-24 14:01:32 -07:00
Krish Dholakia
263439ee4a
Merge pull request #3098 from greenscale-ai/main 
Support for Greenscale AI logging
 2024-04-24 13:09:03 -07:00
Krrish Dholakia
b918f58262 fix(vertex_ai.py): raise explicit error when image url fails to download - prevents silent failure 2024-04-24 09:23:15 -07:00
Krrish Dholakia
48c2c3d78a fix(utils.py): fix streaming to not return usage dict 
Fixes https://github.com/BerriAI/litellm/issues/3237
 2024-04-24 08:06:07 -07:00
Krrish Dholakia
ab24f61099 fix(utils.py): fix mistral api tool calling response 2024-04-23 19:59:11 -07:00
Krish Dholakia
4acdde988f
Merge pull request #3250 from BerriAI/litellm_caching_no_cache_fix 
fix(utils.py): fix 'no-cache': true when caching is turned on
 2024-04-23 19:57:07 -07:00
Krrish Dholakia
d67e47d7fd fix(test_caching.py): add longer delay for async test 2024-04-23 16:13:03 -07:00
David Manouchehri
69ddd7c68f
(utils.py) - Add seed for Groq 2024-04-23 20:32:21 +00:00
Krrish Dholakia
161e836427 fix(utils.py): fix 'no-cache': true when caching is turned on 2024-04-23 12:58:30 -07:00
Simon S. Viloria
2ef4fb2efa
Merge branch 'BerriAI:main' into feature/watsonx-integration 2024-04-23 12:18:34 +02:00
Simon Sanchez Viloria
74d2ba0a23 feat - watsonx refractoring, removed dependency, and added support for embedding calls 2024-04-23 12:01:13 +02:00
David Manouchehri
6d61607ee3
(utils.py) - Fix response_format typo for Groq 2024-04-23 04:26:26 +00:00
Krrish Dholakia
be4a3de27c fix(utils.py): support deepinfra response object 2024-04-22 10:51:11 -07:00
Simon S. Viloria
a77537ddd4
Merge branch 'BerriAI:main' into feature/watsonx-integration 2024-04-21 10:35:51 +02:00
Krish Dholakia
fcde3ba213
Merge pull request #3192 from BerriAI/litellm_calculate_max_parallel_requests 
fix(router.py): Make TPM limits concurrency-safe
 2024-04-20 13:24:29 -07:00
Krrish Dholakia
0f69f0b44e test(test_router_max_parallel_requests.py): more extensive testing for setting max parallel requests 2024-04-20 12:56:54 -07:00
Simon S. Viloria
7b2bd2e0e8
Merge branch 'BerriAI:main' into feature/watsonx-integration 2024-04-20 21:02:54 +02:00
Krrish Dholakia
33d828a0ed fix(utils.py): map vertex ai exceptions - rate limit error 2024-04-20 11:12:05 -07:00
Simon Sanchez Viloria
6edb133733 Added support for IBM watsonx.ai models 2024-04-20 20:06:46 +02:00
Krrish Dholakia
4c78f8f309 fix(router.py): calculate max_parallel_requests from given tpm limits 
use the azure formula to calculate rpm -> max_parallel_requests based on a deployment's tpm limits
 2024-04-20 10:43:18 -07:00
Ishaan Jaff
63805873e7 fix - supports_vision should not raise Exception 2024-04-19 21:19:07 -07:00
Ishaan Jaff
01b1136631 fix - GetLLMProvider excepton error raise 2024-04-18 20:10:37 -07:00
David Manouchehri
f65c02d43a
(feat) - Add seed to Cohere Chat. 2024-04-18 20:57:06 +00:00
Ishaan Jaff
f610061a79
Merge pull request #3130 from BerriAI/litellm_show_vertex_project_exceptions 
[FIX] -  show vertex_project, vertex_location in Vertex AI exceptions
 2024-04-18 13:18:20 -07:00
Ishaan Jaff
930f8712e4 fix - track vertex_location and vertex_project in vertex exceptions 2024-04-18 12:53:33 -07:00
Krrish Dholakia
28edb77350 fix(utils.py): support prometheus failed call metrics 2024-04-18 12:29:15 -07:00
Ishaan Jaff
192e0842c6 fix - show _vertex_project, _vertex_location in exceptions 2024-04-18 11:48:43 -07:00
Nandesh Guru
c8b8f93184
Merge branch 'BerriAI:main' into main 2024-04-18 09:44:31 -07:00
Krish Dholakia
91fe668411
Merge pull request #3105 from BerriAI/litellm_fix_hashing 
fix(_types.py): hash api key in UserAPIKeyAuth
 2024-04-18 08:16:24 -07:00
Krrish Dholakia
6eb8fe35c8 fix(utils.py): function_setup empty message fix 
fixes https://github.com/BerriAI/litellm/issues/2858
 2024-04-18 07:32:29 -07:00