Commit graph

3040 commits

Author SHA1 Message Date
Krrish Dholakia
2e49614230 fix(utils.py): exception map vertex ai 500 internal server errors 2024-06-10 21:37:54 -07:00
Ishaan Jaff
86971c76a1
Merge pull request #4116 from BerriAI/litellm_show_model_group_in_exceptions
fix - show `model group` in  Azure ContentPolicy exceptions
2024-06-10 20:53:53 -07:00
Ishaan Jaff
b4db464604 fix - show model group in exceptions 2024-06-10 20:30:31 -07:00
Krish Dholakia
55a20c7cce
Merge pull request #4084 from BerriAI/litellm_batch_add_team_members
fix(proxy_server.py): allow passing in a list of team members
2024-06-10 20:26:35 -07:00
Krish Dholakia
8379d58318
Merge pull request #4106 from BerriAI/litellm_anthropic_bedrock_tool_calling_fix
fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
2024-06-10 20:21:16 -07:00
Krrish Dholakia
82149b8cf4 test(test_text_completion.py): skip unstable test 2024-06-10 19:45:24 -07:00
Ishaan Jaff
dfe874c9e5 test - client side fallbacks 2024-06-10 15:00:36 -07:00
Krrish Dholakia
65baa83928 fix(bedrock_httpx.py): returning correct finish reason on streaming completion 2024-06-10 14:47:49 -07:00
Krrish Dholakia
84652dd946 fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
Fixes https://github.com/BerriAI/litellm/issues/4091
2024-06-10 14:20:25 -07:00
Ishaan Jaff
a27f7e2817 feat - log exceptions to OTEL 2024-06-10 12:34:18 -07:00
Ishaan Jaff
d5a1cc282e test fix - cohere API Made a breaking change 2024-06-10 09:36:46 -07:00
Krrish Dholakia
d066e0e152 fix(proxy/_types.py): fix validation check 2024-06-08 22:56:56 -07:00
Krish Dholakia
90ae7f040a
Merge pull request #4087 from BerriAI/litellm_update_together_ai_pricing
Update together ai pricing
2024-06-08 22:07:12 -07:00
Ishaan Jaff
78dbb15ccd ci/cd run again 2024-06-08 21:05:35 -07:00
Krish Dholakia
b4fc4abb76
Merge pull request #4080 from BerriAI/litellm_predibase_exception_mapping
fix(utils.py): improved predibase exception mapping
2024-06-08 20:27:44 -07:00
Krish Dholakia
e42198f87c
Merge pull request #4085 from BerriAI/litellm_fix_tgai_unmapped_model
fix(cost_calculator.py): fixes tgai unmapped model pricing
2024-06-08 20:27:26 -07:00
Krrish Dholakia
6306914e56 fix(types/router.py): modelgroupinfo to handle mode being None and supported_openai_params not being a list 2024-06-08 20:13:45 -07:00
Krrish Dholakia
f3a845eff9 build(model_prices_and_context_window.json): update together ai model pricing - account for new categories 2024-06-08 19:56:35 -07:00
Krrish Dholakia
b26c3c7d22 fix(cost_calculator.py): fixes tgai unmapped model pricing
Fixes error where tgai helper function returned None. Enforces stronger type hints, refactors code, adds more unit testing.
2024-06-08 19:43:57 -07:00
Ishaan Jaff
b56fa0e5c4 fix OTEL test 2024-06-08 19:43:03 -07:00
Ishaan Jaff
03dcf366a1 fix test otel logger 2024-06-08 18:24:00 -07:00
Ishaan Jaff
2d618087bf test_otel_callback 2024-06-08 15:24:14 -07:00
Krrish Dholakia
1dafb1b3b7 fix(utils.py): improved predibase exception mapping
adds unit testing + better coverage for predibase errors
2024-06-08 14:32:43 -07:00
Ishaan Jaff
47f1e16533 otel test - callbacks 2024-06-08 14:16:51 -07:00
Krrish Dholakia
93a3a0cc1e fix(utils.py): fix helicone success logging integration
Fixes https://github.com/BerriAI/litellm/issues/4062
2024-06-08 08:59:56 -07:00
Ishaan Jaff
c5a611ca91 (ci/cd) run again 2024-06-07 19:12:04 -07:00
Ishaan Jaff
f69c2591b2 fix - redacted by litellm test 2024-06-07 17:02:21 -07:00
Ishaan Jaff
718b547646
Merge branch 'main' into litellm_security_fix 2024-06-07 16:52:25 -07:00
Krrish Dholakia
beddb58852 test(test_custom_callback_input.py): fix custom callback input test 2024-06-07 16:13:30 -07:00
Krrish Dholakia
f73b6033fd fix(test_custom_callbacks_input.py): unit tests for 'turn_off_message_logging'
ensure no raw request is logged either
2024-06-07 15:39:15 -07:00
Ishaan Jaff
7dcf8fc67e fix test litellm_parent_otel_span 2024-06-07 14:07:58 -07:00
Ishaan Jaff
d9dacc1f43
Merge pull request #4065 from BerriAI/litellm_use_common_func
[Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`
2024-06-07 14:02:17 -07:00
Ishaan Jaff
2cf3133669
Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
7ef7bc8a9a fix simplify - pass litellm_parent_otel_span 2024-06-07 13:48:21 -07:00
Krrish Dholakia
b41d7f5d51 fix(proxy/utils.py): security fix
use typed dict for spendlogs payload. assert no sensitive information logged.
2024-06-07 13:44:11 -07:00
Ishaan Jaff
2287f383a1 test fix 2024-06-07 13:31:18 -07:00
Ishaan Jaff
630bc803e2 fix proxy server test 2024-06-07 12:54:39 -07:00
Krish Dholakia
6b703f0ebf
Merge pull request #4033 from BerriAI/litellm_bedrock_converse_api
feat(bedrock_httpx.py): add support for bedrock converse api
2024-06-07 12:08:10 -07:00
Krrish Dholakia
7d2230bd7f test(test_prompt_factory.py): cleanup test 2024-06-07 12:07:15 -07:00
Ishaan Jaff
923cbed6ab test fix - proxy server chat completion 2024-06-07 11:53:03 -07:00
Krrish Dholakia
6024f9e45e test(test_lowest_latency_routing.py): add time.sleep to reduce test flakiness 2024-06-07 11:28:33 -07:00
Ishaan Jaff
02b5c03739 (ci/cd) use ruff 2024-06-07 10:07:48 -07:00
Krrish Dholakia
e66b3d264f fix(factory.py): handle bedrock claude image url's 2024-06-07 10:04:03 -07:00
Krrish Dholakia
21f4329b65 feat(test_completion.py): deduplicate kwarg 2024-06-07 09:13:38 -07:00
Krrish Dholakia
6a52e63e21 test(test_completion.py): fix kwarg repetition 2024-06-07 09:06:48 -07:00
Ishaan Jaff
7b1047bd1f
Merge pull request #4043 from BerriAI/litellm_enforce_params
[Feat] Enterprise - Enforce Params in request to LiteLLM Proxy
2024-06-07 08:52:46 -07:00
Krish Dholakia
26993c067e
Merge branch 'main' into litellm_bedrock_converse_api 2024-06-07 08:49:52 -07:00
Krish Dholakia
f6a262122b
Merge pull request #4054 from BerriAI/litellm_aws_kms_support
feat(aws_secret_manager.py): Support AWS KMS for Master Key encrption
2024-06-07 08:49:25 -07:00
Krrish Dholakia
35e4323095 refactor(main.py): only route anthropic calls through converse api
v0 scope let's move function calling to converse api
2024-06-07 08:47:51 -07:00
Krish Dholakia
471be6670c
Merge pull request #4049 from BerriAI/litellm_cleanup_traceback
refactor: replace 'traceback.print_exc()' with logging library
2024-06-07 08:03:22 -07:00