Commit graph

3006 commits

Author SHA1 Message Date
Ishaan Jaff
2cf3133669
Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
2287f383a1 test fix 2024-06-07 13:31:18 -07:00
Ishaan Jaff
630bc803e2 fix proxy server test 2024-06-07 12:54:39 -07:00
Krish Dholakia
6b703f0ebf
Merge pull request #4033 from BerriAI/litellm_bedrock_converse_api
feat(bedrock_httpx.py): add support for bedrock converse api
2024-06-07 12:08:10 -07:00
Krrish Dholakia
7d2230bd7f test(test_prompt_factory.py): cleanup test 2024-06-07 12:07:15 -07:00
Ishaan Jaff
923cbed6ab test fix - proxy server chat completion 2024-06-07 11:53:03 -07:00
Krrish Dholakia
6024f9e45e test(test_lowest_latency_routing.py): add time.sleep to reduce test flakiness 2024-06-07 11:28:33 -07:00
Ishaan Jaff
02b5c03739 (ci/cd) use ruff 2024-06-07 10:07:48 -07:00
Krrish Dholakia
e66b3d264f fix(factory.py): handle bedrock claude image url's 2024-06-07 10:04:03 -07:00
Krrish Dholakia
21f4329b65 feat(test_completion.py): deduplicate kwarg 2024-06-07 09:13:38 -07:00
Krrish Dholakia
6a52e63e21 test(test_completion.py): fix kwarg repetition 2024-06-07 09:06:48 -07:00
Ishaan Jaff
7b1047bd1f
Merge pull request #4043 from BerriAI/litellm_enforce_params
[Feat] Enterprise - Enforce Params in request to LiteLLM Proxy
2024-06-07 08:52:46 -07:00
Krish Dholakia
26993c067e
Merge branch 'main' into litellm_bedrock_converse_api 2024-06-07 08:49:52 -07:00
Krish Dholakia
f6a262122b
Merge pull request #4054 from BerriAI/litellm_aws_kms_support
feat(aws_secret_manager.py): Support AWS KMS for Master Key encrption
2024-06-07 08:49:25 -07:00
Krrish Dholakia
35e4323095 refactor(main.py): only route anthropic calls through converse api
v0 scope let's move function calling to converse api
2024-06-07 08:47:51 -07:00
Krish Dholakia
471be6670c
Merge pull request #4049 from BerriAI/litellm_cleanup_traceback
refactor: replace 'traceback.print_exc()' with logging library
2024-06-07 08:03:22 -07:00
Krish Dholakia
b6e0bf27b8
Merge branch 'main' into litellm_aws_kms_support 2024-06-07 07:58:56 -07:00
Krrish Dholakia
ff5136f5ed test(test_completion.py): fix test to use mock response - prevent hang 2024-06-07 07:05:32 -07:00
Krrish Dholakia
ddc82774b0 test(test_completion.py): fix replicate test which was hanging 2024-06-06 22:17:30 -07:00
Krrish Dholakia
51ba5652a0 feat(bedrock_httpx.py): working bedrock converse api streaming 2024-06-06 22:13:21 -07:00
Krrish Dholakia
a995a0b172 fix(bedrock_httpx.py): working claude 3 function calling 2024-06-06 20:12:41 -07:00
Krrish Dholakia
6e9bca59b0 fix(utils.py): fix exception mapping for azure internal server error 2024-06-06 17:12:30 -07:00
Krrish Dholakia
09a471da10 test(test_assistants.py): add more error logging 2024-06-06 16:43:12 -07:00
Krish Dholakia
1742141fb6
Merge pull request #4046 from BerriAI/litellm_router_order
feat(router.py): enable settting 'order' for a deployment in model list
2024-06-06 16:37:03 -07:00
Raymond Huang
968f54a65c test 2024-06-06 10:11:27 -07:00
Krrish Dholakia
a7dcf25722 feat(router.py): enable settting 'order' for a deployment in model list
Allows user to control which model gets called first in model group
2024-06-06 09:46:51 -07:00
Ishaan Jaff
73d66e94c5 test - enforce params 2024-06-06 09:22:12 -07:00
Ishaan Jaff
2e95758ada ci/cd run again 2024-06-05 21:58:59 -07:00
Ishaan Jaff
27db329621 fix - test lowest cost routing 2024-06-05 21:42:41 -07:00
Krrish Dholakia
a76a9b7d11 feat(bedrock_httpx.py): add support for bedrock converse api
closes https://github.com/BerriAI/litellm/issues/4000
2024-06-05 21:20:36 -07:00
Krrish Dholakia
b360ab4c89 fix(azure.py): support dynamic drop params 2024-06-05 09:03:10 -07:00
Krrish Dholakia
162f9400d2 feat(utils.py): support dynamically setting 'drop_params'
Allows user to turn this on/off for individual calls by passing in as a completion arg
2024-06-05 08:44:04 -07:00
Ishaan Jaff
39f4f1728f fix ci/cd OTEL callback test 2024-06-04 21:27:34 -07:00
Krish Dholakia
c544ba3654
Merge pull request #4009 from BerriAI/litellm_fix_streaming_cost_cal
fix(utils.py): fix cost calculation for openai-compatible streaming object
2024-06-04 21:00:22 -07:00
Krish Dholakia
d6f4233441
Merge pull request #4015 from BerriAI/litellm_stream_options_fix_2
feat(utils.py): Support `stream_options` param across all providers
2024-06-04 20:59:39 -07:00
Krish Dholakia
2d9a251147
Merge pull request #4012 from BerriAI/litellm_assistants_streaming
feat(assistants/main.py): add assistants api streaming support
2024-06-04 20:58:02 -07:00
Krrish Dholakia
1a95660495 fix(test_completion.py): fix predibase test to be mock + fix optional param mapping for predibase 2024-06-04 20:06:23 -07:00
Krrish Dholakia
43af5575c8 fix(utils.py): fix 2024-06-04 19:41:20 -07:00
Krrish Dholakia
54dacfdf61 feat(utils.py): support 'stream_options' param across all providers
Closes https://github.com/BerriAI/litellm/issues/3553
2024-06-04 19:03:26 -07:00
Krrish Dholakia
9aa29854de fix(utils.py): fix stream options to return consistent response object 2024-06-04 18:17:45 -07:00
Krrish Dholakia
15b226ca4f test(test_completion_cost.py): cleanup test 2024-06-04 16:57:25 -07:00
Krrish Dholakia
650ea6d0c3 feat(assistants/main.py): support arun_thread_stream 2024-06-04 16:47:51 -07:00
Krrish Dholakia
f3d78532f9 feat(assistants/main.py): add assistants api streaming support 2024-06-04 16:30:35 -07:00
Ishaan Jaff
48f399bcc4 fix - otel logging test 2024-06-04 15:01:56 -07:00
Ishaan Jaff
8369988579 ci/cd run again 2024-06-04 14:42:27 -07:00
Ishaan Jaff
c5dd47e71b better debugging on otel callback 2024-06-04 14:41:07 -07:00
Krrish Dholakia
52a2f5150c fix(utils.py): fix cost calculation for openai-compatible streaming object 2024-06-04 10:36:25 -07:00
Ishaan Jaff
009c63f194
Merge pull request #3974 from yujonglee/simple-otel
Add simple OpenTelemetry tracer
2024-06-04 08:30:28 -07:00
Ishaan Jaff
97c82225b1 test fix - test_acompletion_caching_on_router 2024-06-04 07:55:53 -07:00
Krrish Dholakia
8625280c32 test(test_image_generation.py): fix azure dall e test 2024-06-03 23:32:19 -07:00