Commit graph

1681 commits

Author SHA1 Message Date
Ishaan Jaff
f09158504b feat - support vertex ai dimensions 2024-06-12 09:29:51 -07:00
Ishaan Jaff
5ebeb4d067 ci/cd fix predibase 500 errors 2024-06-11 23:15:48 -07:00
Krish Dholakia
029d32344f
Merge pull request #4137 from jamesbraza/custom-llm-provider
Allowing inference of LLM provider in `get_supported_openai_params`
2024-06-11 18:38:42 -07:00
James Braza
ef6e920161 Added handling of unmapped provider, with test 2024-06-11 18:34:10 -07:00
Krish Dholakia
7c23077a71
Merge pull request #4119 from BerriAI/litellm_tiktoken_bump
feat(utils.py): bump tiktoken dependency to 0.7.0 (gpt-4o token counting support)
2024-06-11 18:24:58 -07:00
James Braza
cb5456c9f5 Allowing inferring custom LLM provider from model inside get_supported_openai_params 2024-06-11 18:16:19 -07:00
Krrish Dholakia
a9cbf2209c fix(utils.py): support dynamic api key for azure_ai route 2024-06-11 17:51:29 -07:00
Krrish Dholakia
9c7788ae48 fix(utils.py): fix formatting 2024-06-11 15:49:20 -07:00
Krrish Dholakia
88e567af2c fix(utils.py): add new 'azure_ai/' route
supports azure's openai compatible api endpoint
2024-06-11 14:06:56 -07:00
Krrish Dholakia
7eae0ff7e3 fix(utils.py): allow user to opt in to raw request logging to langfuse 2024-06-11 13:35:22 -07:00
David Manouchehri
a31fa5fbc8
feat(util.py/azure.py): Add OIDC support when running in Azure Kubernetes Service (AKS). 2024-06-11 15:54:34 +00:00
wslee
18cc703aa2 change friendli_ai -> friendliai 2024-06-11 16:17:30 +09:00
Krrish Dholakia
2e49614230 fix(utils.py): exception map vertex ai 500 internal server errors 2024-06-10 21:37:54 -07:00
Krrish Dholakia
b756374a4f feat(utils.py): bump tiktoken dependency to 0.7.0
adds support for gpt-4o token counting
2024-06-10 21:21:23 -07:00
Krish Dholakia
8379d58318
Merge pull request #4106 from BerriAI/litellm_anthropic_bedrock_tool_calling_fix
fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
2024-06-10 20:21:16 -07:00
Krish Dholakia
4475d2e5b5
Merge branch 'main' into litellm_aws_kms_fixes 2024-06-10 20:17:34 -07:00
Krrish Dholakia
e6c96aa950 fix(utils.py): fix tgai timeout exception mapping + skip flaky test 2024-06-10 19:50:16 -07:00
Krrish Dholakia
622858e37c fix(utils.py): handle together ai timeout exception 2024-06-10 17:54:57 -07:00
Krrish Dholakia
8f140cb5ee fix(utils.py): make sure redis caching works with aws kms encryption 2024-06-10 16:42:19 -07:00
Krrish Dholakia
e4dbb9b2db fix(proxy_cli.py): support passing the database url as an encrypted kms key 2024-06-10 15:48:27 -07:00
Krrish Dholakia
65baa83928 fix(bedrock_httpx.py): returning correct finish reason on streaming completion 2024-06-10 14:47:49 -07:00
Krrish Dholakia
84652dd946 fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
Fixes https://github.com/BerriAI/litellm/issues/4091
2024-06-10 14:20:25 -07:00
wslee
fe8d59f5eb add friendli_ai provider 2024-06-10 17:27:15 +09:00
Ishaan Jaff
39bbc5d8ac
Merge pull request #4086 from BerriAI/litellm_sdk_tool_calling_fic
[Fix] Litellm sdk - allow ChatCompletionMessageToolCall, and Function to be used as dict
2024-06-08 20:48:54 -07:00
Krish Dholakia
b4fc4abb76
Merge pull request #4080 from BerriAI/litellm_predibase_exception_mapping
fix(utils.py): improved predibase exception mapping
2024-06-08 20:27:44 -07:00
Ishaan Jaff
0253c2b213 feat - allow ChatCompletionMessageToolCall, and Function to be used as dict 2024-06-08 19:47:31 -07:00
Krrish Dholakia
b26c3c7d22 fix(cost_calculator.py): fixes tgai unmapped model pricing
Fixes error where tgai helper function returned None. Enforces stronger type hints, refactors code, adds more unit testing.
2024-06-08 19:43:57 -07:00
Krrish Dholakia
1dafb1b3b7 fix(utils.py): improved predibase exception mapping
adds unit testing + better coverage for predibase errors
2024-06-08 14:32:43 -07:00
Krrish Dholakia
93a3a0cc1e fix(utils.py): fix helicone success logging integration
Fixes https://github.com/BerriAI/litellm/issues/4062
2024-06-08 08:59:56 -07:00
Ishaan Jaff
366fc5e40b fix - vertex ai exception mapping 2024-06-07 18:16:26 -07:00
Ishaan Jaff
d5e97861ee fix vertex ai exceptions 2024-06-07 17:13:32 -07:00
Ishaan Jaff
718b547646
Merge branch 'main' into litellm_security_fix 2024-06-07 16:52:25 -07:00
Krrish Dholakia
5c46b386d0 fix(utils.py): fix vertex ai exception mapping 2024-06-07 16:06:31 -07:00
Krrish Dholakia
f73b6033fd fix(test_custom_callbacks_input.py): unit tests for 'turn_off_message_logging'
ensure no raw request is logged either
2024-06-07 15:39:15 -07:00
Ishaan Jaff
d9dacc1f43
Merge pull request #4065 from BerriAI/litellm_use_common_func
[Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`
2024-06-07 14:02:17 -07:00
Ishaan Jaff
2cf3133669
Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
7ef7bc8a9a fix simplify - pass litellm_parent_otel_span 2024-06-07 13:48:21 -07:00
Ishaan Jaff
d2857fc24c
Merge branch 'main' into litellm_redact_messages_slack_alerting 2024-06-07 12:43:53 -07:00
Krrish Dholakia
e66b3d264f fix(factory.py): handle bedrock claude image url's 2024-06-07 10:04:03 -07:00
Ishaan Jaff
54ac848bfb use litellm_parent_otel_span as litellm_param 2024-06-07 08:54:28 -07:00
Krish Dholakia
26993c067e
Merge branch 'main' into litellm_bedrock_converse_api 2024-06-07 08:49:52 -07:00
Krish Dholakia
f6a262122b
Merge pull request #4054 from BerriAI/litellm_aws_kms_support
feat(aws_secret_manager.py): Support AWS KMS for Master Key encrption
2024-06-07 08:49:25 -07:00
Krrish Dholakia
35e4323095 refactor(main.py): only route anthropic calls through converse api
v0 scope let's move function calling to converse api
2024-06-07 08:47:51 -07:00
Krish Dholakia
471be6670c
Merge pull request #4049 from BerriAI/litellm_cleanup_traceback
refactor: replace 'traceback.print_exc()' with logging library
2024-06-07 08:03:22 -07:00
Krish Dholakia
b6e0bf27b8
Merge branch 'main' into litellm_aws_kms_support 2024-06-07 07:58:56 -07:00
Krrish Dholakia
51ba5652a0 feat(bedrock_httpx.py): working bedrock converse api streaming 2024-06-06 22:13:21 -07:00
Krrish Dholakia
a995a0b172 fix(bedrock_httpx.py): working claude 3 function calling 2024-06-06 20:12:41 -07:00
Krrish Dholakia
6e9bca59b0 fix(utils.py): fix exception mapping for azure internal server error 2024-06-06 17:12:30 -07:00
Krish Dholakia
1742141fb6
Merge pull request #4046 from BerriAI/litellm_router_order
feat(router.py): enable settting 'order' for a deployment in model list
2024-06-06 16:37:03 -07:00
Krish Dholakia
677e0255c8
Merge branch 'main' into litellm_cleanup_traceback 2024-06-06 16:32:08 -07:00