Commit graph

1490 commits

Author SHA1 Message Date
Ishaan Jaff
855c7caf0b fix add get_first_chars_messages in utils 2024-05-04 12:43:09 -07:00
Ishaan Jaff
c6beaf53af litellm map Azure GPT ContentPolicyViolationError 2024-05-04 11:14:47 -07:00
alisalim17
978912ef32 feat: add failure handler for logfire 2024-05-04 17:40:23 +04:00
alisalim17
39099e9c5b feat: add logfire integration 2024-05-04 16:22:53 +04:00
Sebastián Estévez
fc0ced48c1
add_function_to_prompt bug fix
This blows up when there's no "functions" in the dictionary even when tools is present because the inner function executes regardless (does not short circuit).
2024-05-03 23:38:54 -04:00
Krish Dholakia
7d2aa2f645
Merge pull request #3433 from BerriAI/litellm_timeout_fix
fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
2024-05-03 18:53:59 -07:00
Krrish Dholakia
097714e02f fix(anthropic.py): handle whitespace characters for anthropic calls 2024-05-03 17:31:34 -07:00
Krrish Dholakia
f7eee60943 docs(exception_mapping.md): update exception mapping docs with 'should_retry' 2024-05-03 16:51:26 -07:00
Ishaan Jaff
5e6b6c41c4
Merge pull request #3432 from BerriAI/litellm_add_bedrock_titan_embed
Feat - add bedrock titan embed-v2
2024-05-03 16:28:12 -07:00
Krrish Dholakia
a732d8772a fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
Closes https://github.com/BerriAI/litellm/issues/3398
2024-05-03 16:24:21 -07:00
Ishaan Jaff
401bf8d67e test - bedrock v2 supports dimension 2024-05-03 16:23:37 -07:00
Ishaan Jaff
4a39b95acc fix - support dimension for titan embed v2 2024-05-03 16:13:27 -07:00
Krrish Dholakia
5b39f8e282 feat(proxy_server.py): return api base in response headers
Closes https://github.com/BerriAI/litellm/issues/2631
2024-05-03 15:27:32 -07:00
Krrish Dholakia
2dd9d2f704 test(test_amazing_vertex_completion.py): try-except api errors 2024-05-03 10:09:57 -07:00
mogith-pn
723ef9963e Clarifai - Added streaming and async completion support 2024-05-03 14:03:38 +00:00
Krish Dholakia
2200900ca2
Merge pull request #3393 from Priva28/main
Add Llama3 tokenizer and allow custom tokenizers.
2024-05-02 16:32:41 -07:00
Ishaan Jaff
7ffe410097
Merge pull request #3392 from BerriAI/litellm_fix_langfuse_reinitalized
[Fix] bug where langfuse was reinitialized on every call
2024-05-02 10:54:47 -07:00
Krrish Dholakia
18cb0bc530 fix(utils.py): revert pydantic object changes 2024-05-02 08:14:45 -07:00
Krrish Dholakia
16522a5351 fix(utils.py): add missing providers + models to validate_environment
Closes https://github.com/BerriAI/litellm/issues/3190
2024-05-02 08:14:45 -07:00
Krrish Dholakia
caf19478af fix(utils.py): fix pydantic object default values 2024-05-01 22:51:46 -07:00
Christian Privitelli
2d43153efa include methods in init import, add test, fix encode/decode param ordering 2024-05-02 15:49:22 +10:00
Krrish Dholakia
29aefaa7d7 fix(utils.py): fix default values 2024-05-01 22:24:37 -07:00
Christian Privitelli
3449a5e446 update docs, allow use with encode/decode 2024-05-02 14:56:38 +10:00
Krish Dholakia
24fc934622
Merge pull request #3379 from elisalimli/main
[chore] Improve type-safety in Message & Delta classes
2024-05-01 21:19:52 -07:00
Krrish Dholakia
cdd3e1eef3 build(ui): enable adding openmeter via proxy ui 2024-05-01 21:16:23 -07:00
Christian Privitelli
b4d4b42cfa fix docs 2024-05-02 14:11:03 +10:00
Christian Privitelli
2fd2e811fd add llama3 tokenizer and support for custom tokenizer 2024-05-02 14:05:38 +10:00
Ishaan Jaff
8a3d8f8ee4 fix bug where langfuse was reinitialized 2024-05-01 20:47:25 -07:00
Krrish Dholakia
2a9651b3ca feat(openmeter.py): add support for user billing
open-meter supports user based billing. Closes https://github.com/BerriAI/litellm/issues/1268
2024-05-01 17:23:48 -07:00
Krrish Dholakia
37eb7910d2 fix(utils.py): fix azure streaming content filter error chunk 2024-05-01 13:45:50 -07:00
Ishaan Jaff
b3161bb20b
Merge pull request #3384 from BerriAI/litellm_fix_details_to
fix - error sending details to log on sentry
2024-05-01 11:44:54 -07:00
Ishaan Jaff
8e75d07bd0 fix - error seeing details to log on sentry 2024-05-01 11:43:14 -07:00
Krrish Dholakia
608fef60a6 fix(utils.py): check if response_object["choices"] is not none and iterable 2024-05-01 11:08:44 -07:00
Krrish Dholakia
e96ccb8edf fix(utils.py): return received args for invalid model response object error
Addresses https://github.com/BerriAI/litellm/issues/3381
2024-05-01 10:47:26 -07:00
alisalim17
81ad331d92 set default tool calls and function call 2024-05-01 17:01:45 +04:00
alisalim17
20a796bacb add tool_calls attribute to Message and Delta classes in order to improve type-safety 2024-05-01 13:47:01 +04:00
Krrish Dholakia
3cc82f558e fix(utils.py): add exception mapping for gemini error 2024-04-30 14:17:10 -07:00
Krrish Dholakia
b46db8b891 feat(utils.py): json logs for raw request sent by litellm
make it easier to view verbose logs in datadog
2024-04-29 19:21:19 -07:00
Krish Dholakia
ec2510029a
Merge pull request #3354 from BerriAI/litellm_replicate_cost_tracking
fix(utils.py): replicate now also has token based pricing for some models
2024-04-29 09:13:41 -07:00
Krrish Dholakia
3725732c4d fix(utils.py): default to time-based tracking for unmapped replicate models. fix time-based cost calc for replicate 2024-04-29 08:36:01 -07:00
Krrish Dholakia
a18844b230 fix(utils.py): use llama tokenizer for replicate models 2024-04-29 08:28:31 -07:00
Krrish Dholakia
ab954243e8 fix(utils.py): fix watson streaming 2024-04-29 08:09:59 -07:00
Krrish Dholakia
2cfb97141d fix(utils.py): replicate now also has token based pricing for some models 2024-04-29 08:06:15 -07:00
Krish Dholakia
1841b74f49
Merge branch 'main' into litellm_common_auth_params 2024-04-28 08:38:06 -07:00
Krrish Dholakia
5f0f3f9fe3 fix(utils.py): don't return usage for streaming - openai spec 2024-04-27 14:13:34 -07:00
Ishaan Jaff
6762d07c7f
Merge pull request #3330 from BerriAI/litellm_rdct_msgs
[Feat] Redact Logging Messages/Response content on Logging Providers with `litellm.turn_off_message_logging=True`
2024-04-27 11:25:09 -07:00
Ishaan Jaff
4ce27e1219 fix - sentry data redaction 2024-04-27 11:23:08 -07:00
Krrish Dholakia
48f19cf839 feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx 2024-04-27 11:06:18 -07:00
Ishaan Jaff
b2111a97e2 fix use redact_message_input_output_from_logging 2024-04-27 10:51:17 -07:00
Ishaan Jaff
10da35675f feat- turn off message logging 2024-04-27 10:03:07 -07:00