Krrish Dholakia
4b5cf26c1b
fix(utils.py): handle gemini chunk no parts error
...
Fixes https://github.com/BerriAI/litellm/issues/3468
2024-05-06 10:59:53 -07:00
Simon Sanchez Viloria
6181d1eaad
Merge branch 'main' into feature/watsonx-integration
2024-05-06 17:27:14 +02:00
Simon Sanchez Viloria
83a274b54b
(feat) support for async stream to watsonx provider
2024-05-06 17:08:40 +02:00
Krrish Dholakia
b5f3f198f2
fix(utils.py): anthropic error handling
2024-05-06 07:25:12 -07:00
Alex Epstein
b82162832a
Update support for langfuse metadata
...
- Added ability to set trace release, version, metadata
- Added ability to update fields during a trace continuation
- Added ability to update input and output during a trace continuation
- Wrote new test for verifying metadata is set correctly
- Small improvement to setting secret boolean, prevent unnecessary literal_eval
- Small improvements to langfuse tests
2024-05-05 14:56:36 -04:00
Ishaan Jaff
5be8c95c6e
fix don't return num retries in utils.py
2024-05-04 19:07:28 -07:00
Ishaan Jaff
0f03e53348
feat return num retries in exceptions
2024-05-04 18:50:38 -07:00
Ishaan Jaff
855c7caf0b
fix add get_first_chars_messages in utils
2024-05-04 12:43:09 -07:00
Ishaan Jaff
c6beaf53af
litellm map Azure GPT ContentPolicyViolationError
2024-05-04 11:14:47 -07:00
Sebastián Estévez
fc0ced48c1
add_function_to_prompt bug fix
...
This blows up when there's no "functions" in the dictionary even when tools is present because the inner function executes regardless (does not short circuit).
2024-05-03 23:38:54 -04:00
Krish Dholakia
7d2aa2f645
Merge pull request #3433 from BerriAI/litellm_timeout_fix
...
fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
2024-05-03 18:53:59 -07:00
Krrish Dholakia
097714e02f
fix(anthropic.py): handle whitespace characters for anthropic calls
2024-05-03 17:31:34 -07:00
Krrish Dholakia
f7eee60943
docs(exception_mapping.md): update exception mapping docs with 'should_retry'
2024-05-03 16:51:26 -07:00
Ishaan Jaff
5e6b6c41c4
Merge pull request #3432 from BerriAI/litellm_add_bedrock_titan_embed
...
Feat - add bedrock titan embed-v2
2024-05-03 16:28:12 -07:00
Krrish Dholakia
a732d8772a
fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
...
Closes https://github.com/BerriAI/litellm/issues/3398
2024-05-03 16:24:21 -07:00
Ishaan Jaff
401bf8d67e
test - bedrock v2 supports dimension
2024-05-03 16:23:37 -07:00
Ishaan Jaff
4a39b95acc
fix - support dimension for titan embed v2
2024-05-03 16:13:27 -07:00
Krrish Dholakia
5b39f8e282
feat(proxy_server.py): return api base in response headers
...
Closes https://github.com/BerriAI/litellm/issues/2631
2024-05-03 15:27:32 -07:00
Krrish Dholakia
2dd9d2f704
test(test_amazing_vertex_completion.py): try-except api errors
2024-05-03 10:09:57 -07:00
mogith-pn
723ef9963e
Clarifai - Added streaming and async completion support
2024-05-03 14:03:38 +00:00
Krish Dholakia
2200900ca2
Merge pull request #3393 from Priva28/main
...
Add Llama3 tokenizer and allow custom tokenizers.
2024-05-02 16:32:41 -07:00
Ishaan Jaff
7ffe410097
Merge pull request #3392 from BerriAI/litellm_fix_langfuse_reinitalized
...
[Fix] bug where langfuse was reinitialized on every call
2024-05-02 10:54:47 -07:00
Krrish Dholakia
18cb0bc530
fix(utils.py): revert pydantic object changes
2024-05-02 08:14:45 -07:00
Krrish Dholakia
16522a5351
fix(utils.py): add missing providers + models to validate_environment
...
Closes https://github.com/BerriAI/litellm/issues/3190
2024-05-02 08:14:45 -07:00
Krrish Dholakia
caf19478af
fix(utils.py): fix pydantic object default values
2024-05-01 22:51:46 -07:00
Christian Privitelli
2d43153efa
include methods in init import, add test, fix encode/decode param ordering
2024-05-02 15:49:22 +10:00
Krrish Dholakia
29aefaa7d7
fix(utils.py): fix default values
2024-05-01 22:24:37 -07:00
Christian Privitelli
3449a5e446
update docs, allow use with encode/decode
2024-05-02 14:56:38 +10:00
Krish Dholakia
24fc934622
Merge pull request #3379 from elisalimli/main
...
[chore] Improve type-safety in Message & Delta classes
2024-05-01 21:19:52 -07:00
Krrish Dholakia
cdd3e1eef3
build(ui): enable adding openmeter via proxy ui
2024-05-01 21:16:23 -07:00
Christian Privitelli
b4d4b42cfa
fix docs
2024-05-02 14:11:03 +10:00
Christian Privitelli
2fd2e811fd
add llama3 tokenizer and support for custom tokenizer
2024-05-02 14:05:38 +10:00
Ishaan Jaff
8a3d8f8ee4
fix bug where langfuse was reinitialized
2024-05-01 20:47:25 -07:00
Krrish Dholakia
2a9651b3ca
feat(openmeter.py): add support for user billing
...
open-meter supports user based billing. Closes https://github.com/BerriAI/litellm/issues/1268
2024-05-01 17:23:48 -07:00
Krrish Dholakia
37eb7910d2
fix(utils.py): fix azure streaming content filter error chunk
2024-05-01 13:45:50 -07:00
Ishaan Jaff
b3161bb20b
Merge pull request #3384 from BerriAI/litellm_fix_details_to
...
fix - error sending details to log on sentry
2024-05-01 11:44:54 -07:00
Ishaan Jaff
8e75d07bd0
fix - error seeing details to log on sentry
2024-05-01 11:43:14 -07:00
Krrish Dholakia
608fef60a6
fix(utils.py): check if response_object["choices"] is not none and iterable
2024-05-01 11:08:44 -07:00
Krrish Dholakia
e96ccb8edf
fix(utils.py): return received args for invalid model response object error
...
Addresses https://github.com/BerriAI/litellm/issues/3381
2024-05-01 10:47:26 -07:00
alisalim17
81ad331d92
set default tool calls and function call
2024-05-01 17:01:45 +04:00
alisalim17
20a796bacb
add tool_calls attribute to Message and Delta classes in order to improve type-safety
2024-05-01 13:47:01 +04:00
Krrish Dholakia
3cc82f558e
fix(utils.py): add exception mapping for gemini error
2024-04-30 14:17:10 -07:00
Krrish Dholakia
b46db8b891
feat(utils.py): json logs for raw request sent by litellm
...
make it easier to view verbose logs in datadog
2024-04-29 19:21:19 -07:00
Krish Dholakia
ec2510029a
Merge pull request #3354 from BerriAI/litellm_replicate_cost_tracking
...
fix(utils.py): replicate now also has token based pricing for some models
2024-04-29 09:13:41 -07:00
Krrish Dholakia
3725732c4d
fix(utils.py): default to time-based tracking for unmapped replicate models. fix time-based cost calc for replicate
2024-04-29 08:36:01 -07:00
Krrish Dholakia
a18844b230
fix(utils.py): use llama tokenizer for replicate models
2024-04-29 08:28:31 -07:00
Krrish Dholakia
ab954243e8
fix(utils.py): fix watson streaming
2024-04-29 08:09:59 -07:00
Krrish Dholakia
2cfb97141d
fix(utils.py): replicate now also has token based pricing for some models
2024-04-29 08:06:15 -07:00
Krish Dholakia
1841b74f49
Merge branch 'main' into litellm_common_auth_params
2024-04-28 08:38:06 -07:00
Krrish Dholakia
5f0f3f9fe3
fix(utils.py): don't return usage for streaming - openai spec
2024-04-27 14:13:34 -07:00
