Krrish Dholakia
4055381cdb
fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
...
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-22 21:26:15 -07:00
Krish Dholakia
fa2d8bc794
Merge pull request #4216 from BerriAI/litellm_refactor_logging
...
refactor(utils.py): Cut down utils.py to <10k lines.
2024-06-15 15:19:42 -07:00
Krrish Dholakia
9d7f5d503c
refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
...
Easier debugging
Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Ishaan Jaff
113b7e34ce
refactor to use _get_async_httpx_client
2024-06-14 21:30:42 -07:00
Ishaan Jaff
8669a0e0be
fix cached httpx client
2024-06-14 21:23:13 -07:00
Ishaan Jaff
d19efd62cf
fix async client
2024-06-14 21:12:32 -07:00
David Manouchehri
0a07b26b74
fix(bedrock_httpx.py): Add IAM caching for converse flow.
2024-06-11 17:00:18 +00:00
David Manouchehri
de5b85f309
fix(bedrock_httpx.py): Fix STS region endpoint for converse flow.
2024-06-11 16:35:03 +00:00
David Manouchehri
20e8df66bd
fix(bedrock_httpx.py): Fix STS region endpoint.
2024-06-11 15:43:33 +00:00
David Manouchehri
6fa14f9ff2
feat(bedrock_httpx.py): Add AWS IAM cred caching for OIDC flow.
2024-06-11 15:43:15 +00:00
Krrish Dholakia
5056fd5778
fix(bedrock_httpx.py): returning correct finish reason on streaming completion
2024-06-10 14:47:49 -07:00
Krrish Dholakia
2d95eaa5bc
fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
...
Fixes https://github.com/BerriAI/litellm/issues/4091
2024-06-10 14:20:25 -07:00
Krrish Dholakia
cbd39d665d
fix(bedrock_httpx.py): fix post call success logging
2024-06-07 14:47:01 -07:00
Krrish Dholakia
672dcf0c6f
fix(factory.py): handle bedrock claude image url's
2024-06-07 10:04:03 -07:00
Krrish Dholakia
778eed3115
fix(bedrock_httpx.py): fix linting errors
2024-06-07 09:01:19 -07:00
Krrish Dholakia
12ed3dc911
refactor(main.py): only route anthropic calls through converse api
...
v0 scope let's move function calling to converse api
2024-06-07 08:47:51 -07:00
Krrish Dholakia
c41b60f6bf
feat(bedrock_httpx.py): working bedrock converse api streaming
2024-06-06 22:13:21 -07:00
Krrish Dholakia
f8b5aa3df6
fix(bedrock_httpx.py): working claude 3 function calling
2024-06-06 20:12:41 -07:00
Krrish Dholakia
96b556f385
feat(bedrock_httpx.py): add support for bedrock converse api
...
closes https://github.com/BerriAI/litellm/issues/4000
2024-06-05 21:20:36 -07:00
uid10804
7858999941
fix(bedrock): raise internal error response
2024-06-03 22:02:10 +02:00
Krish Dholakia
f2ca86b0e7
Merge pull request #3944 from BerriAI/litellm_fix_parallel_streaming
...
fix: fix streaming with httpx client
2024-05-31 21:42:37 -07:00
Krish Dholakia
addf8751a2
Merge pull request #3939 from pharindoko/main
...
fix(bedrock): convert botocore credentials when role is assumed
2024-05-31 18:46:15 -07:00
Krrish Dholakia
3896e3e88f
fix: fix streaming with httpx client
...
prevent overwriting streams in parallel streaming calls
2024-05-31 10:55:18 -07:00
uid10804
559e825e2f
refactor(bedrock_httpx): change botocore reference
2024-05-31 16:57:28 +02:00
David Manouchehri
13fed93dd1
fix(bedrock_httpx.py): Fix OIDC support.
2024-05-31 12:44:52 +00:00
David Manouchehri
4e57637669
feat (bedrock_httpx.py): Add OIDC support for Amazon Bedrock with httpx.
2024-05-31 12:44:50 +00:00
uid10804
df8043bac9
fix: add botocore credentials extraction and conversion
...
The code changes in `bedrock_httpx.py` add functionality to extract and convert AWS STS credentials to session credentials using botocore. This fixes later error in add_auth request when token needs to be assigned.
2024-05-31 12:02:34 +02:00
Krrish Dholakia
68a8b23b59
fix(bedrock_httpx.py): fix bedrock ptu model id str encoding
...
Fixes https://github.com/BerriAI/litellm/issues/3805
2024-05-25 10:54:01 -07:00
Krrish Dholakia
8288a3fe83
fix(bedrock_httpx.py): support 'modelId' param for bedrock ptu's
...
Fixes https://github.com/BerriAI/litellm/issues/3805
2024-05-24 22:55:55 -07:00
Krrish Dholakia
b20f4f65b4
fix(bedrock_httpx.py): raise better timeout exception
2024-05-17 17:16:36 -07:00
Krrish Dholakia
56084d5ac1
fix(bedrock_httpx.py): support mapping for bedrock cohere command r text
2024-05-17 16:13:49 -07:00
Krrish Dholakia
2e0c0a0cc3
fix(bedrock_httpx.py): fix bedrock logging
2024-05-16 23:53:54 -07:00
Krrish Dholakia
be8f2dd909
fix(bedrock_httpx.py): logging fixes
2024-05-16 23:20:51 -07:00
Krrish Dholakia
13e4196e3e
fix(bedrock_httpx.py): add async support for bedrock amazon, meta, mistral models
2024-05-16 22:39:25 -07:00
Krrish Dholakia
8409b39f0d
fix(bedrock_httpx.py): move bedrock ai21 calls to being async
2024-05-16 22:21:30 -07:00
Krrish Dholakia
118fc4ffac
fix(bedrock_httpx.py): move anthropic bedrock calls to httpx
...
Fixing https://github.com/BerriAI/litellm/issues/2921
2024-05-16 21:51:55 -07:00
Krrish Dholakia
8592a73881
fix(bedrock_httpx.py): compatibility fix
2024-05-11 19:55:38 -07:00
Krrish Dholakia
68596ced04
feat(bedrock_httpx.py): working bedrock command-r sync+async streaming
2024-05-11 19:39:51 -07:00
Krrish Dholakia
bd0c3a81cb
fix(bedrock_httpx.py): working async bedrock command r calls
2024-05-11 16:45:20 -07:00
Krrish Dholakia
5185580e3d
feat(bedrock_httpx.py): working cohere command r async calls
2024-05-11 15:04:38 -07:00
Krrish Dholakia
926b86af87
feat(bedrock_httpx.py): moves to using httpx client for bedrock cohere calls
2024-05-11 13:43:08 -07:00
