phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
14667 commits 2497 branches 897 tags 550 MiB
Commit graph

54 commits

Author SHA1 Message Date
Ishaan Jaff
954410de64 fix exception raised in factory.py 2024-07-13 09:54:32 -07:00
Krrish Dholakia
4895cc7c01 fix(bedrock_httpx.py): handle user error - malformed system prompt 
if user passes in system prompt as a list of content blocks, handle that
 2024-07-12 08:28:50 -07:00
Krrish Dholakia
c69193c321 fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
Ishaan Jaff
a94be8b616 fix test_bedrock_httpx_streaming 2024-07-10 17:14:53 -07:00
Ishaan Jaff
0b0aa7c3cd fix bedrock better debugging for credentials 2024-07-09 22:02:17 -07:00
Krrish Dholakia
56410cfcd0 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
David Manouchehri
7aac8d1d94 fix(bedrock_httpx.py): Add anthropic.claude-3-5-sonnet-20240620-v1:0 to the converse list. 2024-07-01 14:18:23 +00:00
Ishaan Jaff
05fd6965a3 fix param mapping for bedrock claude 2024-06-29 19:33:51 -07:00
Ishaan Jaff
695fb5118c fix bedrock claude test 2024-06-29 18:46:06 -07:00
Brian Schultheiss
195cab8e07 Resolve merge conflicts 2024-06-29 15:53:02 -07:00
Krrish Dholakia
7fe4b3d8f4 fix(bedrock_httpx.py): Fix https://github.com/BerriAI/litellm/issues/4415 2024-06-26 16:19:46 -07:00
Brian Schultheiss
02d40207fb Updated more references to AWS session token 2024-06-23 13:37:38 -07:00
Brian Schultheiss
d6925b40fe Support aws_session_token for bedrock client. https://github.com/BerriAI/litellm/issues/4346 2024-06-23 12:51:25 -07:00
Krrish Dholakia
4055381cdb fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions 
Fixes https://github.com/BerriAI/litellm/issues/4338
 2024-06-22 21:26:15 -07:00
Krish Dholakia
fa2d8bc794 Merge pull request #4216 from BerriAI/litellm_refactor_logging 
refactor(utils.py): Cut down utils.py to <10k lines.
 2024-06-15 15:19:42 -07:00
Krrish Dholakia
9d7f5d503c refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines. 
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
 2024-06-15 10:57:20 -07:00
Ishaan Jaff
113b7e34ce refactor to use _get_async_httpx_client 2024-06-14 21:30:42 -07:00
Ishaan Jaff
8669a0e0be fix cached httpx client 2024-06-14 21:23:13 -07:00
Ishaan Jaff
d19efd62cf fix async client 2024-06-14 21:12:32 -07:00
David Manouchehri
0a07b26b74 fix(bedrock_httpx.py): Add IAM caching for converse flow. 2024-06-11 17:00:18 +00:00
David Manouchehri
de5b85f309 fix(bedrock_httpx.py): Fix STS region endpoint for converse flow. 2024-06-11 16:35:03 +00:00
David Manouchehri
20e8df66bd fix(bedrock_httpx.py): Fix STS region endpoint. 2024-06-11 15:43:33 +00:00
David Manouchehri
6fa14f9ff2 feat(bedrock_httpx.py): Add AWS IAM cred caching for OIDC flow. 2024-06-11 15:43:15 +00:00
Krrish Dholakia
5056fd5778 fix(bedrock_httpx.py): returning correct finish reason on streaming completion 2024-06-10 14:47:49 -07:00
Krrish Dholakia
2d95eaa5bc fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming 
Fixes https://github.com/BerriAI/litellm/issues/4091
 2024-06-10 14:20:25 -07:00
Krrish Dholakia
cbd39d665d fix(bedrock_httpx.py): fix post call success logging 2024-06-07 14:47:01 -07:00
Krrish Dholakia
672dcf0c6f fix(factory.py): handle bedrock claude image url's 2024-06-07 10:04:03 -07:00
Krrish Dholakia
778eed3115 fix(bedrock_httpx.py): fix linting errors 2024-06-07 09:01:19 -07:00
Krrish Dholakia
12ed3dc911 refactor(main.py): only route anthropic calls through converse api 
v0 scope let's move function calling to converse api
 2024-06-07 08:47:51 -07:00
Krrish Dholakia
c41b60f6bf feat(bedrock_httpx.py): working bedrock converse api streaming 2024-06-06 22:13:21 -07:00
Krrish Dholakia
f8b5aa3df6 fix(bedrock_httpx.py): working claude 3 function calling 2024-06-06 20:12:41 -07:00
Krrish Dholakia
96b556f385 feat(bedrock_httpx.py): add support for bedrock converse api 
closes https://github.com/BerriAI/litellm/issues/4000
 2024-06-05 21:20:36 -07:00
uid10804
7858999941 fix(bedrock): raise internal error response 2024-06-03 22:02:10 +02:00
Krish Dholakia
f2ca86b0e7 Merge pull request #3944 from BerriAI/litellm_fix_parallel_streaming 
fix: fix streaming with httpx client
 2024-05-31 21:42:37 -07:00
Krish Dholakia
addf8751a2 Merge pull request #3939 from pharindoko/main 
fix(bedrock): convert botocore credentials when role is assumed
 2024-05-31 18:46:15 -07:00
Krrish Dholakia
3896e3e88f fix: fix streaming with httpx client 
prevent overwriting streams in parallel streaming calls
 2024-05-31 10:55:18 -07:00
uid10804
559e825e2f refactor(bedrock_httpx): change botocore reference 2024-05-31 16:57:28 +02:00
David Manouchehri
13fed93dd1 fix(bedrock_httpx.py): Fix OIDC support. 2024-05-31 12:44:52 +00:00
David Manouchehri
4e57637669 feat (bedrock_httpx.py): Add OIDC support for Amazon Bedrock with httpx. 2024-05-31 12:44:50 +00:00
uid10804
df8043bac9 fix: add botocore credentials extraction and conversion 
The code changes in `bedrock_httpx.py` add functionality to extract and convert AWS STS credentials to session credentials using botocore. This fixes later error in add_auth request when token needs to be assigned.
 2024-05-31 12:02:34 +02:00
Krrish Dholakia
68a8b23b59 fix(bedrock_httpx.py): fix bedrock ptu model id str encoding 
Fixes https://github.com/BerriAI/litellm/issues/3805
 2024-05-25 10:54:01 -07:00
Krrish Dholakia
8288a3fe83 fix(bedrock_httpx.py): support 'modelId' param for bedrock ptu's 
Fixes https://github.com/BerriAI/litellm/issues/3805
 2024-05-24 22:55:55 -07:00
Krrish Dholakia
b20f4f65b4 fix(bedrock_httpx.py): raise better timeout exception 2024-05-17 17:16:36 -07:00
Krrish Dholakia
56084d5ac1 fix(bedrock_httpx.py): support mapping for bedrock cohere command r text 2024-05-17 16:13:49 -07:00
Krrish Dholakia
2e0c0a0cc3 fix(bedrock_httpx.py): fix bedrock logging 2024-05-16 23:53:54 -07:00
Krrish Dholakia
be8f2dd909 fix(bedrock_httpx.py): logging fixes 2024-05-16 23:20:51 -07:00
Krrish Dholakia
13e4196e3e fix(bedrock_httpx.py): add async support for bedrock amazon, meta, mistral models 2024-05-16 22:39:25 -07:00
Krrish Dholakia
8409b39f0d fix(bedrock_httpx.py): move bedrock ai21 calls to being async 2024-05-16 22:21:30 -07:00
Krrish Dholakia
118fc4ffac fix(bedrock_httpx.py): move anthropic bedrock calls to httpx 
Fixing https://github.com/BerriAI/litellm/issues/2921
 2024-05-16 21:51:55 -07:00
Krrish Dholakia
8592a73881 fix(bedrock_httpx.py): compatibility fix 2024-05-11 19:55:38 -07:00