phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 11:14:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
14321 commits 2484 branches 894 tags 537 MiB
Commit graph

49 commits

Author SHA1 Message Date
Krrish Dholakia
7618ec43b3 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
David Manouchehri
9a74364baa
fix(bedrock_httpx.py): Add anthropic.claude-3-5-sonnet-20240620-v1:0 to the converse list. 2024-07-01 14:18:23 +00:00
Ishaan Jaff
46698ae01f fix param mapping for bedrock claude 2024-06-29 19:33:51 -07:00
Ishaan Jaff
f9ba3cf668 fix bedrock claude test 2024-06-29 18:46:06 -07:00
Brian Schultheiss
632b7ce17d Resolve merge conflicts 2024-06-29 15:53:02 -07:00
Krrish Dholakia
151d19960e fix(bedrock_httpx.py): Fix https://github.com/BerriAI/litellm/issues/4415 2024-06-26 16:19:46 -07:00
Brian Schultheiss
3fbb25f903 Updated more references to AWS session token 2024-06-23 13:37:38 -07:00
Brian Schultheiss
8ad1ae73e5 Support aws_session_token for bedrock client. https://github.com/BerriAI/litellm/issues/4346 2024-06-23 12:51:25 -07:00
Krrish Dholakia
cea630022e fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions 
Fixes https://github.com/BerriAI/litellm/issues/4338
 2024-06-22 21:26:15 -07:00
Krish Dholakia
f2b3770869
Merge pull request #4216 from BerriAI/litellm_refactor_logging 
refactor(utils.py): Cut down utils.py to <10k lines.
 2024-06-15 15:19:42 -07:00
Krrish Dholakia
4f91205530 refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines. 
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
 2024-06-15 10:57:20 -07:00
Ishaan Jaff
38995def54 refactor to use _get_async_httpx_client 2024-06-14 21:30:42 -07:00
Ishaan Jaff
5ea6fbbe1e fix cached httpx client 2024-06-14 21:23:13 -07:00
Ishaan Jaff
ec095a814d fix async client 2024-06-14 21:12:32 -07:00
David Manouchehri
844f15f8b0
fix(bedrock_httpx.py): Add IAM caching for converse flow. 2024-06-11 17:00:18 +00:00
David Manouchehri
9aee0b4a0f
fix(bedrock_httpx.py): Fix STS region endpoint for converse flow. 2024-06-11 16:35:03 +00:00
David Manouchehri
7faf0b9586
fix(bedrock_httpx.py): Fix STS region endpoint. 2024-06-11 15:43:33 +00:00
David Manouchehri
cd21c80a15
feat(bedrock_httpx.py): Add AWS IAM cred caching for OIDC flow. 2024-06-11 15:43:15 +00:00
Krrish Dholakia
65baa83928 fix(bedrock_httpx.py): returning correct finish reason on streaming completion 2024-06-10 14:47:49 -07:00
Krrish Dholakia
84652dd946 fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming 
Fixes https://github.com/BerriAI/litellm/issues/4091
 2024-06-10 14:20:25 -07:00
Krrish Dholakia
d16bf261a1 fix(bedrock_httpx.py): fix post call success logging 2024-06-07 14:47:01 -07:00
Krrish Dholakia
e66b3d264f fix(factory.py): handle bedrock claude image url's 2024-06-07 10:04:03 -07:00
Krrish Dholakia
7dadca6a99 fix(bedrock_httpx.py): fix linting errors 2024-06-07 09:01:19 -07:00
Krrish Dholakia
35e4323095 refactor(main.py): only route anthropic calls through converse api 
v0 scope let's move function calling to converse api
 2024-06-07 08:47:51 -07:00
Krrish Dholakia
51ba5652a0 feat(bedrock_httpx.py): working bedrock converse api streaming 2024-06-06 22:13:21 -07:00
Krrish Dholakia
a995a0b172 fix(bedrock_httpx.py): working claude 3 function calling 2024-06-06 20:12:41 -07:00
Krrish Dholakia
a76a9b7d11 feat(bedrock_httpx.py): add support for bedrock converse api 
closes https://github.com/BerriAI/litellm/issues/4000
 2024-06-05 21:20:36 -07:00
uid10804
8343906d8e fix(bedrock): raise internal error response 2024-06-03 22:02:10 +02:00
Krish Dholakia
e7ff3adc26
Merge pull request #3944 from BerriAI/litellm_fix_parallel_streaming 
fix: fix streaming with httpx client
 2024-05-31 21:42:37 -07:00
Krish Dholakia
8f87da4b20
Merge pull request #3939 from pharindoko/main 
fix(bedrock): convert botocore credentials when role is assumed
 2024-05-31 18:46:15 -07:00
Krrish Dholakia
93c3635b64 fix: fix streaming with httpx client 
prevent overwriting streams in parallel streaming calls
 2024-05-31 10:55:18 -07:00
uid10804
928efe2d87 refactor(bedrock_httpx): change botocore reference 2024-05-31 16:57:28 +02:00
David Manouchehri
0ed01f430d
fix(bedrock_httpx.py): Fix OIDC support. 2024-05-31 12:44:52 +00:00
David Manouchehri
c301d0c5ca
feat (bedrock_httpx.py): Add OIDC support for Amazon Bedrock with httpx. 2024-05-31 12:44:50 +00:00
uid10804
2f130b39c0 fix: add botocore credentials extraction and conversion 
The code changes in `bedrock_httpx.py` add functionality to extract and convert AWS STS credentials to session credentials using botocore. This fixes later error in add_auth request when token needs to be assigned.
 2024-05-31 12:02:34 +02:00
Krrish Dholakia
d2e14ca833 fix(bedrock_httpx.py): fix bedrock ptu model id str encoding 
Fixes https://github.com/BerriAI/litellm/issues/3805
 2024-05-25 10:54:01 -07:00
Krrish Dholakia
8c92508934 fix(bedrock_httpx.py): support 'modelId' param for bedrock ptu's 
Fixes https://github.com/BerriAI/litellm/issues/3805
 2024-05-24 22:55:55 -07:00
Krrish Dholakia
4682802444 fix(bedrock_httpx.py): raise better timeout exception 2024-05-17 17:16:36 -07:00
Krrish Dholakia
5d24a72b7e fix(bedrock_httpx.py): support mapping for bedrock cohere command r text 2024-05-17 16:13:49 -07:00
Krrish Dholakia
9aa05c19d1 fix(bedrock_httpx.py): fix bedrock logging 2024-05-16 23:53:54 -07:00
Krrish Dholakia
21f2ba6f1f fix(bedrock_httpx.py): logging fixes 2024-05-16 23:20:51 -07:00
Krrish Dholakia
92c2e2af6a fix(bedrock_httpx.py): add async support for bedrock amazon, meta, mistral models 2024-05-16 22:39:25 -07:00
Krrish Dholakia
0293f7766a fix(bedrock_httpx.py): move bedrock ai21 calls to being async 2024-05-16 22:21:30 -07:00
Krrish Dholakia
180bc46ca4 fix(bedrock_httpx.py): move anthropic bedrock calls to httpx 
Fixing https://github.com/BerriAI/litellm/issues/2921
 2024-05-16 21:51:55 -07:00
Krrish Dholakia
65d0be85fc fix(bedrock_httpx.py): compatibility fix 2024-05-11 19:55:38 -07:00
Krrish Dholakia
64650c0279 feat(bedrock_httpx.py): working bedrock command-r sync+async streaming 2024-05-11 19:39:51 -07:00
Krrish Dholakia
49ab1a1d3f fix(bedrock_httpx.py): working async bedrock command r calls 2024-05-11 16:45:20 -07:00
Krrish Dholakia
59c8c0adff feat(bedrock_httpx.py): working cohere command r async calls 2024-05-11 15:04:38 -07:00
Krrish Dholakia
4a3b084961 feat(bedrock_httpx.py): moves to using httpx client for bedrock cohere calls 2024-05-11 13:43:08 -07:00