phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
15182 commits 2490 branches 894 tags 548 MiB
Commit graph

63 commits

Author SHA1 Message Date
Krish Dholakia
b6ca4406b6
Merge branch 'main' into bedrock-llama3.1-405b 2024-07-25 19:29:10 -07:00
David Manouchehri
22c66991ed
Support tool calling for Llama 3.1 on Amazon bedrock. 2024-07-25 20:36:25 +00:00
David Manouchehri
5c4ee3ef3c
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock. 2024-07-25 20:04:03 +00:00
David Manouchehri
3293ad7458
Add Llama 3.1 405b for Bedrock 2024-07-25 19:30:13 +00:00
Krrish Dholakia
99d8b0ad68 fix(bedrock_httpx.py): fix async client check 2024-07-24 12:43:52 -07:00
David Manouchehri
609075bd17
Add Llama 3.1 for Bedrock. 2024-07-24 05:48:23 +00:00
Krrish Dholakia
96471c145e fix(bedrock_httpx.py): support jamba streaming 2024-07-18 19:36:50 -07:00
Krrish Dholakia
cece76c4ee feat(bedrock_httpx.py): add ai21 jamba instruct as converse model 
initial commit for adding ai21 jamba instruct support through bedrock converse
 2024-07-18 18:24:06 -07:00
Krrish Dholakia
e3ca2789df fix(bedrock_httpx.py): cache response stream shape 
Fixes https://github.com/BerriAI/litellm/issues/4774
 2024-07-18 17:41:31 -07:00
Ishaan Jaff
03933de775 fix exception raised in factory.py 2024-07-13 09:54:32 -07:00
Krrish Dholakia
88eb25da5c fix(bedrock_httpx.py): handle user error - malformed system prompt 
if user passes in system prompt as a list of content blocks, handle that
 2024-07-12 08:28:50 -07:00
Krrish Dholakia
6e9f048618 fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
Ishaan Jaff
7efe9beac5 fix test_bedrock_httpx_streaming 2024-07-10 17:14:53 -07:00
Ishaan Jaff
78e67f36e7 fix bedrock better debugging for credentials 2024-07-09 22:02:17 -07:00
Krrish Dholakia
7618ec43b3 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
David Manouchehri
9a74364baa
fix(bedrock_httpx.py): Add anthropic.claude-3-5-sonnet-20240620-v1:0 to the converse list. 2024-07-01 14:18:23 +00:00
Ishaan Jaff
46698ae01f fix param mapping for bedrock claude 2024-06-29 19:33:51 -07:00
Ishaan Jaff
f9ba3cf668 fix bedrock claude test 2024-06-29 18:46:06 -07:00
Brian Schultheiss
632b7ce17d Resolve merge conflicts 2024-06-29 15:53:02 -07:00
Krrish Dholakia
151d19960e fix(bedrock_httpx.py): Fix https://github.com/BerriAI/litellm/issues/4415 2024-06-26 16:19:46 -07:00
Brian Schultheiss
3fbb25f903 Updated more references to AWS session token 2024-06-23 13:37:38 -07:00
Brian Schultheiss
8ad1ae73e5 Support aws_session_token for bedrock client. https://github.com/BerriAI/litellm/issues/4346 2024-06-23 12:51:25 -07:00
Krrish Dholakia
cea630022e fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions 
Fixes https://github.com/BerriAI/litellm/issues/4338
 2024-06-22 21:26:15 -07:00
Krish Dholakia
f2b3770869
Merge pull request #4216 from BerriAI/litellm_refactor_logging 
refactor(utils.py): Cut down utils.py to <10k lines.
 2024-06-15 15:19:42 -07:00
Krrish Dholakia
4f91205530 refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines. 
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
 2024-06-15 10:57:20 -07:00
Ishaan Jaff
38995def54 refactor to use _get_async_httpx_client 2024-06-14 21:30:42 -07:00
Ishaan Jaff
5ea6fbbe1e fix cached httpx client 2024-06-14 21:23:13 -07:00
Ishaan Jaff
ec095a814d fix async client 2024-06-14 21:12:32 -07:00
David Manouchehri
844f15f8b0
fix(bedrock_httpx.py): Add IAM caching for converse flow. 2024-06-11 17:00:18 +00:00
David Manouchehri
9aee0b4a0f
fix(bedrock_httpx.py): Fix STS region endpoint for converse flow. 2024-06-11 16:35:03 +00:00
David Manouchehri
7faf0b9586
fix(bedrock_httpx.py): Fix STS region endpoint. 2024-06-11 15:43:33 +00:00
David Manouchehri
cd21c80a15
feat(bedrock_httpx.py): Add AWS IAM cred caching for OIDC flow. 2024-06-11 15:43:15 +00:00
Krrish Dholakia
65baa83928 fix(bedrock_httpx.py): returning correct finish reason on streaming completion 2024-06-10 14:47:49 -07:00
Krrish Dholakia
84652dd946 fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming 
Fixes https://github.com/BerriAI/litellm/issues/4091
 2024-06-10 14:20:25 -07:00
Krrish Dholakia
d16bf261a1 fix(bedrock_httpx.py): fix post call success logging 2024-06-07 14:47:01 -07:00
Krrish Dholakia
e66b3d264f fix(factory.py): handle bedrock claude image url's 2024-06-07 10:04:03 -07:00
Krrish Dholakia
7dadca6a99 fix(bedrock_httpx.py): fix linting errors 2024-06-07 09:01:19 -07:00
Krrish Dholakia
35e4323095 refactor(main.py): only route anthropic calls through converse api 
v0 scope let's move function calling to converse api
 2024-06-07 08:47:51 -07:00
Krrish Dholakia
51ba5652a0 feat(bedrock_httpx.py): working bedrock converse api streaming 2024-06-06 22:13:21 -07:00
Krrish Dholakia
a995a0b172 fix(bedrock_httpx.py): working claude 3 function calling 2024-06-06 20:12:41 -07:00
Krrish Dholakia
a76a9b7d11 feat(bedrock_httpx.py): add support for bedrock converse api 
closes https://github.com/BerriAI/litellm/issues/4000
 2024-06-05 21:20:36 -07:00
uid10804
8343906d8e fix(bedrock): raise internal error response 2024-06-03 22:02:10 +02:00
Krish Dholakia
e7ff3adc26
Merge pull request #3944 from BerriAI/litellm_fix_parallel_streaming 
fix: fix streaming with httpx client
 2024-05-31 21:42:37 -07:00
Krish Dholakia
8f87da4b20
Merge pull request #3939 from pharindoko/main 
fix(bedrock): convert botocore credentials when role is assumed
 2024-05-31 18:46:15 -07:00
Krrish Dholakia
93c3635b64 fix: fix streaming with httpx client 
prevent overwriting streams in parallel streaming calls
 2024-05-31 10:55:18 -07:00
uid10804
928efe2d87 refactor(bedrock_httpx): change botocore reference 2024-05-31 16:57:28 +02:00
David Manouchehri
0ed01f430d
fix(bedrock_httpx.py): Fix OIDC support. 2024-05-31 12:44:52 +00:00
David Manouchehri
c301d0c5ca
feat (bedrock_httpx.py): Add OIDC support for Amazon Bedrock with httpx. 2024-05-31 12:44:50 +00:00
uid10804
2f130b39c0 fix: add botocore credentials extraction and conversion 
The code changes in `bedrock_httpx.py` add functionality to extract and convert AWS STS credentials to session credentials using botocore. This fixes later error in add_auth request when token needs to be assigned.
 2024-05-31 12:02:34 +02:00
Krrish Dholakia
d2e14ca833 fix(bedrock_httpx.py): fix bedrock ptu model id str encoding 
Fixes https://github.com/BerriAI/litellm/issues/3805
 2024-05-25 10:54:01 -07:00