Commit graph

45 commits

Author SHA1 Message Date
Krrish Dholakia
b838ff22d5 fix(utils.py): add exception mapping for bedrock image internal server error 2024-07-19 19:30:41 -07:00
Krrish Dholakia
fd16974996 fix(factory.py): handle message content being a list instead of string
Fixes https://github.com/BerriAI/litellm/issues/4679
2024-07-12 19:00:39 -07:00
Krrish Dholakia
4895cc7c01 fix(bedrock_httpx.py): handle user error - malformed system prompt
if user passes in system prompt as a list of content blocks, handle that
2024-07-12 08:28:50 -07:00
Krrish Dholakia
39348317d2 fix(main.py): get the region name from boto3 client if dynamic var not set 2024-07-02 09:24:07 -07:00
Ishaan Jaff
fee09a6b7f fix test test_provisioned_throughput 2024-06-29 19:41:05 -07:00
Brian Schultheiss
195cab8e07 Resolve merge conflicts 2024-06-29 15:53:02 -07:00
Krrish Dholakia
7fe4b3d8f4 fix(bedrock_httpx.py): Fix https://github.com/BerriAI/litellm/issues/4415 2024-06-26 16:19:46 -07:00
Brian Schultheiss
728e23f7c6 Update tests to verify streaming works 2024-06-25 14:33:40 -07:00
Brian Schultheiss
e405114401 added test for change 2024-06-23 15:19:54 -07:00
David Manouchehri
b0c3bd4748 Merge remote-tracking branch 'upstream/main' into oidc-bedrock-httpx-caching-part-1 2024-06-11 15:42:31 +00:00
Krrish Dholakia
672dcf0c6f fix(factory.py): handle bedrock claude image url's 2024-06-07 10:04:03 -07:00
David Manouchehri
516c9026d5 test(test_bedrock_completion.py): Add tests to ensure caching isn't breaking anything. 2024-06-01 15:22:08 +00:00
David Manouchehri
3ba7f2d931 Fix: Use David's AWS account to pass unit tests. 2024-05-31 13:50:49 +00:00
David Manouchehri
83cc226369 Add unit test for bedrock httpx oidc auth. 2024-05-31 12:44:53 +00:00
Krrish Dholakia
4aa7e0b17c fix(main.py): pass extra headers through for async calls 2024-05-27 19:11:40 -07:00
Krrish Dholakia
0d3867ea5c test(test_bedrock_completion.py): refactor test bedrock headers test 2024-05-27 19:01:07 -07:00
Krrish Dholakia
68a8b23b59 fix(bedrock_httpx.py): fix bedrock ptu model id str encoding
Fixes https://github.com/BerriAI/litellm/issues/3805
2024-05-25 10:54:01 -07:00
Krrish Dholakia
1a9e4d99ac fix(bedrock_httpx.py): support bedrock ptu's
Fixes https://github.com/BerriAI/litellm/issues/3805
2024-05-24 23:02:04 -07:00
Ishaan Jaff
bac23e43a6 fix test - retry claude-3 image error 3 times 2024-05-20 16:17:09 -07:00
Ishaan Jaff
e79a7c50d1 Update test_bedrock_completion.py
cc @Manouchehri - can u lmk what needs to be in our env to pass this test ? 

attaching the test log here: cda0de1d-3851-469c-8851-ef12dc27fab2/jobs/20819/tests#failed-test-0
2024-05-11 16:30:29 -07:00
David Manouchehri
47449d19e8 feat(bedrock.py): Support using OIDC tokens. 2024-05-07 15:46:54 +00:00
Lucca Zenóbio
146a49103f Merge branch 'main' into main 2024-05-06 09:40:23 -03:00
Krrish Dholakia
8f22092c65 fix(bedrock.py): map finish reason for bedrock 2024-05-04 12:45:40 -07:00
Lucca Zenobio
5d20b9d7d6 test 2024-04-29 10:05:30 -03:00
Nilanjan De
8163d9d0a8 add test 2024-04-19 00:42:48 +04:00
Ishaan Jaff
b00ad976af fix function calling prompt - ask llm to respond in fahrenheit 2024-04-16 21:09:53 -07:00
Krrish Dholakia
47b2b0df17 fix(bedrock.py): fix supported openai params for bedrock claude 3 2024-03-23 16:02:15 -07:00
Krrish Dholakia
f0a5e0ffe9 fix(bedrock.py): working image calls to claude 3 2024-03-04 18:12:47 -08:00
Krrish Dholakia
dc1f347a63 fix(bedrock.py): support bedrock anthropic claude 3 tool calling 2024-03-04 17:47:28 -08:00
Krrish Dholakia
dad65ca602 fix(bedrock.py): support anthropic messages api on bedrock (claude-3) 2024-03-04 17:15:47 -08:00
Tim Xia
5b63ba6aa5 comment out tests 2024-03-01 23:28:25 -05:00
Tim Xia
291aa4f6d0 add assertion for test 2024-03-01 23:27:02 -05:00
Tim Xia
8a0385a51b skip test but it did work locally 2024-03-01 22:49:31 -05:00
Tim Xia
6f389097d2 add support for bedrock mistral models 2024-03-01 22:45:54 -05:00
Krrish Dholakia
267d365067 test: skip aws test - aws account suspended 2024-02-28 14:27:01 -08:00
Krrish Dholakia
129e84f0c5 test: removing aws tests - account suspended - pending their approval 2024-02-28 13:46:20 -08:00
Krrish Dholakia
666ce22bce refactor(test_bedrock_completion.py): clean test 2024-02-28 13:26:08 -08:00
Krrish Dholakia
1a7d6cefcc test: skip test with expired token 2024-02-28 13:13:59 -08:00
Krrish Dholakia
d4404fb61e fix(utils.py): fix if check 2024-01-17 17:17:58 -08:00
Krrish Dholakia
01a5e80df5 fix(utils.py): allow dynamically setting boto3 init and switching between bedrock and openai 2024-01-17 15:56:30 -08:00
Krrish Dholakia
cc89aa7456 fix(bedrock.py): add support for sts based boto3 initialization
https://github.com/BerriAI/litellm/issues/1476
2024-01-17 12:08:59 -08:00
ishaan-jaff
6bb7f4b5c3 (test) provisioned throughput model 2024-01-13 15:56:24 -08:00
ishaan-jaff
c7e09ded9a (test) bedrock provisioned througput 2024-01-13 15:40:30 -08:00
spdustin@gmail.com
6520d153e7 Update factory (and tests) for Claude 2.1 via Bedrock 2024-01-05 23:32:32 +00:00
ishaan-jaff
163b78fef1 (test) bedrock-test passing boto3 client 2024-01-02 10:23:28 +05:30