Commit graph

86 commits

Author SHA1 Message Date
Zihao Li
f16d0c06fd Add backward compatibility to support xml tool use for bedrock and vertex 2024-04-06 00:34:33 +08:00
jdhuang
b6f98e408f Add sync iterator 2024-04-02 20:14:37 +08:00
Krrish Dholakia
49642a5b00 fix(factory.py): parse list in xml tool calling response (anthropic)
improves tool calling outparsing to check if list in response. Also returns the raw response back to the user via `response._hidden_params["original_response"]`, so user can see exactly what anthropic returned
2024-03-29 11:51:26 -07:00
Rob Mann
e80aae5c30 Updating the default Claude3 max tokens 2024-03-26 11:46:59 -04:00
Krrish Dholakia
2fabff06c0 fix(bedrock.py): fix supported openai params for bedrock claude 3 2024-03-23 16:02:15 -07:00
Krrish Dholakia
94f55aa6d9 fix(bedrock.py): support claude 3 function calling when stream=true
https://github.com/BerriAI/litellm/issues/2615
2024-03-21 18:39:03 -07:00
garfeildma
45d31e33aa support multiple system message tranlation for bedrock claude-3 2024-03-18 19:41:15 +08:00
Krrish Dholakia
f7cf90a636 fix(bedrock.py): add all supported bedrock / anthropic messages api params 2024-03-15 09:41:40 -07:00
Krrish Dholakia
8b24ddcbbd fix(bedrock.py): enable claude-3 streaming 2024-03-09 14:02:27 -08:00
ishaan-jaff
c6e6afd125 (fix) bug importing litellm 2024-03-05 18:41:39 -08:00
Krrish Dholakia
c6d7234c97 fix(bedrock.py): fix conditional 2024-03-04 21:46:00 -08:00
Krrish Dholakia
0f62213656 fix(utils.py): fix default message object values 2024-03-04 21:19:03 -08:00
Krrish Dholakia
caa17d484a fix(bedrock.py): working image calls to claude 3 2024-03-04 18:12:47 -08:00
Krrish Dholakia
478307d4cf fix(bedrock.py): support anthropic messages api on bedrock (claude-3) 2024-03-04 17:15:47 -08:00
Krrish Dholakia
0ac652a771 fix(bedrock.py): add claude 3 support 2024-03-04 17:15:47 -08:00
Tim Xia
67110df3e1 change to snake case 'cause of aws docs 2024-03-02 00:07:21 -05:00
Tim Xia
2c97b952ea follow camelcase convention 2024-03-01 23:58:03 -05:00
Tim Xia
b4dc7f0f17 Add AmazonMistralConfig 2024-03-01 23:14:00 -05:00
Tim Xia
739f4f05f6 add support for bedrock mistral models 2024-03-01 22:45:54 -05:00
Krrish Dholakia
cb5a13ed49 fix(bedrock.py): fix amazon titan prompt formatting 2024-02-13 22:02:25 -08:00
ishaan-jaff
896fd393db (feat) support bedrock timeout 2024-02-09 14:36:43 -08:00
Krrish Dholakia
841639333b fix(bedrock.py): raise exception for amazon titan null response 2024-02-08 21:12:25 -08:00
David Leen
140d915adf Add support for AWS credentials from profile file
https://boto3.amazonaws.com/v1/documentation/api/latest/guide/credentials.html#aws-config-file
2024-02-08 15:10:50 -08:00
Krrish Dholakia
36416360c4 feat(bedrock.py): add stable diffusion image generation support 2024-02-03 12:08:38 -08:00
ishaan-jaff
f941c57688 (fix) use isinstance to check types 2024-01-30 08:31:21 -08:00
ishaan-jaff
b9a117fa1d (feat) Bedrock embedding - raise correct exception BadRequest 2024-01-30 08:14:35 -08:00
Krrish Dholakia
f5da95685a feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given 2024-01-26 14:53:58 -08:00
Krrish Dholakia
8e9dc09955 fix(bedrock.py): add support for sts based boto3 initialization
https://github.com/BerriAI/litellm/issues/1476
2024-01-17 12:08:59 -08:00
ishaan-jaff
069d060ec9 (feat) provisioned throughput - bedrock embedding models 2024-01-13 21:07:38 -08:00
ishaan-jaff
5e03c9c637 (feat) bedrock support provisioned throughput 2024-01-13 15:39:54 -08:00
Krish Dholakia
554080804f
Merge pull request #1429 from dleen/data
[bug] unbound variable in bedrock
2024-01-12 22:16:11 +05:30
David Leen
a674de8f36 improve bedrock exception granularity 2024-01-12 16:38:55 +01:00
David Leen
8b021fc4cd [bug] unbound variable in bedrock
note: the code was written as `json.dumps({})` even though it is more verbose in order to facilitate easier refactoring in the future

fixes #1428
2024-01-12 12:33:00 +01:00
ishaan-jaff
a9d812eb8d (fix) bedrock - embedding - support str input 2024-01-11 23:02:12 +05:30
ishaan-jaff
a876748bf5 v0 2024-01-11 22:56:18 +05:30
ishaan-jaff
d1e8d13c4f (fix) init_bedrock_client 2024-01-01 22:48:56 +05:30
Krrish Dholakia
4905929de3 refactor: add black formatting 2023-12-25 14:11:20 +05:30
David Manouchehri
93c4556eb0
Add aws_bedrock_runtime_endpoint support. 2023-12-20 19:31:43 -05:00
Krrish Dholakia
804d58eb20 bump: version 1.14.4 → 1.14.5.dev1 2023-12-14 15:23:52 -08:00
Krrish Dholakia
ad39afc0ad test(test_custom_callback_input.py): embedding callback tests for azure, openai, bedrock 2023-12-11 15:32:46 -08:00
Krrish Dholakia
b09ecb986e test(test_custom_callback_input.py): add bedrock testing
n

n
2023-12-11 13:00:01 -08:00
Krrish Dholakia
c1e95740b0 fix(bedrock.py): fix output format for cohere embeddings 2023-12-06 22:47:01 -08:00
Krrish Dholakia
f1c1ec8523 fix(bedrock.py): fix embeddings call 2023-12-06 14:16:00 -08:00
Krrish Dholakia
b24c9b4cbf refactor: fix linting 2023-12-06 13:27:40 -08:00
Krrish Dholakia
d962d5d4c0 fix(bedrock.py): adding support for cohere embeddings 2023-12-06 13:25:18 -08:00
Krrish Dholakia
ab76daa90b fix(bedrock.py): support ai21 / bedrock streaming 2023-11-29 16:35:06 -08:00
ishaan-jaff
26938f697e (feat) completion:debugging - show raw POST request 2023-11-27 10:13:37 -08:00
Krish Dholakia
e4f1e2b138
Merge pull request #845 from canada4663/upstream-main
Added support for multiple embeddings via Bedrock
2023-11-21 14:00:06 -08:00
ishaan-jaff
50f883a2fb (fix) pydantic errors with response.time 2023-11-20 18:28:19 -08:00
canada4663
74ed37c4f2 bedrock embedding changes pre-testing 2023-11-18 21:00:06 -08:00