Commit graph

112 commits

Author SHA1 Message Date
ishaan-jaff
68553ed8dc (fix) use isinstance to check types 2024-01-30 08:31:21 -08:00
ishaan-jaff
4bef067f6a (feat) Bedrock embedding - raise correct exception BadRequest 2024-01-30 08:14:35 -08:00
Krrish Dholakia
e1beaf0945 feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given 2024-01-26 14:53:58 -08:00
Krrish Dholakia
cc89aa7456 fix(bedrock.py): add support for sts based boto3 initialization
https://github.com/BerriAI/litellm/issues/1476
2024-01-17 12:08:59 -08:00
ishaan-jaff
a5f3907334 (feat) provisioned throughput - bedrock embedding models 2024-01-13 21:07:38 -08:00
ishaan-jaff
a661149a39 (feat) bedrock support provisioned throughput 2024-01-13 15:39:54 -08:00
Krish Dholakia
84879c0318 Merge pull request #1429 from dleen/data
[bug] unbound variable in bedrock
2024-01-12 22:16:11 +05:30
David Leen
1660e4ab72 improve bedrock exception granularity 2024-01-12 16:38:55 +01:00
David Leen
d0e9c9dce9 [bug] unbound variable in bedrock
note: the code was written as `json.dumps({})` even though it is more verbose in order to facilitate easier refactoring in the future

fixes #1428
2024-01-12 12:33:00 +01:00
ishaan-jaff
1f04446222 (fix) bedrock - embedding - support str input 2024-01-11 23:02:12 +05:30
ishaan-jaff
9aac1de191 v0 2024-01-11 22:56:18 +05:30
ishaan-jaff
6672591198 (fix) init_bedrock_client 2024-01-01 22:48:56 +05:30
Krrish Dholakia
79978c44ba refactor: add black formatting 2023-12-25 14:11:20 +05:30
David Manouchehri
98bb605701 Add aws_bedrock_runtime_endpoint support. 2023-12-20 19:31:43 -05:00
Krrish Dholakia
a207f8ea63 bump: version 1.14.4 → 1.14.5.dev1 2023-12-14 15:23:52 -08:00
Krrish Dholakia
02cfefa257 test(test_custom_callback_input.py): embedding callback tests for azure, openai, bedrock 2023-12-11 15:32:46 -08:00
Krrish Dholakia
72591a2165 test(test_custom_callback_input.py): add bedrock testing
n

n
2023-12-11 13:00:01 -08:00
Krrish Dholakia
583de6ab92 fix(bedrock.py): fix output format for cohere embeddings 2023-12-06 22:47:01 -08:00
Krrish Dholakia
feb4e50234 fix(bedrock.py): fix embeddings call 2023-12-06 14:16:00 -08:00
Krrish Dholakia
b5b366626f refactor: fix linting 2023-12-06 13:27:40 -08:00
Krrish Dholakia
a18bdb3f2e fix(bedrock.py): adding support for cohere embeddings 2023-12-06 13:25:18 -08:00
Krrish Dholakia
2a5592abe7 fix(bedrock.py): support ai21 / bedrock streaming 2023-11-29 16:35:06 -08:00
ishaan-jaff
0fdcbad2ca (feat) completion:debugging - show raw POST request 2023-11-27 10:13:37 -08:00
Krish Dholakia
1e99ebfec3 Merge pull request #845 from canada4663/upstream-main
Added support for multiple embeddings via Bedrock
2023-11-21 14:00:06 -08:00
ishaan-jaff
7bc28f3b1c (fix) pydantic errors with response.time 2023-11-20 18:28:19 -08:00
canada4663
5108b00688 bedrock embedding changes pre-testing 2023-11-18 21:00:06 -08:00
David Christian
9c4afd87ed added support for bedrock llama models 2023-11-13 15:41:21 -08:00
Krrish Dholakia
4b74ddcb17 refactor: fixing linting issues 2023-11-11 18:52:28 -08:00
Krrish Dholakia
7b4e21e574 refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk 2023-11-11 17:33:19 -08:00
Krrish Dholakia
d53a0d9663 refactor(bedrock.py): better exception mapping for bedrock + huggingface 2023-11-04 16:12:12 -07:00
Krrish Dholakia
d0b23a2722 refactor(all-files): removing all print statements; adding pre-commit + flake8 to prevent future regressions 2023-11-04 12:50:15 -07:00
Krrish Dholakia
64b6b0155d fix(bedrock.py): add exception mapping coverage for authentication scenarios 2023-11-03 18:25:34 -07:00
Krrish Dholakia
8bf8464fc2 fix(bedrock.py): fix bedrock exception mapping 2023-11-03 18:14:12 -07:00
ishaan-jaff
10f72f0f4a (fix) bedrock: remove check for - if "error" in outputText 2023-11-03 18:06:23 -07:00
ishaan-jaff
0668d8d81e (feat) embedding() add bedrock/amazon.titan-embed-text-v1 2023-11-01 13:55:28 -07:00
ishaan-jaff
c6229b7113 (feat) add bedrock.cohere streaming 2023-10-31 22:26:43 -07:00
canada4663
49033bbe27 add ability to use custom AWS Bedrock Runtime endpoint via environment or .env variable AWS_BEDROCK_RUNTIME_ENDPOINT or as a parameter to init_bedrock_client 2023-10-28 22:25:45 -07:00
canada4663
46ef5a94b9 add in ability to read AWS boto3 default AWS Region name if litellm .env config AWS_REGION_NAME not available 2023-10-28 21:43:48 -07:00
ishaan-jaff
75d45c27c1 (fix) bedrock region name defaults to None 2023-10-27 10:17:45 -07:00
ishaan-jaff
194b6263c7 (feat) add model_response.usage.completion_tokens for bedrock, palm, petals, sagemaker 2023-10-27 09:51:50 -07:00
Krrish Dholakia
2f9e112c14 fix(anthropic.py-+-bedrock.py): anthropic prompt format 2023-10-20 10:56:15 -07:00
Krrish Dholakia
d0b4dfd26c feat(proxy_server): adds create-proxy feature 2023-10-12 18:27:07 -07:00
Krrish Dholakia
cc0e4f4f9f fix: fix value error if model returns empty completion 2023-10-10 10:11:40 -07:00
Krrish Dholakia
f62a13a6b3 fix(anthropic.py): fix anthropic prompt 2023-10-09 15:22:58 -07:00
Zeeshan Hooda
c85588ced7 (test) add bedrock existing client auth test 2023-10-09 03:39:40 -06:00
Zeeshan Hooda
7cfbf48bcb (docs) bedrock pass existing client to completion 2023-10-09 01:14:53 -06:00
Zeeshan Hooda
62dd17b97b (feat) bedrock pass client to completion 2023-10-09 00:51:58 -06:00
ishaan-jaff
fc10894a86 (feat) bedrock auth in completion 2023-10-07 15:27:58 -07:00
Krrish Dholakia
37f9626422 fix(bedrock.py): adding provider-specific configs 2023-10-05 23:49:20 -07:00
Krrish Dholakia
69cdf5347a style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00