Krish Dholakia
86d0c0ae4e
Merge pull request #3582 from BerriAI/litellm_explicit_region_name_setting
...
feat(router.py): allow setting model_region in litellm_params
2024-05-11 11:36:22 -07:00
Krrish Dholakia
6714854bb7
feat(router.py): support region routing for bedrock, vertex ai, watsonx
2024-05-11 11:04:00 -07:00
Krish Dholakia
40063798bd
Merge pull request #3507 from Manouchehri/oidc-3505-part-1
...
Initial OIDC support (Google/GitHub/CircleCI -> Amazon Bedrock & Azure OpenAI)
2024-05-11 09:25:17 -07:00
Krrish Dholakia
6575143460
feat(proxy_server.py): return litellm version in response headers
2024-05-08 16:00:08 -07:00
David Manouchehri
3ee0328b04
feat(bedrock.py): Support using OIDC tokens.
2024-05-07 15:46:54 +00:00
Lucca Zenóbio
b22517845e
Merge branch 'main' into main
2024-05-06 09:40:23 -03:00
Krrish Dholakia
09d7121af2
fix(bedrock.py): map finish reason for bedrock
2024-05-04 12:45:40 -07:00
Krrish Dholakia
0450abfdc1
fix(bedrock.py): fix boto3 config init
2024-05-03 17:22:06 -07:00
Krrish Dholakia
a732d8772a
fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
...
Closes https://github.com/BerriAI/litellm/issues/3398
2024-05-03 16:24:21 -07:00
Lucca Zenóbio
78303b79ee
Merge branch 'main' into main
2024-05-02 09:46:34 -03:00
Krrish Dholakia
29aefaa7d7
fix(utils.py): fix default values
2024-05-01 22:24:37 -07:00
Krrish Dholakia
48f19cf839
feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx
2024-04-27 11:06:18 -07:00
Lucca Zenobio
6127d9f488
merge
2024-04-25 15:00:07 -03:00
aswny
9ead717531
fix Llama models message to prompt conversion in for AWS Bedrock provider
2024-04-25 17:19:55 +00:00
Krrish Dholakia
48c2c3d78a
fix(utils.py): fix streaming to not return usage dict
...
Fixes https://github.com/BerriAI/litellm/issues/3237
2024-04-24 08:06:07 -07:00
Zihao Li
f16d0c06fd
Add backward compatibility to support xml tool use for bedrock and vertex
2024-04-06 00:34:33 +08:00
jdhuang
b6f98e408f
Add sync iterator
2024-04-02 20:14:37 +08:00
Krrish Dholakia
49642a5b00
fix(factory.py): parse list in xml tool calling response (anthropic)
...
improves tool calling outparsing to check if list in response. Also returns the raw response back to the user via `response._hidden_params["original_response"]`, so user can see exactly what anthropic returned
2024-03-29 11:51:26 -07:00
Rob Mann
e80aae5c30
Updating the default Claude3 max tokens
2024-03-26 11:46:59 -04:00
Lucca Zenobio
cda78a5da0
update
2024-03-25 13:08:17 -03:00
Krrish Dholakia
2fabff06c0
fix(bedrock.py): fix supported openai params for bedrock claude 3
2024-03-23 16:02:15 -07:00
Krrish Dholakia
94f55aa6d9
fix(bedrock.py): support claude 3 function calling when stream=true
...
https://github.com/BerriAI/litellm/issues/2615
2024-03-21 18:39:03 -07:00
Lucca Zenobio
0c0780be83
extra headers
2024-03-21 10:43:27 -03:00
garfeildma
45d31e33aa
support multiple system message tranlation for bedrock claude-3
2024-03-18 19:41:15 +08:00
Krrish Dholakia
f7cf90a636
fix(bedrock.py): add all supported bedrock / anthropic messages api params
2024-03-15 09:41:40 -07:00
Krrish Dholakia
8b24ddcbbd
fix(bedrock.py): enable claude-3 streaming
2024-03-09 14:02:27 -08:00
ishaan-jaff
c6e6afd125
(fix) bug importing litellm
2024-03-05 18:41:39 -08:00
Krrish Dholakia
c6d7234c97
fix(bedrock.py): fix conditional
2024-03-04 21:46:00 -08:00
Krrish Dholakia
0f62213656
fix(utils.py): fix default message object values
2024-03-04 21:19:03 -08:00
Krrish Dholakia
caa17d484a
fix(bedrock.py): working image calls to claude 3
2024-03-04 18:12:47 -08:00
Krrish Dholakia
478307d4cf
fix(bedrock.py): support anthropic messages api on bedrock (claude-3)
2024-03-04 17:15:47 -08:00
Krrish Dholakia
0ac652a771
fix(bedrock.py): add claude 3 support
2024-03-04 17:15:47 -08:00
Tim Xia
67110df3e1
change to snake case 'cause of aws docs
2024-03-02 00:07:21 -05:00
Tim Xia
2c97b952ea
follow camelcase convention
2024-03-01 23:58:03 -05:00
Tim Xia
b4dc7f0f17
Add AmazonMistralConfig
2024-03-01 23:14:00 -05:00
Tim Xia
739f4f05f6
add support for bedrock mistral models
2024-03-01 22:45:54 -05:00
Krrish Dholakia
cb5a13ed49
fix(bedrock.py): fix amazon titan prompt formatting
2024-02-13 22:02:25 -08:00
ishaan-jaff
896fd393db
(feat) support bedrock timeout
2024-02-09 14:36:43 -08:00
Krrish Dholakia
841639333b
fix(bedrock.py): raise exception for amazon titan null response
2024-02-08 21:12:25 -08:00
David Leen
140d915adf
Add support for AWS credentials from profile file
...
https://boto3.amazonaws.com/v1/documentation/api/latest/guide/credentials.html#aws-config-file
2024-02-08 15:10:50 -08:00
Krrish Dholakia
36416360c4
feat(bedrock.py): add stable diffusion image generation support
2024-02-03 12:08:38 -08:00
ishaan-jaff
f941c57688
(fix) use isinstance to check types
2024-01-30 08:31:21 -08:00
ishaan-jaff
b9a117fa1d
(feat) Bedrock embedding - raise correct exception BadRequest
2024-01-30 08:14:35 -08:00
Krrish Dholakia
f5da95685a
feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given
2024-01-26 14:53:58 -08:00
Krrish Dholakia
8e9dc09955
fix(bedrock.py): add support for sts based boto3 initialization
...
https://github.com/BerriAI/litellm/issues/1476
2024-01-17 12:08:59 -08:00
ishaan-jaff
069d060ec9
(feat) provisioned throughput - bedrock embedding models
2024-01-13 21:07:38 -08:00
ishaan-jaff
5e03c9c637
(feat) bedrock support provisioned throughput
2024-01-13 15:39:54 -08:00
Krish Dholakia
554080804f
Merge pull request #1429 from dleen/data
...
[bug] unbound variable in bedrock
2024-01-12 22:16:11 +05:30
David Leen
a674de8f36
improve bedrock exception granularity
2024-01-12 16:38:55 +01:00
David Leen
8b021fc4cd
[bug] unbound variable in bedrock
...
note: the code was written as `json.dumps({})` even though it is more verbose in order to facilitate easier refactoring in the future
fixes #1428
2024-01-12 12:33:00 +01:00
