Krish Dholakia
b9732b15b7
Merge pull request #4613 from petermuller/main
...
Fix: use Bedrock region from environment variables before other region definitions
2024-07-20 19:19:05 -07:00
Krrish Dholakia
c69193c321
fix: move to using pydantic obj for setting values
2024-07-11 13:18:36 -07:00
Peter Muller
902f39fedd
Fix: use Bedrock region from environment variables before other region definitions
2024-07-08 15:37:07 -07:00
Krrish Dholakia
7fe4b3d8f4
fix(bedrock_httpx.py): Fix https://github.com/BerriAI/litellm/issues/4415
2024-06-26 16:19:46 -07:00
Krrish Dholakia
71a2fabc6a
fix(bedrock.py): support custom prompt templates for all providers
...
Fixes https://github.com/BerriAI/litellm/issues/4239
2024-06-17 08:28:46 -07:00
Krrish Dholakia
7de77ab677
fix(init.py): fix imports
2024-06-15 11:31:09 -07:00
Krrish Dholakia
9d7f5d503c
refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
...
Easier debugging
Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Krish Dholakia
7f64c61275
Merge pull request #3582 from BerriAI/litellm_explicit_region_name_setting
...
feat(router.py): allow setting model_region in litellm_params
2024-05-11 11:36:22 -07:00
Krrish Dholakia
691c185ff8
feat(router.py): support region routing for bedrock, vertex ai, watsonx
2024-05-11 11:04:00 -07:00
Krish Dholakia
997ef2e480
Merge pull request #3507 from Manouchehri/oidc-3505-part-1
...
Initial OIDC support (Google/GitHub/CircleCI -> Amazon Bedrock & Azure OpenAI)
2024-05-11 09:25:17 -07:00
Krrish Dholakia
5f93cae3ff
feat(proxy_server.py): return litellm version in response headers
2024-05-08 16:00:08 -07:00
David Manouchehri
47449d19e8
feat(bedrock.py): Support using OIDC tokens.
2024-05-07 15:46:54 +00:00
Lucca Zenóbio
146a49103f
Merge branch 'main' into main
2024-05-06 09:40:23 -03:00
Krrish Dholakia
8f22092c65
fix(bedrock.py): map finish reason for bedrock
2024-05-04 12:45:40 -07:00
Krrish Dholakia
defed7c08a
fix(bedrock.py): fix boto3 config init
2024-05-03 17:22:06 -07:00
Krrish Dholakia
7715a9d333
fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
...
Closes https://github.com/BerriAI/litellm/issues/3398
2024-05-03 16:24:21 -07:00
Lucca Zenóbio
bf2a319713
Merge branch 'main' into main
2024-05-02 09:46:34 -03:00
Krrish Dholakia
a241cdb818
fix(utils.py): fix default values
2024-05-01 22:24:37 -07:00
Krrish Dholakia
ee68c0aaaa
feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx
2024-04-27 11:06:18 -07:00
Lucca Zenobio
e73978b0d9
merge
2024-04-25 15:00:07 -03:00
aswny
1e7a6c5d1f
fix Llama models message to prompt conversion in for AWS Bedrock provider
2024-04-25 17:19:55 +00:00
Krrish Dholakia
b10f03706d
fix(utils.py): fix streaming to not return usage dict
...
Fixes https://github.com/BerriAI/litellm/issues/3237
2024-04-24 08:06:07 -07:00
Zihao Li
715c11a9da
Add backward compatibility to support xml tool use for bedrock and vertex
2024-04-06 00:34:33 +08:00
jdhuang
b5dd970a76
Add sync iterator
2024-04-02 20:14:37 +08:00
Krrish Dholakia
69f27aa25c
fix(factory.py): parse list in xml tool calling response (anthropic)
...
improves tool calling outparsing to check if list in response. Also returns the raw response back to the user via `response._hidden_params["original_response"]`, so user can see exactly what anthropic returned
2024-03-29 11:51:26 -07:00
Rob Mann
4b7c5e4c2e
Updating the default Claude3 max tokens
2024-03-26 11:46:59 -04:00
Lucca Zenobio
f91a707b9c
update
2024-03-25 13:08:17 -03:00
Krrish Dholakia
47b2b0df17
fix(bedrock.py): fix supported openai params for bedrock claude 3
2024-03-23 16:02:15 -07:00
Krrish Dholakia
e8fbe9a9a5
fix(bedrock.py): support claude 3 function calling when stream=true
...
https://github.com/BerriAI/litellm/issues/2615
2024-03-21 18:39:03 -07:00
Lucca Zenobio
274d936195
extra headers
2024-03-21 10:43:27 -03:00
garfeildma
0c72f0a145
support multiple system message tranlation for bedrock claude-3
2024-03-18 19:41:15 +08:00
Krrish Dholakia
da5dc402c1
fix(bedrock.py): add all supported bedrock / anthropic messages api params
2024-03-15 09:41:40 -07:00
Krrish Dholakia
d8cf889597
fix(bedrock.py): enable claude-3 streaming
2024-03-09 14:02:27 -08:00
ishaan-jaff
e0a7ae539e
(fix) bug importing litellm
2024-03-05 18:41:39 -08:00
Krrish Dholakia
ee5bedf541
fix(bedrock.py): fix conditional
2024-03-04 21:46:00 -08:00
Krrish Dholakia
87831588c8
fix(utils.py): fix default message object values
2024-03-04 21:19:03 -08:00
Krrish Dholakia
f0a5e0ffe9
fix(bedrock.py): working image calls to claude 3
2024-03-04 18:12:47 -08:00
Krrish Dholakia
dad65ca602
fix(bedrock.py): support anthropic messages api on bedrock (claude-3)
2024-03-04 17:15:47 -08:00
Krrish Dholakia
6c486c2461
fix(bedrock.py): add claude 3 support
2024-03-04 17:15:47 -08:00
Tim Xia
30887760e6
change to snake case 'cause of aws docs
2024-03-02 00:07:21 -05:00
Tim Xia
fe3d7577dc
follow camelcase convention
2024-03-01 23:58:03 -05:00
Tim Xia
78a93e40ed
Add AmazonMistralConfig
2024-03-01 23:14:00 -05:00
Tim Xia
6f389097d2
add support for bedrock mistral models
2024-03-01 22:45:54 -05:00
Krrish Dholakia
179fef23f9
fix(bedrock.py): fix amazon titan prompt formatting
2024-02-13 22:02:25 -08:00
ishaan-jaff
83e7ebd157
(feat) support bedrock timeout
2024-02-09 14:36:43 -08:00
Krrish Dholakia
6e2c8732c9
fix(bedrock.py): raise exception for amazon titan null response
2024-02-08 21:12:25 -08:00
David Leen
b791dec5b6
Add support for AWS credentials from profile file
...
https://boto3.amazonaws.com/v1/documentation/api/latest/guide/credentials.html#aws-config-file
2024-02-08 15:10:50 -08:00
Krrish Dholakia
5994c1e7ef
feat(bedrock.py): add stable diffusion image generation support
2024-02-03 12:08:38 -08:00
ishaan-jaff
68553ed8dc
(fix) use isinstance to check types
2024-01-30 08:31:21 -08:00
ishaan-jaff
4bef067f6a
(feat) Bedrock embedding - raise correct exception BadRequest
2024-01-30 08:14:35 -08:00
