Litellm dev 01 29 2025 p2 (#8102)

* docs: cleanup doc

* feat(bedrock/): initial commit adding bedrock/converse_like/<model> route support

allows routing to a converse like endpoint

Resolves https://github.com/BerriAI/litellm/issues/8085

* feat(bedrock/chat/converse_transformation.py): make converse config base config compatible

enables new 'converse_like' route

* feat(converse_transformation.py): enables using the proxy with converse like api endpoint

Resolves https://github.com/BerriAI/litellm/issues/8085
This commit is contained in:
Krish Dholakia 2025-01-29 20:53:37 -08:00 committed by GitHub
parent a57fad1e29
commit dad24f2b52
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
12 changed files with 182 additions and 51 deletions

View file

@ -6021,8 +6021,11 @@ class ProviderConfigManager:
return litellm.PetalsConfig()
elif litellm.LlmProviders.BEDROCK == provider:
base_model = litellm.AmazonConverseConfig()._get_base_model(model)
if base_model in litellm.bedrock_converse_models:
pass
if (
base_model in litellm.bedrock_converse_models
or "converse_like" in model
):
return litellm.AmazonConverseConfig()
elif "amazon" in model: # amazon titan llms
return litellm.AmazonTitanConfig()
elif "meta" in model: # amazon / meta llms