phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

(feat) Add Bedrock Stability.ai Stable Diffusion 3 Image Generation models (#6673)

Browse source 
* add bedrock image gen async support

* added async support for bedrock image gen

* move image gen testing

* add AmazonStability3Config

* add AmazonStability3Config config

* update AmazonStabilityConfig

* update get_optional_params_image_gen

* use 1 helper for _get_request_body

* add transform_response_dict_to_openai_response for stability3

* test sd3-large-v1:0

* unit testing for bedrock image gen

* fix load_vertex_ai_credentials

* fix test_aimage_generation_vertex_ai

* add stability.sd3-large-v1:0 to model cost map

* add stability.stability.sd3-large-v1:0 to docs
This commit is contained in:
Ishaan Jaff 2024-11-08 19:26:03 -08:00 • committed by GitHub
parent 0871c33a24
commit 979dfe8ab2
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
14 changed files with 528 additions and 111 deletions
Download patch file Download diff file Expand all files Collapse all files

7
model_prices_and_context_window.json
View file

@ -5611,6 +5611,13 @@
"litellm_provider": "bedrock",
"mode": "image_generation"
},
"stability.stability.sd3-large-v1:0": {
"max_tokens": 77,
"max_input_tokens": 77,
"output_cost_per_image": 0.08,
"litellm_provider": "bedrock",
"mode": "image_generation"
},
"sagemaker/meta-textgeneration-llama-2-7b": {
"max_tokens": 4096,
"max_input_tokens": 4096,