litellm-mirror/litellm
Krish Dholakia 2b58f16fda refactor: make bedrock image transformation requests async (#7840)
* refactor: initial commit for using separate sync vs. async transformation routes for bedrock

ensures no blocking calls e.g. when converting image url to b64

* perf(converse_transformation.py): make bedrock converse transformation async

asyncify's the bedrock message transformation - useful for handling image urls for bedrock

* fix(converse_handler.py): fix logging for async streaming

* style: cleanup unused imports
2025-01-17 20:14:15 -08:00
..
adapters (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
assistants Revert "fix: add missing parameters order, limit, before, and after in get_as…" (#7542) 2025-01-03 16:32:12 -08:00
batch_completion (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
batches (Feat - Batches API) add support for retrieving vertex api batch jobs (#7661) 2025-01-09 18:35:03 -08:00
caching (litellm SDK perf improvements) - handle cases when unable to lookup model in model cost map (#7750) 2025-01-13 19:58:46 -08:00
files (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
fine_tuning (feat) POST /fine_tuning/jobs support passing vertex specific hyper params (#7490) 2025-01-01 07:44:48 -08:00
integrations [fix dd llm obs] - use env vars for setting dd tags, service name (#7835) 2025-01-17 18:57:16 -08:00
litellm_core_utils Revert "test_completion_mistral_api_mistral_large_function_call" 2025-01-17 07:20:46 -08:00
llms refactor: make bedrock image transformation requests async (#7840) 2025-01-17 20:14:15 -08:00
proxy refactor: make bedrock image transformation requests async (#7840) 2025-01-17 20:14:15 -08:00
realtime_api (Refactor) - Re use litellm.completion/litellm.embedding etc for health checks (#7455) 2024-12-28 18:38:54 -08:00
rerank_api (feat) /batches - track user_api_key_alias, user_api_key_team_alias etc for /batch requests (#7401) 2024-12-24 17:44:28 -08:00
router_strategy Litellm dev 12 26 2024 p4 (#7439) 2024-12-27 12:01:42 -08:00
router_utils (Feat) - LiteLLM Use UsernamePasswordCredential for Azure OpenAI (#7496) 2025-01-01 14:11:27 -08:00
secret_managers [Hashicorp - secret manager] - use vault namespace for tls auth (#7834) 2025-01-17 19:27:56 -08:00
types refactor: make bedrock image transformation requests async (#7840) 2025-01-17 20:14:15 -08:00
__init__.py refactor: make bedrock image transformation requests async (#7840) 2025-01-17 20:14:15 -08:00
_logging.py (sdk perf fix) - only print args passed to litellm when debugging mode is on (#7708) 2025-01-11 22:56:20 -08:00
_redis.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
_service_logger.py fix svc logger (#7727) 2025-01-12 22:00:25 -08:00
_version.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
budget_manager.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
constants.py [BETA] Add OpenAI /images/variations + Topaz API support (#7700) 2025-01-11 23:27:46 -08:00
cost.json
cost_calculator.py fixes for img gen cost cal 2025-01-12 16:41:18 -08:00
exceptions.py LiteLLM Minor Fixes & Improvements (12/27/2024) - p1 (#7448) 2024-12-27 19:04:39 -08:00
main.py (core sdk fix) - fix fallbacks stuck in infinite loop (#7751) 2025-01-13 19:34:34 -08:00
model_prices_and_context_window_backup.json QA: ensure all bedrock regional models have same supported_ as base + Anthropic nested pydantic object support (#7844) 2025-01-17 19:49:12 -08:00
py.typed feature - Types for mypy - #360 2024-05-30 14:14:41 -04:00
router.py (core sdk fix) - fix fallbacks stuck in infinite loop (#7751) 2025-01-13 19:34:34 -08:00
scheduler.py (refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) 2024-10-14 16:34:01 +05:30
timeout.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
utils.py QA: ensure all bedrock regional models have same supported_ as base + Anthropic nested pydantic object support (#7844) 2025-01-17 19:49:12 -08:00