litellm-mirror/litellm
Ishaan Jaff 1e89d4a1ba (Feat) 273% improvement GCS Bucket Logger - use Batched Logging (#6679)
* use CustomBatchLogger for GCS

* add GCS bucket logging type

* use batch logging for GCs bucket

* add gcs_bucket

* allow setting flush_interval on CustomBatchLogger

* set GCS_FLUSH_INTERVAL to 1s

* fix test_key_logging

* fix test_key_logging

* add docs on new env vars
2024-11-11 11:35:34 +05:30
..
adapters LiteLLM Minor Fixes & Improvements (09/27/2024) (#5938) 2024-09-27 22:52:57 -07:00
assistants Add pyright to ci/cd + Fix remaining type-checking errors (#6082) 2024-10-05 17:04:00 -04:00
batch_completion (refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) 2024-10-14 16:34:01 +05:30
batches Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
caching Litellm perf improvements 3 (#6573) 2024-11-05 03:51:26 +05:30
deprecated_litellm_server (refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) 2024-10-14 16:34:01 +05:30
files Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
fine_tuning Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
integrations (Feat) 273% improvement GCS Bucket Logger - use Batched Logging (#6679) 2024-11-11 11:35:34 +05:30
litellm_core_utils Litellm dev 11 07 2024 (#6649) 2024-11-08 19:34:22 +05:30
llms (feat) Add Bedrock Stability.ai Stable Diffusion 3 Image Generation models (#6673) 2024-11-08 19:26:03 -08:00
proxy (Feat) 273% improvement GCS Bucket Logger - use Batched Logging (#6679) 2024-11-11 11:35:34 +05:30
realtime_api LiteLLM Minor Fixes & Improvements (10/10/2024) (#6158) 2024-10-11 23:04:36 -07:00
rerank_api Add pyright to ci/cd + Fix remaining type-checking errors (#6082) 2024-10-05 17:04:00 -04:00
router_strategy fix(lowest_tpm_rpm_routing.py): fix parallel rate limit check (#6577) 2024-11-05 22:03:44 +05:30
router_utils fix(pattern_match_deployments.py): default to user input if unable to map based on wildcards (#6646) 2024-11-07 23:57:37 +05:30
secret_managers (fix) proxy - fix when STORE_MODEL_IN_DB should be set (#6492) 2024-10-29 21:28:14 +05:30
types (Feat) 273% improvement GCS Bucket Logger - use Batched Logging (#6679) 2024-11-11 11:35:34 +05:30
__init__.py (feat) Add Bedrock Stability.ai Stable Diffusion 3 Image Generation models (#6673) 2024-11-08 19:26:03 -08:00
_logging.py LiteLLM Minor Fixes & Improvements (10/30/2024) (#6519) 2024-11-02 00:44:32 +05:30
_redis.py Litellm dev 10 22 2024 (#6384) 2024-10-22 21:18:54 -07:00
_service_logger.py (feat) log error class, function_name on prometheus service failure hook + only log DB related failures on DB service hook (#6650) 2024-11-07 17:01:18 -08:00
_version.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
budget_manager.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
constants.py Litellm router max depth (#6501) 2024-10-29 22:05:41 -07:00
cost.json
cost_calculator.py LiteLLM Minor Fixes & Improvements (10/18/2024) (#6320) 2024-10-19 22:23:27 -07:00
exceptions.py Litellm dev 10 26 2024 (#6472) 2024-10-28 15:05:43 -07:00
main.py (feat) Add Bedrock Stability.ai Stable Diffusion 3 Image Generation models (#6673) 2024-11-08 19:26:03 -08:00
model_prices_and_context_window_backup.json fix model cost map stability.sd3-large-v1:0 2024-11-08 19:51:35 -08:00
py.typed feature - Types for mypy - #360 2024-05-30 14:14:41 -04:00
requirements.txt
router.py Litellm dev 11 08 2024 (#6658) 2024-11-08 22:07:17 +05:30
scheduler.py (refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) 2024-10-14 16:34:01 +05:30
timeout.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
utils.py (feat) Add Bedrock Stability.ai Stable Diffusion 3 Image Generation models (#6673) 2024-11-08 19:26:03 -08:00