litellm/litellm
Ishaan Jaff 480a8d73c0
[Fix] Perf use only async functions for get cache (#5930)
* use async functions

* fix parallel request limiter use correct user id

* fix getting user_id
2024-09-26 18:39:40 -07:00
..
adapters fix(anthropic_adapter.py): fix sync streaming 2024-08-03 20:52:29 -07:00
assistants [Feat-Proxy] Add Azure Assistants API - Create Assistant, Delete Assistant Support (#5777) 2024-09-18 16:27:33 -07:00
batches use correct type hints for audio transcriptions 2024-09-05 09:12:27 -07:00
deprecated_litellm_server
files fix import error 2024-09-05 10:09:44 -07:00
fine_tuning refactor get_secret 2024-09-03 10:42:12 -07:00
integrations track api key and alias in remaining tokens metric (#5924) 2024-09-26 18:01:03 -07:00
litellm_core_utils [Feat] Improve OTEL Tracking - Require all Redis Cache reads to be logged on OTEL (#5881) 2024-09-25 10:57:08 -07:00
llms LiteLLM Minor Fixes & Improvements (09/25/2024) (#5893) 2024-09-26 16:41:44 -07:00
proxy [Fix] Perf use only async functions for get cache (#5930) 2024-09-26 18:39:40 -07:00
rerank_api LiteLLM Minor Fixes & Improvements (09/24/2024) (#5880) 2024-09-25 22:11:57 -07:00
router_strategy LiteLLM Minor Fixes & Improvements (09/21/2024) (#5819) 2024-09-21 18:51:53 -07:00
router_utils [Feat-Prometheus] Track exception status on litellm_deployment_failure_responses (#5706) 2024-09-14 18:44:31 -07:00
secret_managers LiteLLM Minor Fixes & Improvements (09/25/2024) (#5893) 2024-09-26 16:41:44 -07:00
tests [Fix proxy perf] Use correct cache key when reading from redis cache (#5928) 2024-09-26 18:13:35 -07:00
types LiteLLM Minor Fixes & Improvements (09/25/2024) (#5893) 2024-09-26 16:41:44 -07:00
__init__.py LiteLLM Minor Fixes & Improvements (09/24/2024) (#5880) 2024-09-25 22:11:57 -07:00
_logging.py fix(_logging.py): fix timestamp format for json logs 2024-06-20 15:20:21 -07:00
_redis.py LiteLLM Minor Fixes & Improvements (09/21/2024) (#5819) 2024-09-21 18:51:53 -07:00
_service_logger.py [Fix] OTEL - Don't log messages when callback settings disable message logging (#5875) 2024-09-24 18:29:52 -07:00
_version.py
budget_manager.py
caching.py [Feat] Improve OTEL Tracking - Require all Redis Cache reads to be logged on OTEL (#5881) 2024-09-25 10:57:08 -07:00
cost.json
cost_calculator.py LiteLLM Minor Fixes & Improvements (09/24/2024) (#5880) 2024-09-25 22:11:57 -07:00
exceptions.py LiteLLM Minor Fixes & Improvements (09/21/2024) (#5819) 2024-09-21 18:51:53 -07:00
main.py LiteLLM Minor Fixes & Improvements (09/24/2024) (#5880) 2024-09-25 22:11:57 -07:00
model_prices_and_context_window_backup.json track api key and alias in remaining tokens metric (#5924) 2024-09-26 18:01:03 -07:00
py.typed
requirements.txt
router.py [Feat-Router] Allow setting which environment to use a model on (#5892) 2024-09-25 10:12:06 -07:00
scheduler.py feat(scheduler.py): support redis caching for req. prioritization 2024-06-06 14:19:21 -07:00
timeout.py
utils.py LiteLLM Minor Fixes & Improvements (09/25/2024) (#5893) 2024-09-26 16:41:44 -07:00