phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 03:04:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
litellm-mirror/litellm
History
Ishaan Jaff 441adad3ae
(router_strategy/) ensure all async functions use async cache methods (#6489) 
* fix router strat

* use async set / get cache in router_strategy

* add coverage for router strategy

* fix imports

* fix batch_get_cache

* use async methods for least busy

* fix least busy use async methods

* fix test_dual_cache_increment

* test async_get_available_deployment when routing_strategy="least-busy"
2024-10-29 21:07:17 +05:30
..
adapters LiteLLM Minor Fixes & Improvements (09/27/2024) (#5938) 2024-09-27 22:52:57 -07:00
assistants Add pyright to ci/cd + Fix remaining type-checking errors (#6082) 2024-10-05 17:04:00 -04:00
batch_completion (refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) 2024-10-14 16:34:01 +05:30
batches Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
caching redis otel tracing + async support for latency routing (#6452) 2024-10-28 21:52:12 -07:00
deprecated_litellm_server (refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) 2024-10-14 16:34:01 +05:30
files Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
fine_tuning Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
integrations (fix) Prometheus - Log Postgres DB latency, status on prometheus (#6484) 2024-10-29 12:17:35 +05:30
litellm_core_utils (Feat) New Logging integration - add Datadog LLM Observability support (#6449) 2024-10-28 22:01:32 +05:30
llms LiteLLM Minor Fixes & Improvements (10/24/2024) (#6441) 2024-10-28 15:05:20 -07:00
proxy (fix) Prometheus - Log Postgres DB latency, status on prometheus (#6484) 2024-10-29 12:17:35 +05:30
realtime_api LiteLLM Minor Fixes & Improvements (10/10/2024) (#6158) 2024-10-11 23:04:36 -07:00
rerank_api Add pyright to ci/cd + Fix remaining type-checking errors (#6082) 2024-10-05 17:04:00 -04:00
router_strategy (router_strategy/) ensure all async functions use async cache methods (#6489) 2024-10-29 21:07:17 +05:30
router_utils redis otel tracing + async support for latency routing (#6452) 2024-10-28 21:52:12 -07:00
secret_managers (code quality) add ruff check PLR0915 for too-many-statements (#6309) 2024-10-18 15:36:49 +05:30
tests Feat: Add Langtrace integration (#5341) 2024-10-11 19:19:53 +05:30
types redis otel tracing + async support for latency routing (#6452) 2024-10-28 21:52:12 -07:00
__init__.py (Feat) New Logging integration - add Datadog LLM Observability support (#6449) 2024-10-28 22:01:32 +05:30
_logging.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
_redis.py Litellm dev 10 22 2024 (#6384) 2024-10-22 21:18:54 -07:00
_service_logger.py redis otel tracing + async support for latency routing (#6452) 2024-10-28 21:52:12 -07:00
_version.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
budget_manager.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
cost.json
cost_calculator.py LiteLLM Minor Fixes & Improvements (10/18/2024) (#6320) 2024-10-19 22:23:27 -07:00
exceptions.py Litellm dev 10 26 2024 (#6472) 2024-10-28 15:05:43 -07:00
main.py Litellm dev 10 26 2024 (#6472) 2024-10-28 15:05:43 -07:00
model_prices_and_context_window_backup.json LiteLLM Minor Fixes & Improvements (10/24/2024) (#6441) 2024-10-28 15:05:20 -07:00
py.typed feature - Types for mypy - #360 2024-05-30 14:14:41 -04:00
requirements.txt
router.py (router_strategy/) ensure all async functions use async cache methods (#6489) 2024-10-29 21:07:17 +05:30
scheduler.py (refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) 2024-10-14 16:34:01 +05:30
timeout.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
utils.py Litellm dev 10 26 2024 (#6472) 2024-10-28 15:05:43 -07:00