litellm-mirror/litellm
Ishaan Jaff 22c86a95f7 [Feat - Perf Improvement] DataDog Logger 91% lower latency (#5687)
* fix refactor dd to be an instance of custom logger

* migrate dd logger to be async

* clean up dd logging

* add datadog sync and async code

* use batching for datadog logger

* add doc string for dd logging

* add clear doc string

* fix doc string

* allow debugging intake url

* clean up requirements.txt

* allow setting custom batch size on logger

* fix dd logging to use compression

* fix linting

* add dd load test

* fix dd load test

* fix dd url

* add test_datadog_logging_http_request

* fix test_datadog_logging_http_request
2024-09-13 17:39:17 -07:00
..
adapters fix(anthropic_adapter.py): fix sync streaming 2024-08-03 20:52:29 -07:00
assistants fix linting error 2024-09-05 09:56:33 -07:00
batches use correct type hints for audio transcriptions 2024-09-05 09:12:27 -07:00
deprecated_litellm_server
files fix import error 2024-09-05 10:09:44 -07:00
fine_tuning refactor get_secret 2024-09-03 10:42:12 -07:00
integrations [Feat - Perf Improvement] DataDog Logger 91% lower latency (#5687) 2024-09-13 17:39:17 -07:00
litellm_core_utils [Feat - Perf Improvement] DataDog Logger 91% lower latency (#5687) 2024-09-13 17:39:17 -07:00
llms [Fix] Performance - use in memory cache when downloading images from a url (#5657) 2024-09-13 07:23:42 -07:00
proxy [Feat - Perf Improvement] DataDog Logger 91% lower latency (#5687) 2024-09-13 17:39:17 -07:00
rerank_api LiteLLM Minor Fixes and Improvements (09/12/2024) (#5658) 2024-09-12 23:04:06 -07:00
router_strategy support default deployments 2024-09-09 14:23:17 -07:00
router_utils fix import error 2024-09-05 10:09:44 -07:00
secret_managers LiteLLM Minor Fixes and Improvements (11/09/2024) (#5634) 2024-09-11 22:36:06 -07:00
tests [Feat - Perf Improvement] DataDog Logger 91% lower latency (#5687) 2024-09-13 17:39:17 -07:00
types LiteLLM Minor Fixes and Improvements (09/12/2024) (#5658) 2024-09-12 23:04:06 -07:00
__init__.py [Feat - Perf Improvement] DataDog Logger 91% lower latency (#5687) 2024-09-13 17:39:17 -07:00
_logging.py
_redis.py allow setting password for redis cluster 2024-09-07 09:25:13 -07:00
_service_logger.py fix handle case when service logger has no attribute prometheusServicesLogger 2024-08-08 17:19:12 -07:00
_version.py
budget_manager.py
caching.py LiteLLM Minor Fixes and Improvements (11/09/2024) (#5634) 2024-09-11 22:36:06 -07:00
cost.json
cost_calculator.py LiteLLM Minor Fixes and Improvements (09/10/2024) (#5618) 2024-09-11 11:30:29 -07:00
exceptions.py fix: fix tests 2024-08-07 15:02:04 -07:00
main.py LiteLLM Minor Fixes and Improvements (09/10/2024) (#5618) 2024-09-11 11:30:29 -07:00
model_prices_and_context_window_backup.json build: bump from 1.44.28 -> 1.45.0 2024-09-12 23:10:29 -07:00
py.typed
requirements.txt
router.py LiteLLM Minor Fixes and Improvements (09/12/2024) (#5658) 2024-09-12 23:04:06 -07:00
scheduler.py
timeout.py
utils.py Merge pull request #5573 from BerriAI/litellm_add_rerank_spend_tracking 2024-09-06 18:11:30 -07:00