litellm-mirror/tests/logging_callback_tests
Krish Dholakia 2a79c95af7 Improved wildcard route handling on /models and /model_group/info (#8473)
* fix(model_checks.py): update returning known model from wildcard to filter based on given model prefix

ensures wildcard route - `vertex_ai/gemini-*` just returns known vertex_ai/gemini- models

* test(test_proxy_utils.py): add unit testing for new 'get_known_models_from_wildcard' helper

* test(test_models.py): add e2e testing for `/model_group/info` endpoint

* feat(prometheus.py): support tracking total requests by user_email on prometheus

adds initial support for tracking total requests by user_email

* test(test_prometheus.py): add testing to ensure user email is always tracked

* test: update testing for new prometheus metric

* test(test_prometheus_unit_tests.py): add user email to total proxy metric

* test: update tests

* test: fix spend tests

* test: fix test

* fix(pagerduty.py): fix linting error
2025-02-11 19:37:43 -08:00
..
gcs_pub_sub_body Log applied guardrails on LLM API call (#8452) 2025-02-10 22:57:30 -08:00
langfuse_expected_request_body (Bug Fix - Langfuse) - fix for when model response has choices=[] (#8339) 2025-02-06 18:02:26 -08:00
base_test.py Litellm dev 11 11 2024 (#6693) 2024-11-12 00:16:35 +05:30
conftest.py (refactor) use helper function _assemble_complete_response_from_streaming_chunks to assemble complete responses in caching and logging callbacks (#6220) 2024-10-15 12:45:12 +05:30
create_mock_standard_logging_payload.py (fixes) datadog logging - handle 1MB max log size on DD (#6996) 2024-12-02 23:01:42 -08:00
gettysburg.wav (Testing) - Add e2e testing for langfuse logging with tags (#7922) 2025-01-22 09:09:25 -08:00
test_alerting.py (Feat) soft budget alerts on keys (#7623) 2025-01-07 21:36:34 -08:00
test_amazing_s3_logs.py (Feat) Add x-litellm-overhead-duration-ms and "x-litellm-response-duration-ms" in response from LiteLLM (#7899) 2025-01-21 20:27:55 -08:00
test_assemble_streaming_responses.py [Bug Fix]: ImportError: cannot import name 'T' from 're' (#7314) 2024-12-19 13:09:30 -08:00
test_azure_blob_storage.py (feat) Add Azure Blob Storage Logging Integration (#7265) 2024-12-16 22:18:22 -08:00
test_custom_guardrail.py test: update test 2025-02-10 22:13:58 -08:00
test_datadog.py (Feat) datadog_llm_observability callback - emit request_tags on logs (#7883) 2025-01-20 20:36:27 -08:00
test_datadog_llm_obs.py LiteLLM Minor Fixes & Improvements (11/04/2024) (#6572) 2024-11-06 17:53:46 +05:30
test_gcs_pub_sub.py (Feat) - Add GCS Pub/Sub Logging integration for sending DB SpendLogs to BigQuery (#7976) 2025-01-24 20:57:20 -08:00
test_humanloop_unit_tests.py HumanLoop integration for Prompt Management (#7479) 2024-12-30 22:26:03 -08:00
test_langfuse_e2e_test.py (Bug Fix - Langfuse) - fix for when model response has choices=[] (#8339) 2025-02-06 18:02:26 -08:00
test_langfuse_unit_tests.py (Bug Fix - Langfuse) - fix for when model response has choices=[] (#8339) 2025-02-06 18:02:26 -08:00
test_langsmith_unit_test.py Litellm dev 11 30 2024 (#6974) 2024-12-02 21:03:33 -08:00
test_log_db_redis_services.py LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037) 2024-12-05 00:02:31 -08:00
test_logging_redaction_e2e_test.py Litellm dev 01 02 2025 p1 (#7516) 2025-01-03 14:40:57 -08:00
test_opentelemetry_unit_tests.py Litellm dev 11 11 2024 (#6693) 2024-11-12 00:16:35 +05:30
test_otel_logging.py Improved wildcard route handling on /models and /model_group/info (#8473) 2025-02-11 19:37:43 -08:00
test_pagerduty_alerting.py (Feat) - Add PagerDuty Alerting Integration (#7478) 2025-01-01 07:12:51 -08:00
test_prometheus_unit_tests.py Improved wildcard route handling on /models and /model_group/info (#8473) 2025-02-11 19:37:43 -08:00
test_spend_logs.py (feat) - track org_id in SpendLogs (#8253) 2025-02-04 21:08:05 -08:00
test_standard_logging_payload.py (fix) GCS bucket logger - apply truncate_standard_logging_payload_content to standard_logging_payload and ensure GCS flushes queue on fails (#7519) 2025-01-03 08:09:03 -08:00
test_token_counting.py (Fixes) OpenAI Streaming Token Counting + Fixes usage track when litellm.turn_off_message_logging=True (#8156) 2025-01-31 15:06:37 -08:00
test_unit_test_litellm_logging.py (performance improvement - litellm sdk + proxy) - ensure litellm does not create unnecessary threads when running async functions (#7680) 2025-01-10 17:57:22 -08:00
test_unit_tests_init_callbacks.py test_init_custom_logger_compatible_class_as_callback 2025-01-24 21:27:22 -08:00
test_view_request_resp_logs.py (Feat) - Allow viewing Request/Response Logs stored in GCS Bucket (#8449) 2025-02-10 20:38:55 -08:00