litellm-mirror/litellm/proxy/auth
Krish Dholakia 4f8a3fd4cf
redis otel tracing + async support for latency routing (#6452)
* docs(exception_mapping.md): add missing exception types

Fixes https://github.com/Aider-AI/aider/issues/2120#issuecomment-2438971183

* fix(main.py): register custom model pricing with specific key

Ensure custom model pricing is registered to the specific model+provider key combination

* test: make testing more robust for custom pricing

* fix(redis_cache.py): instrument otel logging for sync redis calls

ensures complete coverage for all redis cache calls

* refactor: pass parent_otel_span for redis caching calls in router

allows for more observability into what calls are causing latency issues

* test: update tests with new params

* refactor: ensure e2e otel tracing for router

* refactor(router.py): add more otel tracing acrosss router

catch all latency issues for router requests

* fix: fix linting error

* fix(router.py): fix linting error

* fix: fix test

* test: fix tests

* fix(dual_cache.py): pass ttl to redis cache

* fix: fix param
2024-10-28 21:52:12 -07:00
..
auth_checks.py test_is_ui_route_allowed 2024-10-25 10:37:11 +04:00
auth_checks_organization.py (feat proxy) [beta] add support for organization role based access controls (#6112) 2024-10-09 15:18:18 +05:30
auth_utils.py LiteLLM Minor Fixes & Improvements (10/17/2024) (#6293) 2024-10-17 22:09:11 -07:00
handle_jwt.py LiteLLM Minor Fixes & Improvements (10/18/2024) (#6320) 2024-10-19 22:23:27 -07:00
litellm_license.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
model_checks.py fix: Minor LiteLLM Fixes + Improvements (29/08/2024) (#5436) 2024-08-29 22:40:25 -07:00
oauth2_check.py pass llm provider when creating async httpx clients 2024-09-10 11:51:42 -07:00
oauth2_proxy_hook.py add hook for oauth2 proxy 2024-08-28 15:51:20 -07:00
public_key.pem fix update public key 2024-07-27 09:45:58 -07:00
rds_iam_token.py LiteLLM Minor Fixes & Improvements (09/25/2024) (#5893) 2024-09-26 16:41:44 -07:00
route_checks.py use helper for _route_matches_pattern 2024-10-25 10:31:21 +04:00
service_account_checks.py [Feat-Proxy] add service accounts backend (#5852) 2024-09-23 16:37:02 -07:00
user_api_key_auth.py redis otel tracing + async support for latency routing (#6452) 2024-10-28 21:52:12 -07:00