phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 11:14:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

refactor: instrument 'dynamic_rate_limiting' callback on proxy

Browse source
This commit is contained in:
Krrish Dholakia 2024-06-22 00:32:29 -07:00
parent 6a7982fa40
commit 8f95381276
8 changed files with 136 additions and 28 deletions
Download patch file Download diff file Expand all files Collapse all files

1
litellm/proxy/hooks/dynamic_rate_limiter.py
View file

@ -131,7 +131,6 @@ class _PROXY_DynamicRateLimitHandler(CustomLogger):
- Check if tpm available
- Raise RateLimitError if no tpm available
"""
if "model" in data:
available_tpm, model_tpm, active_projects = await self.check_available_tpm(
model=data["model"]