phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 10:44:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

v0 add rerank on litellm proxy

Browse source
This commit is contained in:
Ishaan Jaff 2024-08-27 17:28:39 -07:00
parent 37ed201c50
commit fb5be57bb8
12 changed files with 138 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
litellm/proxy/hooks/dynamic_rate_limiter.py
View file

@ -199,6 +199,7 @@ class _PROXY_DynamicRateLimitHandler(CustomLogger):
"moderation",
"audio_transcription",
"pass_through_endpoint",
"rerank",
],
) -> Optional[
Union[Exception, str, dict]