phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

fix(utils.py): fix cache hits for streaming

Browse source 
Fixes https://github.com/BerriAI/litellm/issues/4109
This commit is contained in:
Krrish Dholakia 2024-07-26 19:03:42 -07:00
parent c0717133a9
commit fe0b55f2ca
5 changed files with 42 additions and 16 deletions
Download patch file Download diff file Expand all files Collapse all files

1
litellm/tests/test_proxy_server.py
View file

@ -625,6 +625,7 @@ def test_chat_completion_optional_params(mock_acompletion, client_no_auth):
# Run the test
# test_chat_completion_optional_params()
# Test Reading config.yaml file
from litellm.proxy.proxy_server import ProxyConfig