phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

fix(caching.py): hash the cache key to prevent key too long errors

Browse source
This commit is contained in:
Krrish Dholakia 2023-12-29 15:03:33 +05:30
parent 6e68cd1125
commit 1e07f0fce8
3 changed files with 28 additions and 13 deletions
Download patch file Download diff file Expand all files Collapse all files

2
docs/my-website/docs/load_test.md
View file

@ -1,6 +1,6 @@
# 🔥 Load Test LiteLLM
Here is a script to load test LiteLLM
Here is a script to load test LiteLLM vs OpenAI
```python
from openai import AsyncOpenAI, AsyncAzureOpenAI