forked from phoenix/litellm-mirror
update load test doc
This commit is contained in:
parent
45a981a37e
commit
0c9c42915f
1 changed files with 1 additions and 1 deletions
|
@ -77,7 +77,7 @@ litellm_settings:
|
||||||
|
|
||||||
## Load test - Endpoints with Rate Limits
|
## Load test - Endpoints with Rate Limits
|
||||||
|
|
||||||
Run a load test on 2 LLM deployments each with 10K RPM Quota. Expect to see ~20K RPM (333 RPS)
|
Run a load test on 2 LLM deployments each with 10K RPM Quota. Expect to see ~20K RPM
|
||||||
|
|
||||||
### Expected Performance
|
### Expected Performance
|
||||||
|
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue