phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

fix rps / rpm values on load testing

Browse source
This commit is contained in:
Ishaan Jaff 2024-09-10 11:22:19 -07:00
parent a0e4510f53
commit 87bac7c026
1 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

6
docs/my-website/docs/proxy/prod.md
View file

@ -107,9 +107,9 @@ export LITELLM_SALT_KEY="sk-1234"
|--------------|-------| |--------------|-------|
| Avg latency | `50ms` | | Avg latency | `50ms` |
| Median latency | `51ms` | | Median latency | `51ms` |
| `/chat/completions` Requests/second | `35` | | `/chat/completions` Requests/second | `100` |
| `/chat/completions` Requests/minute | `2100` | | `/chat/completions` Requests/minute | `6000` |
| `/chat/completions` Requests/hour | `126K` | | `/chat/completions` Requests/hour | `360K` |
### Verifying Debugging logs are off ### Verifying Debugging logs are off