From 87bac7c026c228184dfb513be74ed6480f54cc02 Mon Sep 17 00:00:00 2001 From: Ishaan Jaff Date: Tue, 10 Sep 2024 11:22:19 -0700 Subject: [PATCH] fix rps / rpm values on load testing --- docs/my-website/docs/proxy/prod.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/my-website/docs/proxy/prod.md b/docs/my-website/docs/proxy/prod.md index 654d8cc2d..2fb4dd3b3 100644 --- a/docs/my-website/docs/proxy/prod.md +++ b/docs/my-website/docs/proxy/prod.md @@ -107,9 +107,9 @@ export LITELLM_SALT_KEY="sk-1234" |--------------|-------| | Avg latency | `50ms` | | Median latency | `51ms` | -| `/chat/completions` Requests/second | `35` | -| `/chat/completions` Requests/minute | `2100` | -| `/chat/completions` Requests/hour | `126K` | +| `/chat/completions` Requests/second | `100` | +| `/chat/completions` Requests/minute | `6000` | +| `/chat/completions` Requests/hour | `360K` | ### Verifying Debugging logs are off