From eb3806feba33e13afadb0ea48f3fb71f29142cb0 Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Thu, 28 Mar 2024 15:26:26 -0700 Subject: [PATCH] docs(prod.md): update docs with litellm spend logs server machine spec --- docs/my-website/docs/proxy/prod.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/docs/my-website/docs/proxy/prod.md b/docs/my-website/docs/proxy/prod.md index 6f25e2636..6cd1bc2fa 100644 --- a/docs/my-website/docs/proxy/prod.md +++ b/docs/my-website/docs/proxy/prod.md @@ -112,6 +112,13 @@ Received and stored 1 logs. Total logs in memory: 1 Flushed 1 log to the DB. ``` + +### Machine Specification + +A t2.micro should be sufficient to handle 1k logs / minute on this server. + +This consumes at max 120MB, and <0.1 vCPU. + ## 4. Switch off resetting budgets Add this to your config.yaml. (Only spend per Key, User and Team will be tracked - spend per API Call will not be written to the LiteLLM Database)