phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs(prod.md): update docs with litellm spend logs server machine spec

Browse source
This commit is contained in:
Krrish Dholakia 2024-03-28 15:26:26 -07:00
parent 8c9623a6bc
commit eb3806feba
1 changed files with 7 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

7
docs/my-website/docs/proxy/prod.md
View file

@ -112,6 +112,13 @@ Received and stored 1 logs. Total logs in memory: 1
Flushed 1 log to the DB. Flushed 1 log to the DB.
``` ```
### Machine Specification
A t2.micro should be sufficient to handle 1k logs / minute on this server.
This consumes at max 120MB, and <0.1 vCPU.
## 4. Switch off resetting budgets ## 4. Switch off resetting budgets
Add this to your config.yaml. (Only spend per Key, User and Team will be tracked - spend per API Call will not be written to the LiteLLM Database) Add this to your config.yaml. (Only spend per Key, User and Team will be tracked - spend per API Call will not be written to the LiteLLM Database)