phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

(docs) deploy on railway

Browse source
This commit is contained in:
ishaan-jaff 2023-12-28 16:35:18 +05:30
parent f3d572231f
commit ab306ad5d4
1 changed files with 8 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

8
docs/my-website/docs/proxy/deploy.md
View file

@ -105,6 +105,14 @@ curl https://litellm-7yjrj3ha2q-uc.a.run.app/v1/chat/completions \
}' }'
``` ```
## Deploy on Railway https://railway.app
**Step 1: Click the button** to deploy to Railway
[![Deploy on Railway](https://railway.app/button.svg)](https://railway.app/template/S7P9sn?referralCode=t3ukrU)
**Step 2:** Set `PORT` = 4000 on Railway Environment Variables
## LiteLLM Proxy Performance ## LiteLLM Proxy Performance
LiteLLM proxy has been load tested to handle 1500 req/s. LiteLLM proxy has been load tested to handle 1500 req/s.