(fix) docs litellm helm chart

This commit is contained in:
ishaan-jaff 2024-03-15 16:07:43 -07:00
parent 21202a397f
commit 4a33c53619
2 changed files with 13 additions and 6 deletions

View file

@ -2,7 +2,7 @@
## Prerequisites ## Prerequisites
- Kubernetes 1.23+ - Kubernetes 1.21+
- Helm 3.8.0+ - Helm 3.8.0+
If `db.deployStandalone` is used: If `db.deployStandalone` is used:

View file

@ -150,17 +150,20 @@ To avoid issues with predictability, difficulties in rollback, and inconsistent
## Deploy with Database ## Deploy with Database
### Docker, Kubernetes, Helm Chart
<Tabs>
<TabItem value="docker-deploy" label="Dockerfile">
We maintain a [seperate Dockerfile](https://github.com/BerriAI/litellm/pkgs/container/litellm-database) for reducing build time when running LiteLLM proxy with a connected Postgres Database We maintain a [seperate Dockerfile](https://github.com/BerriAI/litellm/pkgs/container/litellm-database) for reducing build time when running LiteLLM proxy with a connected Postgres Database
<Tabs> ```shell
<TabItem value="docker-deploy" label="Dockerfile">
```
docker pull docker pull ghcr.io/berriai/litellm-database:main-latest docker pull docker pull ghcr.io/berriai/litellm-database:main-latest
``` ```
``` ```shell
docker run --name litellm-proxy \ docker run --name litellm-proxy \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:<port>/<dbname> \ -e DATABASE_URL=postgresql://<user>:<password>@<host>:<port>/<dbname> \
-p 4000:4000 \ -p 4000:4000 \
@ -233,6 +236,8 @@ Your OpenAI proxy server is now running on `http://0.0.0.0:4000`.
</TabItem> </TabItem>
<TabItem value="helm-deploy" label="Helm"> <TabItem value="helm-deploy" label="Helm">
Use this to deploy litellm using a helm chart. Link to [the LiteLLM Helm Chart](https://github.com/BerriAI/litellm/tree/main/deploy/charts/litellm)
#### Step 1. Clone the repository #### Step 1. Clone the repository
```bash ```bash
@ -241,6 +246,8 @@ git clone https://github.com/BerriAI/litellm.git
#### Step 2. Deploy with Helm #### Step 2. Deploy with Helm
Run the following command in the root of your `litellm` repo
```bash ```bash
helm install \ helm install \
--set masterkey=SuPeRsEcReT \ --set masterkey=SuPeRsEcReT \