forked from phoenix/litellm-mirror
(fix) docs litellm helm chart
This commit is contained in:
parent
21202a397f
commit
4a33c53619
2 changed files with 13 additions and 6 deletions
|
@ -2,7 +2,7 @@
|
||||||
|
|
||||||
## Prerequisites
|
## Prerequisites
|
||||||
|
|
||||||
- Kubernetes 1.23+
|
- Kubernetes 1.21+
|
||||||
- Helm 3.8.0+
|
- Helm 3.8.0+
|
||||||
|
|
||||||
If `db.deployStandalone` is used:
|
If `db.deployStandalone` is used:
|
||||||
|
|
|
@ -150,17 +150,20 @@ To avoid issues with predictability, difficulties in rollback, and inconsistent
|
||||||
|
|
||||||
|
|
||||||
## Deploy with Database
|
## Deploy with Database
|
||||||
|
### Docker, Kubernetes, Helm Chart
|
||||||
|
|
||||||
|
|
||||||
|
<Tabs>
|
||||||
|
|
||||||
|
<TabItem value="docker-deploy" label="Dockerfile">
|
||||||
|
|
||||||
We maintain a [seperate Dockerfile](https://github.com/BerriAI/litellm/pkgs/container/litellm-database) for reducing build time when running LiteLLM proxy with a connected Postgres Database
|
We maintain a [seperate Dockerfile](https://github.com/BerriAI/litellm/pkgs/container/litellm-database) for reducing build time when running LiteLLM proxy with a connected Postgres Database
|
||||||
|
|
||||||
<Tabs>
|
```shell
|
||||||
<TabItem value="docker-deploy" label="Dockerfile">
|
|
||||||
|
|
||||||
```
|
|
||||||
docker pull docker pull ghcr.io/berriai/litellm-database:main-latest
|
docker pull docker pull ghcr.io/berriai/litellm-database:main-latest
|
||||||
```
|
```
|
||||||
|
|
||||||
```
|
```shell
|
||||||
docker run --name litellm-proxy \
|
docker run --name litellm-proxy \
|
||||||
-e DATABASE_URL=postgresql://<user>:<password>@<host>:<port>/<dbname> \
|
-e DATABASE_URL=postgresql://<user>:<password>@<host>:<port>/<dbname> \
|
||||||
-p 4000:4000 \
|
-p 4000:4000 \
|
||||||
|
@ -233,6 +236,8 @@ Your OpenAI proxy server is now running on `http://0.0.0.0:4000`.
|
||||||
</TabItem>
|
</TabItem>
|
||||||
<TabItem value="helm-deploy" label="Helm">
|
<TabItem value="helm-deploy" label="Helm">
|
||||||
|
|
||||||
|
Use this to deploy litellm using a helm chart. Link to [the LiteLLM Helm Chart](https://github.com/BerriAI/litellm/tree/main/deploy/charts/litellm)
|
||||||
|
|
||||||
#### Step 1. Clone the repository
|
#### Step 1. Clone the repository
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
|
@ -241,6 +246,8 @@ git clone https://github.com/BerriAI/litellm.git
|
||||||
|
|
||||||
#### Step 2. Deploy with Helm
|
#### Step 2. Deploy with Helm
|
||||||
|
|
||||||
|
Run the following command in the root of your `litellm` repo
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
helm install \
|
helm install \
|
||||||
--set masterkey=SuPeRsEcReT \
|
--set masterkey=SuPeRsEcReT \
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue