forked from phoenix/litellm-mirror
(fix) docs litellm helm chart
This commit is contained in:
parent
21202a397f
commit
4a33c53619
2 changed files with 13 additions and 6 deletions
|
@ -2,7 +2,7 @@
|
|||
|
||||
## Prerequisites
|
||||
|
||||
- Kubernetes 1.23+
|
||||
- Kubernetes 1.21+
|
||||
- Helm 3.8.0+
|
||||
|
||||
If `db.deployStandalone` is used:
|
||||
|
|
|
@ -150,17 +150,20 @@ To avoid issues with predictability, difficulties in rollback, and inconsistent
|
|||
|
||||
|
||||
## Deploy with Database
|
||||
### Docker, Kubernetes, Helm Chart
|
||||
|
||||
|
||||
<Tabs>
|
||||
|
||||
<TabItem value="docker-deploy" label="Dockerfile">
|
||||
|
||||
We maintain a [seperate Dockerfile](https://github.com/BerriAI/litellm/pkgs/container/litellm-database) for reducing build time when running LiteLLM proxy with a connected Postgres Database
|
||||
|
||||
<Tabs>
|
||||
<TabItem value="docker-deploy" label="Dockerfile">
|
||||
|
||||
```
|
||||
```shell
|
||||
docker pull docker pull ghcr.io/berriai/litellm-database:main-latest
|
||||
```
|
||||
|
||||
```
|
||||
```shell
|
||||
docker run --name litellm-proxy \
|
||||
-e DATABASE_URL=postgresql://<user>:<password>@<host>:<port>/<dbname> \
|
||||
-p 4000:4000 \
|
||||
|
@ -233,6 +236,8 @@ Your OpenAI proxy server is now running on `http://0.0.0.0:4000`.
|
|||
</TabItem>
|
||||
<TabItem value="helm-deploy" label="Helm">
|
||||
|
||||
Use this to deploy litellm using a helm chart. Link to [the LiteLLM Helm Chart](https://github.com/BerriAI/litellm/tree/main/deploy/charts/litellm)
|
||||
|
||||
#### Step 1. Clone the repository
|
||||
|
||||
```bash
|
||||
|
@ -241,6 +246,8 @@ git clone https://github.com/BerriAI/litellm.git
|
|||
|
||||
#### Step 2. Deploy with Helm
|
||||
|
||||
Run the following command in the root of your `litellm` repo
|
||||
|
||||
```bash
|
||||
helm install \
|
||||
--set masterkey=SuPeRsEcReT \
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue