forked from phoenix/litellm-mirror
docs(configs.md): add litellm config / s3 bucket object info in configs.md
This commit is contained in:
parent
b35da5014b
commit
60baa65e0e
1 changed files with 50 additions and 0 deletions
|
@ -882,3 +882,53 @@ $ litellm
|
|||
```
|
||||
|
||||
|
||||
### Providing LiteLLM config.yaml file as a s3, GCS Bucket Object/url
|
||||
|
||||
Use this if you cannot mount a config file on your deployment service (example - AWS Fargate, Railway etc)
|
||||
|
||||
LiteLLM Proxy will read your config.yaml from an s3 Bucket or GCS Bucket
|
||||
|
||||
<Tabs>
|
||||
<TabItem value="gcs" label="GCS Bucket">
|
||||
|
||||
Set the following .env vars
|
||||
```shell
|
||||
LITELLM_CONFIG_BUCKET_TYPE = "gcs" # set this to "gcs"
|
||||
LITELLM_CONFIG_BUCKET_NAME = "litellm-proxy" # your bucket name on GCS
|
||||
LITELLM_CONFIG_BUCKET_OBJECT_KEY = "proxy_config.yaml" # object key on GCS
|
||||
```
|
||||
|
||||
Start litellm proxy with these env vars - litellm will read your config from GCS
|
||||
|
||||
```shell
|
||||
docker run --name litellm-proxy \
|
||||
-e DATABASE_URL=<database_url> \
|
||||
-e LITELLM_CONFIG_BUCKET_NAME=<bucket_name> \
|
||||
-e LITELLM_CONFIG_BUCKET_OBJECT_KEY="<object_key>> \
|
||||
-e LITELLM_CONFIG_BUCKET_TYPE="gcs" \
|
||||
-p 4000:4000 \
|
||||
ghcr.io/berriai/litellm-database:main-latest --detailed_debug
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
|
||||
<TabItem value="s3" label="s3">
|
||||
|
||||
Set the following .env vars
|
||||
```shell
|
||||
LITELLM_CONFIG_BUCKET_NAME = "litellm-proxy" # your bucket name on s3
|
||||
LITELLM_CONFIG_BUCKET_OBJECT_KEY = "litellm_proxy_config.yaml" # object key on s3
|
||||
```
|
||||
|
||||
Start litellm proxy with these env vars - litellm will read your config from s3
|
||||
|
||||
```shell
|
||||
docker run --name litellm-proxy \
|
||||
-e DATABASE_URL=<database_url> \
|
||||
-e LITELLM_CONFIG_BUCKET_NAME=<bucket_name> \
|
||||
-e LITELLM_CONFIG_BUCKET_OBJECT_KEY="<object_key>> \
|
||||
-p 4000:4000 \
|
||||
ghcr.io/berriai/litellm-database:main-latest
|
||||
```
|
||||
</TabItem>
|
||||
</Tabs>
|
Loading…
Add table
Add a link
Reference in a new issue