phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs(deploy.md): add iam-based auth to rds

Browse source
This commit is contained in:
Krrish Dholakia 2024-08-06 14:29:39 -07:00
parent 47346112e1
commit 2a95484a83
1 changed files with 28 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

28
docs/my-website/docs/proxy/deploy.md
View file

@ -827,3 +827,31 @@ Run the command `docker-compose up` or `docker compose up` as per your docker in
Your LiteLLM container should be running now on the defined port e.g. `4000`.
### IAM-based Auth for RDS DB
1. Set AWS env var
```bash
export AWS_WEB_IDENTITY_TOKEN='/path/to/token'
export AWS_ROLE_NAME='arn:aws:iam::123456789012:role/MyRole'
export AWS_SESSION_NAME='MySession'
```
[**See all Auth options**](https://github.com/BerriAI/litellm/blob/089a4f279ad61b7b3e213d8039fb9b75204a7abc/litellm/proxy/auth/rds_iam_token.py#L165)
2. Add RDS credentials to env
```bash
export DATABASE_USER="db-user"
export DATABASE_PORT="5432"
export DATABASE_HOST="database-1-instance-1.cs1ksmwz2xt3.us-west-2.rds.amazonaws.com"
export DATABASE_NAME="database-1-instance-1"
```
3. Run proxy with iam+rds
```bash
litellm --config /path/to/config.yaml --iam_token_db_auth
```