phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs(proxy/caching.md): add ttl param to proxy/caching.md

Browse source
This commit is contained in:
Krrish Dholakia 2024-03-25 13:46:52 -07:00
parent 591a0a376e
commit 16ade7e556
1 changed files with 12 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

13
docs/my-website/docs/proxy/caching.md
View file

@ -32,8 +32,9 @@ litellm_settings:
cache: True # set cache responses to True, litellm defaults to using a redis cache cache: True # set cache responses to True, litellm defaults to using a redis cache
``` ```
#### [OPTIONAL] Step 1.5: Add redis namespaces #### [OPTIONAL] Step 1.5: Add redis namespaces, default ttl
## Namespace
If you want to create some folder for your keys, you can set a namespace, like this: If you want to create some folder for your keys, you can set a namespace, like this:
```yaml ```yaml
@ -50,6 +51,16 @@ and keys will be stored like:
litellm_caching:<hash> litellm_caching:<hash>
``` ```
## TTL
```yaml
litellm_settings:
cache: true
cache_params: # set cache params for redis
type: redis
ttl: 600 # will be cached on redis for 600s
```
#### Step 2: Add Redis Credentials to .env #### Step 2: Add Redis Credentials to .env
Set either `REDIS_URL` or the `REDIS_HOST` in your os environment, to enable caching. Set either `REDIS_URL` or the `REDIS_HOST` in your os environment, to enable caching.