phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs(proxy/caching.md): add configuring user api key cache ttl to docs

Browse source
This commit is contained in:
Krrish Dholakia 2024-05-25 12:14:11 -07:00
parent 19321094da
commit 3c961136ea
1 changed files with 11 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

11
docs/my-website/docs/proxy/caching.md
View file

@ -487,3 +487,14 @@ cache_params:
s3_aws_session_token: your_session_token # AWS Session Token for temporary credentials
```
## Advanced - user api key cache ttl
Configure how long the in-memory cache stores the key object (prevents db requests)
```yaml
general_settings:
user_api_key_cache_ttl: <your-number> #time in seconds
```
By default this value is set to 60s.