phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

(docs) cache context manager

Browse source
This commit is contained in:
ishaan-jaff 2023-12-30 19:50:22 +05:30
parent 1c93642951
commit bf4a9f40e8
1 changed files with 17 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

17
docs/my-website/docs/caching/redis_cache.md
View file

@ -60,6 +60,23 @@ Switch caching off
litellm.disable_cache() litellm.disable_cache()
``` ```
### Updating Cache Params (Redis Host, Port etc)
Update the Cache params
```python
litellm.update_cache(
type: Optional[Literal["local", "redis"]] = "local",
host: Optional[str] = None,
port: Optional[str] = None,
password: Optional[str] = None,
supported_call_types: Optional[
List[Literal["completion", "acompletion", "embedding", "aembedding"]]
] = ["completion", "acompletion", "embedding", "aembedding"],
**kwargs,
)
```
## Custom Cache Keys: ## Custom Cache Keys:
Define function to return cache key Define function to return cache key
```python ```python