phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

(docs) caching

Browse source
This commit is contained in:
ishaan-jaff 2023-12-30 19:04:33 +05:30
parent 8ff3bbcfee
commit 231148ed73
1 changed files with 3 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

8
docs/my-website/docs/caching/redis_cache.md
View file

@ -4,7 +4,7 @@
### Pre-requisites
Install redis
```
```shell
pip install redis
```
For the hosted version you can setup your own Redis DB here: https://app.redislabs.com/
@ -18,13 +18,11 @@ litellm.cache = Cache(type="redis", host=<host>, port=<port>, password=<password
# Make completion calls
response1 = completion(
model="gpt-3.5-turbo",
messages=[{"role": "user", "content": "Tell me a joke."}],
caching=True
messages=[{"role": "user", "content": "Tell me a joke."}]
)
response2 = completion(
model="gpt-3.5-turbo",
messages=[{"role": "user", "content": "Tell me a joke."}],
caching=True
messages=[{"role": "user", "content": "Tell me a joke."}]
)
# response1 == response2, response 1 is cached