litellm/docs/my-website/docs/caching
Ajeet D'Souza 0533f77138
docs: add time.sleep() between streaming calls
LiteLLM's cache appears to be updated in the background. Without this `time.sleep()` call, both responses take `0.8s` to return, but after adding it, the second response returns in `0.006s`.
2024-08-28 17:59:07 +05:30
..
all_caches.md fix qdrant semantic cache 2024-08-26 09:25:59 -07:00
caching_api.md docs: add time.sleep() between streaming calls 2024-08-28 17:59:07 +05:30
local_caching.md docs: add disk cache doc and update cache arguments 2024-05-10 12:17:03 +02:00