litellm/docs
Ajeet D'Souza 0533f77138
docs: add time.sleep() between streaming calls
LiteLLM's cache appears to be updated in the background. Without this `time.sleep()` call, both responses take `0.8s` to return, but after adding it, the second response returns in `0.006s`.
2024-08-28 17:59:07 +05:30
..
my-website docs: add time.sleep() between streaming calls 2024-08-28 17:59:07 +05:30