Commit graph

2 commits

Author SHA1 Message Date
Sunny Wan
a3c70a099e fixed memory leak and added test 2025-03-04 18:12:26 -05:00
Ishaan Jaff
753290e5b8
(perf) Fix memory leak on /completions route (#8551)
* initial mem util test

* fix _cached_get_model_info_helper

* test memory usage

* fix tests

* fix mem usage
2025-02-14 18:58:16 -08:00