phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-03 18:00:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/tests/unit/providers/utils/cache
History
William Caban 299c575daa feat(cache): add cache store abstraction layer 
Implement reusable cache store abstraction with in-memory and Redis
backends as foundation for prompt caching feature (PR1 of progressive delivery).

- Add CacheStore protocol defining cache interface
- Implement MemoryCacheStore with LRU, LFU, and TTL-only eviction policies
- Implement RedisCacheStore with connection pooling and retry logic
- Add CircuitBreaker for cache backend failure protection
- Include comprehensive unit tests (55 tests, >80% coverage)
- Add dependencies: cachetools>=5.5.0, redis>=5.2.0

This abstraction enables flexible caching implementations for the prompt
caching middleware without coupling to specific storage backends.

Signed-by: William Caban <willliam.caban@gmail.com>
2025-11-15 14:55:18 -05:00
..
__init__.py feat(cache): add cache store abstraction layer 2025-11-15 14:55:18 -05:00
test_cache_store.py feat(cache): add cache store abstraction layer 2025-11-15 14:55:18 -05:00
test_memory_cache.py feat(cache): add cache store abstraction layer 2025-11-15 14:55:18 -05:00
test_redis_cache.py feat(cache): add cache store abstraction layer 2025-11-15 14:55:18 -05:00