Commit graph

4168 commits

Author SHA1 Message Date
ishaan-jaff
8436c0489c (feat) working - sync semantic caching 2024-02-06 13:31:58 -08:00
ishaan-jaff
6a5e96ac1b (feat )add semantic cache 2024-02-06 13:31:58 -08:00
ishaan-jaff
dc9cb13e10 (feat) show langfuse logging tags better through proxy 2024-02-06 13:31:58 -08:00
Krrish Dholakia
8ed9573931 test(test_completion.py): fix test 2024-02-06 13:30:59 -08:00
ishaan-jaff
54a86b192d (ci/cd) run again 2024-02-06 13:30:59 -08:00
ishaan-jaff
4d9eb840f9 (fix) mark semantic caching as beta test 2024-02-06 13:30:59 -08:00
ishaan-jaff
d54428f1c5 (fix) semantic caching 2024-02-06 13:30:59 -08:00
ishaan-jaff
f71f34e680 (fix) test-semantic caching 2024-02-06 13:30:59 -08:00
ishaan-jaff
4265c7affb (feat) redis-semantic cache on proxy 2024-02-06 13:30:59 -08:00
ishaan-jaff
76e479542e (fix) use semantic cache on proxy 2024-02-06 13:30:59 -08:00
ishaan-jaff
bf74359287 allow setting redis_semantic cache_embedding model 2024-02-06 13:30:59 -08:00
ishaan-jaff
666a553fca (feat) log semantic_sim to langfuse 2024-02-06 13:30:59 -08:00
ishaan-jaff
e9d00a92ed (feat) working semantic cache on proxy 2024-02-06 13:30:59 -08:00
ishaan-jaff
ef32a5da1b (feat) redis-semantic cache 2024-02-06 13:30:55 -08:00
ishaan-jaff
0c488a7cc7 (feat) working semantic-cache on litellm proxy 2024-02-06 13:30:55 -08:00
ishaan-jaff
ca5f83d5fe (test) async semantic cache 2024-02-06 13:30:55 -08:00
ishaan-jaff
97fbfc07b4 (feat) RedisSemanticCache - async 2024-02-06 13:30:55 -08:00
ishaan-jaff
05d64acdd3 (fix) semantic cache 2024-02-06 13:30:55 -08:00
ishaan-jaff
5d6af6b7d6 (test) semantic caching 2024-02-06 13:30:55 -08:00
ishaan-jaff
b8a1cc4e42 (test) semantic cache 2024-02-06 13:30:55 -08:00
ishaan-jaff
bc22fda64e (feat) working - sync semantic caching 2024-02-06 13:30:55 -08:00
ishaan-jaff
fa1681fe7a (feat )add semantic cache 2024-02-06 13:30:55 -08:00
ishaan-jaff
e6e340cd46 (feat) show langfuse logging tags better through proxy 2024-02-06 13:30:55 -08:00
Krrish Dholakia
cde96b8ba0 test(test_completion.py): fix test 2024-02-06 13:30:31 -08:00
ishaan-jaff
667e006dbf (ci/cd) run again 2024-02-06 13:30:31 -08:00
ishaan-jaff
548d56ac42 (fix) mark semantic caching as beta test 2024-02-06 13:30:31 -08:00
ishaan-jaff
ca26ecc4dc (fix) semantic caching 2024-02-06 13:30:31 -08:00
ishaan-jaff
b2c78108c8 (fix) test-semantic caching 2024-02-06 13:30:31 -08:00
ishaan-jaff
a8d190f507 (feat) redis-semantic cache on proxy 2024-02-06 13:30:31 -08:00
ishaan-jaff
63e91eb2c4 (fix) use semantic cache on proxy 2024-02-06 13:30:31 -08:00
ishaan-jaff
000afc1391 allow setting redis_semantic cache_embedding model 2024-02-06 13:30:31 -08:00
ishaan-jaff
74fb4e4cba (feat) log semantic_sim to langfuse 2024-02-06 13:30:31 -08:00
ishaan-jaff
a7b3148c99 (feat) working semantic cache on proxy 2024-02-06 13:30:30 -08:00
ishaan-jaff
2b86c3a9b4 (feat) redis-semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaff
ba0d92c712 (feat) working semantic-cache on litellm proxy 2024-02-06 13:30:17 -08:00
ishaan-jaff
87b5b418d8 (test) async semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaff
b2f9dde360 (feat) RedisSemanticCache - async 2024-02-06 13:30:17 -08:00
ishaan-jaff
b63fe39ed2 (fix) semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaff
4450be0a64 (test) semantic caching 2024-02-06 13:30:17 -08:00
ishaan-jaff
80e1d901d8 (test) semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaff
80865f93b8 (feat) working - sync semantic caching 2024-02-06 13:30:17 -08:00
ishaan-jaff
168a2f7806 (feat )add semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaff
a73d57b32b (feat) show langfuse logging tags better through proxy 2024-02-06 13:30:17 -08:00
Krrish Dholakia
fa5f4b9774 test(test_completion.py): fix test 2024-02-06 13:29:47 -08:00
ishaan-jaff
79c225a60f (ci/cd) run again 2024-02-06 13:26:48 -08:00
Ishaan Jaff
8a8f538329
Merge pull request #1829 from BerriAI/litellm_add_semantic_cache
[Feat] Add Semantic Caching to litellm💰
2024-02-06 13:18:59 -08:00
Krrish Dholakia
420d2754d7 fix(utils.py): round max tokens to be int always 2024-02-06 13:17:57 -08:00
ishaan-jaff
bc6d29f879 (ci/cd) run again 2024-02-06 13:17:57 -08:00
ishaan-jaff
1bcd2eafd2 (ci/cd) run again 2024-02-06 13:17:57 -08:00
ishaan-jaff
86c84d72e5 (ci/cd) fix test_config_no_auth 2024-02-06 13:17:57 -08:00