Commit graph

7083 commits

Author SHA1 Message Date
Krish Dholakia
e36566a212
Merge branch 'main' into litellm_admin_ui_view_all_keys 2024-02-06 14:34:57 -08:00
Krish Dholakia
db68b837e2
Merge pull request #1847 from BerriAI/litellm_vertex_ai_streaming_fix
fix(utils.py): return finish reason for last vertex ai chunk
2024-02-06 14:34:09 -08:00
Krish Dholakia
f70bbc7b2e
Merge branch 'main' into litellm_vertex_ai_streaming_fix 2024-02-06 14:33:54 -08:00
Krish Dholakia
284a256ccf
Merge pull request #1856 from BerriAI/litellm_fix_proxy_health_readiness
fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected)
2024-02-06 14:32:15 -08:00
Krish Dholakia
4fe4d0c1f3
Merge branch 'main' into litellm_fix_proxy_health_readiness 2024-02-06 14:31:57 -08:00
Krrish Dholakia
191eef06de build(requirements.txt): fix dependency 2024-02-06 14:10:56 -08:00
ishaan-jaff
223cc88f0c (ci/cd) run again 2024-02-06 14:00:27 -08:00
ishaan-jaff
7f870ebced (feat) redis-semantic cache on proxy 2024-02-06 13:58:20 -08:00
ishaan-jaff
3fa5bba4ea (fix) add redisvl==0.0.7 2024-02-06 13:58:20 -08:00
Krrish Dholakia
c46aca7951 refactor(main.py): trigger deploy
n
2024-02-06 13:58:20 -08:00
ishaan-jaff
2b9a48eb6c (fix) redisvl requirements.txt issue 2024-02-06 13:58:20 -08:00
ishaan-jaff
3a5923cffa (fix) langfuse show semantic-similarity in tags 2024-02-06 13:58:20 -08:00
ishaan-jaff
8bce6d4fb2 (fix) dockerfile requirements.txt 2024-02-06 13:58:20 -08:00
ishaan-jaff
d9f407b4c2 (feat) show semantic-cache on health/readiness 2024-02-06 13:58:20 -08:00
ishaan-jaff
3d1d447db9 (feat) redis-semantic cache on proxy 2024-02-06 13:58:20 -08:00
ishaan-jaff
ff7d05aaef (fix) add redisvl==0.0.7 2024-02-06 13:58:20 -08:00
ishaan-jaff
d05984ef13 (feat) working semantic cache on proxy 2024-02-06 13:58:13 -08:00
Krrish Dholakia
d1549cb2f3 refactor(main.py): trigger deploy
n
2024-02-06 13:55:51 -08:00
ishaan-jaff
4233e2b850 (fix) redisvl requirements.txt issue 2024-02-06 13:52:32 -08:00
ishaan-jaff
a6afba8cf2 (fix) langfuse show semantic-similarity in tags 2024-02-06 13:41:22 -08:00
ishaan-jaff
f19b2becac (fix) dockerfile requirements.txt 2024-02-06 13:36:35 -08:00
ishaan-jaff
3d0ece828a (feat) show semantic-cache on health/readiness 2024-02-06 13:35:34 -08:00
Krrish Dholakia
f0d4b62b6b test(test_completion.py): fix test 2024-02-06 13:32:03 -08:00
ishaan-jaff
f0e632ebc8 (ci/cd) run again 2024-02-06 13:32:03 -08:00
ishaan-jaff
d2a44de4c9 (fix) mark semantic caching as beta test 2024-02-06 13:32:03 -08:00
ishaan-jaff
ba4ca4d02a (fix) semantic caching 2024-02-06 13:32:03 -08:00
ishaan-jaff
bf6e3f807b (docs) litellm semantic caching 2024-02-06 13:32:03 -08:00
ishaan-jaff
f244e56893 (docs) redis cache 2024-02-06 13:32:03 -08:00
ishaan-jaff
9f7ec4c9f9 (fix) test-semantic caching 2024-02-06 13:32:03 -08:00
ishaan-jaff
755f44613d (feat) redis-semantic cache on proxy 2024-02-06 13:32:03 -08:00
ishaan-jaff
c1e9041506 (docs) using semantic caching on proxy 2024-02-06 13:32:03 -08:00
ishaan-jaff
e74363b480 (fix) use semantic cache on proxy 2024-02-06 13:32:03 -08:00
ishaan-jaff
48fa97125d allow setting redis_semantic cache_embedding model 2024-02-06 13:32:03 -08:00
ishaan-jaff
80af1c9a58 (feat) log semantic_sim to langfuse 2024-02-06 13:32:03 -08:00
ishaan-jaff
6edf675e41 (fix) add redisvl==0.0.7 2024-02-06 13:32:03 -08:00
ishaan-jaff
2881e7b111 (feat) working semantic cache on proxy 2024-02-06 13:32:03 -08:00
ishaan-jaff
5f2877e699 (feat) redis-semantic cache 2024-02-06 13:31:58 -08:00
ishaan-jaff
f1dea5571a (feat) working semantic-cache on litellm proxy 2024-02-06 13:31:58 -08:00
ishaan-jaff
8a75cbd3ad (test) async semantic cache 2024-02-06 13:31:58 -08:00
ishaan-jaff
f66b6f5cd7 (feat) RedisSemanticCache - async 2024-02-06 13:31:58 -08:00
ishaan-jaff
58c4a29fbc (fix) semantic cache 2024-02-06 13:31:58 -08:00
ishaan-jaff
28676b2e0b (test) semantic caching 2024-02-06 13:31:58 -08:00
ishaan-jaff
5d345b5b57 (test) semantic cache 2024-02-06 13:31:58 -08:00
ishaan-jaff
8436c0489c (feat) working - sync semantic caching 2024-02-06 13:31:58 -08:00
ishaan-jaff
6a5e96ac1b (feat )add semantic cache 2024-02-06 13:31:58 -08:00
ishaan-jaff
dc9cb13e10 (feat) show langfuse logging tags better through proxy 2024-02-06 13:31:58 -08:00
Krrish Dholakia
8ed9573931 test(test_completion.py): fix test 2024-02-06 13:30:59 -08:00
ishaan-jaff
54a86b192d (ci/cd) run again 2024-02-06 13:30:59 -08:00
ishaan-jaff
4d9eb840f9 (fix) mark semantic caching as beta test 2024-02-06 13:30:59 -08:00
ishaan-jaff
d54428f1c5 (fix) semantic caching 2024-02-06 13:30:59 -08:00