Ishaan Jaff
|
ba56e37244
|
(refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208)
* use folder for caching
* fix importing caching
* fix clickhouse pyright
* fix linting
* fix correctly pass kwargs and args
* fix test case for embedding
* fix linting
* fix embedding caching logic
* fix refactor handle utils.py
* fix test_embedding_caching_azure_individual_items_reordered
|
2024-10-14 16:34:01 +05:30 |
|
Ishaan Jaff
|
0d027b22fd
|
[Feat-Proxy] Slack Alerting - allow using os.environ/ vars for alert to webhook url (#5726)
* allow using os.environ for slack urls
* use env vars for webhook urls
* fix types for get_secret
* fix linting
* fix linting
* fix linting
* linting fixes
* linting fix
* docs alerting slack
* fix get data
|
2024-09-16 18:03:37 -07:00 |
|
Ishaan Jaff
|
359a003ac8
|
v0 add rerank on litellm proxy
|
2024-08-27 17:28:39 -07:00 |
|
Ishaan Jaff
|
a8e192a868
|
fix use guardrail for pre call hook
|
2024-08-23 09:34:08 -07:00 |
|
Ishaan Jaff
|
6e3f27cf69
|
add custom guardrail reference
|
2024-08-23 08:32:07 -07:00 |
|