Commit graph

523 commits

Author SHA1 Message Date
Krrish Dholakia
49847347d0 fix(llm_guard.py): add streaming hook for moderation calls 2024-02-20 20:31:32 -08:00
Krrish Dholakia
b3886b4bda refactor(main.py): trigger new build 2024-02-19 22:53:38 -08:00
ishaan-jaff
854a7c92d5 (feat) /user/get_requests 2024-02-19 17:04:13 -08:00
ishaan-jaff
6985880506 (feat) use user_notification table 2024-02-19 16:53:40 -08:00
ishaan-jaff
a13565dd95 (feat) proxy - save model access requests 2024-02-19 16:35:20 -08:00
Krish Dholakia
9522f6a2c1
Merge pull request #2049 from BerriAI/litellm_return_all_teams_for_user
feat(proxy_server.py): return all teams, user is a member of in /user/info
2024-02-17 23:36:45 -08:00
Krrish Dholakia
d0813fd27f feat(proxy_server.py): return all teams, user is a member of in /user/info
https://github.com/BerriAI/litellm/issues/2014
2024-02-17 19:18:41 -08:00
ishaan-jaff
2927811c19 (fix) testing fix 2024-02-17 19:17:33 -08:00
ishaan-jaff
fdf3cd4c59 (fix) litellm bug in 2024-02-17 19:13:04 -08:00
Krrish Dholakia
bf77295168 feat(llama_guard.py): add llama guard support for content moderation + new async_moderation_hook endpoint 2024-02-17 19:13:04 -08:00
ishaan-jaff
901a1a3655 (fix) litellm bug in 2024-02-17 18:41:37 -08:00
Krrish Dholakia
2a4a6995ac feat(llama_guard.py): add llama guard support for content moderation + new async_moderation_hook endpoint 2024-02-16 18:45:25 -08:00
ishaan-jaff
23589a398a (feat) log request_tags in SpendLogs 2024-02-16 09:52:25 -08:00
ishaan-jaff
88037b68b0 (feat) track spend per team 2024-02-15 21:41:48 -08:00
Krish Dholakia
856aa9c30b
Merge branch 'main' into litellm_team_settings 2024-02-14 21:45:59 -08:00
Krrish Dholakia
8717ee6d9a feat(proxy_server.py): enable /team/info endpoint 2024-02-14 18:12:18 -08:00
Krrish Dholakia
c094db7160 feat(proxy_server.py): working /team/new endpoint for creating a new team 2024-02-14 17:20:41 -08:00
ishaan-jaff
5408a6de3d (feat) proxy add amoderation endpoint 2024-02-14 11:03:23 -08:00
Krrish Dholakia
f68b656040 feat(presidio_pii_masking.py): enable output parsing for pii masking 2024-02-13 21:36:57 -08:00
Krish Dholakia
1391490d92
Merge pull request #1931 from BerriAI/litellm_microsoft_presidio_pii
feat(proxy_server.py): support for pii masking with microsoft presidio
2024-02-11 00:27:14 -08:00
Ishaan Jaff
1cb8d2d3a3
Merge pull request #1933 from BerriAI/litellm_team_specific_models
[FEAT] Proxy - set team specific models
2024-02-10 21:40:13 -08:00
ishaan-jaff
7648aecf87 (fix) setting valid_models per team 2024-02-10 21:20:58 -08:00
ishaan-jaff
5ac5f6c53c (feat)team-specific models 2024-02-10 21:13:39 -08:00
Krrish Dholakia
2d845b12ed feat(proxy_server.py): support for pii masking with microsoft presidio 2024-02-10 20:21:12 -08:00
Krrish Dholakia
34c118e5e9 feat(ui): show key alias instead of hashed token 2024-02-10 15:45:42 -08:00
Krrish Dholakia
6b83001459 feat(proxy_server.py): support key lists for /key/info 2024-02-10 14:24:12 -08:00
Krrish Dholakia
43da22ae13 feat(proxy_server.py): show admin global spend as time series data 2024-02-09 16:31:35 -08:00
ishaan-jaff
8462e85792 (feat) alert for failing cost tracking 2024-02-07 18:49:45 -08:00
ishaan-jaff
258fe63e7d (fix) ui - when request body is None 2024-02-07 11:33:43 -08:00
Krish Dholakia
df60edfa07
Merge branch 'main' into litellm_spend_logging_high_traffic 2024-02-06 23:36:58 -08:00
Krish Dholakia
2bc710d8e9
Merge pull request #1843 from BerriAI/litellm_admin_ui_view_all_keys
feat(ui): enable admin to view all valid keys created on the proxy
2024-02-06 22:06:46 -08:00
Krrish Dholakia
4a0df3cb4f fix(proxy_cli.py-&&-proxy_server.py): bump reset budget intervals and fix pool limits for prisma connections 2024-02-06 19:39:49 -08:00
Ishaan Jaff
73c6ce890b
Merge pull request #1859 from BerriAI/litellm_allow_using_budgets_without_keys
[Feat] Budgets for 'user' param passed to /chat/completions, /embeddings etc
2024-02-06 16:32:25 -08:00
Krish Dholakia
9e9fb747ce
Merge branch 'main' into litellm_slack_langfuse_alerting 2024-02-06 15:48:52 -08:00
ishaan-jaff
52b864976b (feat) support max_user_budget 2024-02-06 15:19:36 -08:00
Krish Dholakia
e36566a212
Merge branch 'main' into litellm_admin_ui_view_all_keys 2024-02-06 14:34:57 -08:00
Krrish Dholakia
e5fec98e1f fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected) 2024-02-06 12:57:05 -08:00
Krrish Dholakia
f2a7e2ee98 feat(ui): enable admin to view all valid keys created on the proxy 2024-02-05 19:28:57 -08:00
Krrish Dholakia
e35a7c32cb fix(proxy/utils.py): if langfuse trace id passed in, just send that as part of alert 2024-02-05 16:34:33 -08:00
Krrish Dholakia
ef0171e063 feat(utils.py): support cost tracking for openai/azure image gen models 2024-02-03 17:09:54 -08:00
Krrish Dholakia
5f9ea8a94f fix(utils.py): add track cost callback to callback list for team id callbacks 2024-02-02 08:18:06 -08:00
Krrish Dholakia
92058cbcd4 fix(utils.py): override default success callbacks with dynamic callbacks if set 2024-02-02 06:21:43 -08:00
ishaan-jaff
e13e61ad3b (docs) proxy ui 2024-02-01 16:17:04 -08:00
ishaan-jaff
44bf1409e0 (fix) ui link 2024-02-01 16:14:29 -08:00
ishaan-jaff
83cbed8b20 (fix) default UI use master key for auth 2024-02-01 16:05:23 -08:00
ishaan-jaff
26520dd4e4 (fix) ui improve default flow 2024-02-01 15:03:48 -08:00
Krish Dholakia
ce415a243d
Merge branch 'main' into litellm_no_store_cache_control 2024-01-30 21:44:57 -08:00
Krrish Dholakia
f9acad87dc feat(proxy_server.py): enable cache controls per key + no-store cache flag 2024-01-30 20:46:50 -08:00
ishaan-jaff
8daabe16f4 (feat) allow users to use UI without SSO 2024-01-30 17:00:40 -08:00
Krrish Dholakia
bbe71c8375 fix(test_parallel_request_limiter): increase time limit for waiting for success logging event to happen 2024-01-30 13:26:17 -08:00