Commit graph

1335 commits

Author SHA1 Message Date
Krish Dholakia
e93674638a Merge pull request #2087 from BerriAI/litellm_llm_guard_integration
feat(llm_guard.py): support llm guard for content moderation
2024-02-19 22:48:12 -08:00
ishaan-jaff
42d2dbdf87 (feat) proxy allow user/request_model 2024-02-19 20:56:28 -08:00
Krrish Dholakia
66e4abcb0d feat(llm_guard.py): support llm guard for content moderation
https://github.com/BerriAI/litellm/issues/2056
2024-02-19 20:51:25 -08:00
ishaan-jaff
1a6c64aa66 (fix) user_id_models on sso/callback 2024-02-19 20:39:17 -08:00
ishaan-jaff
9b7ec4e3df (feat) /user/get_requests 2024-02-19 20:39:17 -08:00
ishaan-jaff
cfcde8bb6e (feat) use user_notification table 2024-02-19 20:39:17 -08:00
ishaan-jaff
890e2514a0 (feat) proxy - save model access requests 2024-02-19 20:39:17 -08:00
Krrish Dholakia
27cd47bf37 test(test_presidio_pii_masking.py): add more unit tests 2024-02-19 20:39:17 -08:00
Krrish Dholakia
966abee67f test(test_presidio_pii_masking.py): add more unit tests 2024-02-19 16:30:44 -08:00
Ishaan Jaff
b4e2690b83 Merge pull request #2066 from BerriAI/litellm_show_if_user_has_model_access
[FEAT] /model/info show models user has access to
2024-02-19 15:00:17 -08:00
ishaan-jaff
10c0da389e (fix) use "/v2/model/info", 2024-02-19 13:29:19 -08:00
ishaan-jaff
8aa134951a (fix) model/info 2024-02-19 13:27:12 -08:00
ishaan-jaff
11adf1e135 (feat) use /v2/model/info 2024-02-19 13:24:22 -08:00
ishaan-jaff
a1918434e3 (fix) server show models user has access to 2024-02-19 13:17:24 -08:00
ishaan-jaff
4f486de58c (feat) /model/info show models user has access to 2024-02-19 09:25:32 -08:00
Krish Dholakia
a0ad23a738 Merge pull request #2049 from BerriAI/litellm_return_all_teams_for_user
feat(proxy_server.py): return all teams, user is a member of in /user/info
2024-02-17 23:36:45 -08:00
Krish Dholakia
f485e778cb Merge branch 'main' into litellm_google_text_moderation 2024-02-17 22:10:26 -08:00
Krish Dholakia
8e0040c09d Merge branch 'main' into litellm_llamaguard_custom_categories 2024-02-17 21:36:40 -08:00
Krrish Dholakia
7bd3132b38 feat(proxy_server.py): return all teams, user is a member of in /user/info
https://github.com/BerriAI/litellm/issues/2014
2024-02-17 19:18:41 -08:00
ishaan-jaff
c381fcc01c (fix) testing fix 2024-02-17 19:17:33 -08:00
ishaan-jaff
e3517a53aa (build) new ui build 2024-02-17 19:13:04 -08:00
Krrish Dholakia
8b166c2eff feat(presidio_pii_masking.py): allow request level controls for turning on/off pii masking
https://github.com/BerriAI/litellm/issues/2003
2024-02-17 19:13:04 -08:00
Krrish Dholakia
e8d4265c46 fix(proxy_cli.py): allow user to control db connection pool + timeouts from config 2024-02-17 19:13:04 -08:00
ishaan-jaff
80d566c869 (fix) litellm bug in 2024-02-17 19:13:04 -08:00
Krrish Dholakia
383afa389f refactor: rename enterprise specific hooks and callbacks to be more precise 2024-02-17 19:13:04 -08:00
ishaan-jaff
26098d194f (fix) dynamo db test - new model_spend params 2024-02-17 19:13:04 -08:00
ishaan-jaff
cc50ddb866 (fix) issue with storing model max budget 2024-02-17 19:13:04 -08:00
ishaan-jaff
ed0355f577 (fix) ui build 2024-02-17 19:13:04 -08:00
ishaan-jaff
8c3b897ca3 (feat) set fast api root path 2024-02-17 19:13:04 -08:00
Krrish Dholakia
a2afd80d48 docs(enterprise.md): add llama guard tutorial to enterprise docs 2024-02-17 19:13:04 -08:00
Krrish Dholakia
01ac0418b6 feat(llama_guard.py): add llama guard support for content moderation + new async_moderation_hook endpoint 2024-02-17 19:13:04 -08:00
Krrish Dholakia
7263ae63c6 fix(proxy_cli.py): allow user to control db connection pool + timeouts from config 2024-02-17 19:03:43 -08:00
Ishaan Jaff
ee0d842f31 Merge pull request #2047 from BerriAI/litellm_ui_cost_tracking
[FIX] Spend Tracking bug for Keys made on Admin UI (when role = proxy_admin)
2024-02-17 18:59:02 -08:00
ishaan-jaff
2787611273 (fix) litellm bug in 2024-02-17 18:41:37 -08:00
Krrish Dholakia
ea2632d9f3 feat(google_text_moderation.py): allow user to use google text moderation for content mod on proxy 2024-02-17 18:36:29 -08:00
Krrish Dholakia
423bd4012d refactor: rename enterprise specific hooks and callbacks to be more precise 2024-02-17 17:52:45 -08:00
Krrish Dholakia
f52b3c5f84 feat(llama_guard.py): allow user to define custom unsafe content categories 2024-02-17 17:42:47 -08:00
ishaan-jaff
0102a2b198 (fix) dynamo db test - new model_spend params 2024-02-17 16:00:08 -08:00
Ishaan Jaff
0249ed1476 Merge pull request #2022 from BerriAI/litellm_budgets_per_llm
[FEAT] Track spend per model (for Key, User and Team)
2024-02-17 15:35:31 -08:00
ishaan-jaff
8bf4fa0638 (fix) ui build 2024-02-17 14:06:52 -08:00
ishaan-jaff
9b508280ac (feat) set fast api root path 2024-02-17 13:03:24 -08:00
Krrish Dholakia
7a75682637 docs(enterprise.md): add llama guard tutorial to enterprise docs 2024-02-17 09:25:49 -08:00
Krrish Dholakia
67cd9b1c63 feat(llama_guard.py): add llama guard support for content moderation + new async_moderation_hook endpoint 2024-02-16 18:45:25 -08:00
ishaan-jaff
927187318f (fix) issue with storing model max budget 2024-02-16 18:18:35 -08:00
ishaan-jaff
eb72d42fb8 (fix) _types for model_max_budget 2024-02-16 17:47:22 -08:00
ishaan-jaff
f03b522233 (fix) types for model_max_budget 2024-02-16 17:46:34 -08:00
ishaan-jaff
4cadc9f947 (feat) budgets per model 2024-02-16 17:19:01 -08:00
ishaan-jaff
5e21ebca31 (fix) setting model_max_budget 2024-02-16 17:00:23 -08:00
ishaan-jaff
85a10ac9ba (feat) track spend key-model, user-model, team-model 2024-02-16 16:32:17 -08:00
ishaan-jaff
885336a467 (feat) track key spend per model 2024-02-16 16:15:24 -08:00