Commit graph

1359 commits

Author SHA1 Message Date
ishaan-jaff
9845d34075 (fix) issue with storing model max budget 2024-02-17 19:13:04 -08:00
ishaan-jaff
dceece00c9 (fix) ui build 2024-02-17 19:13:04 -08:00
ishaan-jaff
9276e205bf (feat) set fast api root path 2024-02-17 19:13:04 -08:00
Krrish Dholakia
0a3284e753 docs(enterprise.md): add llama guard tutorial to enterprise docs 2024-02-17 19:13:04 -08:00
Krrish Dholakia
bf77295168 feat(llama_guard.py): add llama guard support for content moderation + new async_moderation_hook endpoint 2024-02-17 19:13:04 -08:00
Krrish Dholakia
045d84e167 fix(proxy_cli.py): allow user to control db connection pool + timeouts from config 2024-02-17 19:03:43 -08:00
Ishaan Jaff
bf572b495a
Merge pull request #2047 from BerriAI/litellm_ui_cost_tracking
[FIX] Spend Tracking bug for Keys made on Admin UI (when role = proxy_admin)
2024-02-17 18:59:02 -08:00
ishaan-jaff
901a1a3655 (fix) litellm bug in 2024-02-17 18:41:37 -08:00
Krrish Dholakia
ddf0911c46 feat(google_text_moderation.py): allow user to use google text moderation for content mod on proxy 2024-02-17 18:36:29 -08:00
Krrish Dholakia
73acdf3736 refactor: rename enterprise specific hooks and callbacks to be more precise 2024-02-17 17:52:45 -08:00
Krrish Dholakia
074d93cc97 feat(llama_guard.py): allow user to define custom unsafe content categories 2024-02-17 17:42:47 -08:00
ishaan-jaff
44202aa25b (fix) dynamo db test - new model_spend params 2024-02-17 16:00:08 -08:00
Ishaan Jaff
35af2d666b
Merge pull request #2022 from BerriAI/litellm_budgets_per_llm
[FEAT] Track spend per model (for Key, User and Team)
2024-02-17 15:35:31 -08:00
ishaan-jaff
c069403b05 (fix) ui build 2024-02-17 14:06:52 -08:00
ishaan-jaff
844df2412e (feat) set fast api root path 2024-02-17 13:03:24 -08:00
Krrish Dholakia
3565f74338 docs(enterprise.md): add llama guard tutorial to enterprise docs 2024-02-17 09:25:49 -08:00
Krrish Dholakia
2a4a6995ac feat(llama_guard.py): add llama guard support for content moderation + new async_moderation_hook endpoint 2024-02-16 18:45:25 -08:00
ishaan-jaff
62d0c54cfb (fix) issue with storing model max budget 2024-02-16 18:18:35 -08:00
ishaan-jaff
e76a3c5ce5 (fix) _types for model_max_budget 2024-02-16 17:47:22 -08:00
ishaan-jaff
659a394a36 (fix) types for model_max_budget 2024-02-16 17:46:34 -08:00
ishaan-jaff
4ea354ee6e (feat) budgets per model 2024-02-16 17:19:01 -08:00
ishaan-jaff
e8dcf8fa13 (fix) setting model_max_budget 2024-02-16 17:00:23 -08:00
ishaan-jaff
d65c6d3869 (feat) track spend key-model, user-model, team-model 2024-02-16 16:32:17 -08:00
ishaan-jaff
2c9d142e42 (feat) track key spend per model 2024-02-16 16:15:24 -08:00
ishaan-jaff
a2f1d2ee52 (feat) set key-model budgets 2024-02-16 15:44:34 -08:00
Ishaan Jaff
4d4653b619
Merge branch 'main' into litellm_fix_generic_sso 2024-02-16 14:51:46 -08:00
Ishaan Jaff
e6b9e5b46f
Merge pull request #2020 from Lunik/feat/generic-sso-scopes
 Allow to configure scopes in generic SSO
2024-02-16 14:45:09 -08:00
ishaan-jaff
5857b02bfc (feat) generic sso, set generic_user_id_attribute_name 2024-02-16 14:40:27 -08:00
Lunik
af4537e421
Allow to configure scopes in generic SSO
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-02-16 23:24:58 +01:00
Krrish Dholakia
01077b20b9 fix(proxy_server.py): restrict model access for /v1/completions endpoint 2024-02-16 11:54:12 -08:00
ishaan-jaff
936e460a30 (chore) fix spend tracking request tags 2024-02-16 11:54:12 -08:00
Krrish Dholakia
e9b27d9811 fix(proxy_server.py): re-add /team/info endpoint (fixing merge issue) 2024-02-16 11:54:12 -08:00
Krrish Dholakia
d97369dcbe fix(proxy_server.py): restrict model access for /v1/completions endpoint 2024-02-16 11:50:07 -08:00
Ishaan Jaff
691542ddf0
Merge pull request #2004 from BerriAI/litellm_track_spend_per_tag
[FEAT] Track spend per tag
2024-02-16 10:55:02 -08:00
ishaan-jaff
55bd08847c (chore) fix spend tracking request tags 2024-02-16 10:53:33 -08:00
ishaan-jaff
138f5ceb1e (feat) view spend per tag 2024-02-16 10:16:48 -08:00
ishaan-jaff
23589a398a (feat) log request_tags in SpendLogs 2024-02-16 09:52:25 -08:00
ishaan-jaff
097b46d948 (feat) view spend per tag 2024-02-16 08:51:23 -08:00
Krrish Dholakia
8640989a80 fix(proxy_server.py): re-add /team/info endpoint (fixing merge issue) 2024-02-16 08:49:37 -08:00
Krish Dholakia
999fab82f7
Merge branch 'main' into litellm_moderations_improvements 2024-02-15 23:08:25 -08:00
Ishaan Jaff
3615094939
Merge pull request #1996 from BerriAI/litellm_track_spend_per_team
[FEAT] Track spend per team
2024-02-15 22:43:36 -08:00
ishaan-jaff
c4eae818ef (fix) chat ui bug 2024-02-15 22:40:42 -08:00
ishaan-jaff
9bcf9ad531 (feat) schema.prisma 2024-02-15 22:10:45 -08:00
Ishaan Jaff
de6b4967a7
Merge pull request #1993 from BerriAI/litellm_track_team_id_langfuse_tags_metadata
[FEAT] Track team_id in langfuse tags, callback metadata
2024-02-15 21:42:12 -08:00
ishaan-jaff
88037b68b0 (feat) track spend per team 2024-02-15 21:41:48 -08:00
Krrish Dholakia
7698b4b7d7 build(schema.prisma): add permissions column to key table 2024-02-15 21:29:34 -08:00
ishaan-jaff
039617766f (feat) track team_id in langfuse tags 2024-02-15 20:58:39 -08:00
Krrish Dholakia
34fce00960 fix: dynamo_db.py
handle permissions row
2024-02-15 20:36:59 -08:00
Krrish Dholakia
cd8d35107b fix: check key permissions for turning on/off pii masking 2024-02-15 20:16:15 -08:00
Krrish Dholakia
cccd577e75 feat(proxy_server.py): expose new permissions field for keys 2024-02-15 20:03:32 -08:00