Commit graph

451 commits

Author SHA1 Message Date
ishaan-jaff
5ac5f6c53c (feat)team-specific models 2024-02-10 21:13:39 -08:00
Krrish Dholakia
2d845b12ed feat(proxy_server.py): support for pii masking with microsoft presidio 2024-02-10 20:21:12 -08:00
Krrish Dholakia
34c118e5e9 feat(ui): show key alias instead of hashed token 2024-02-10 15:45:42 -08:00
Krrish Dholakia
6b83001459 feat(proxy_server.py): support key lists for /key/info 2024-02-10 14:24:12 -08:00
Krrish Dholakia
43da22ae13 feat(proxy_server.py): show admin global spend as time series data 2024-02-09 16:31:35 -08:00
ishaan-jaff
8462e85792 (feat) alert for failing cost tracking 2024-02-07 18:49:45 -08:00
ishaan-jaff
258fe63e7d (fix) ui - when request body is None 2024-02-07 11:33:43 -08:00
Krish Dholakia
df60edfa07
Merge branch 'main' into litellm_spend_logging_high_traffic 2024-02-06 23:36:58 -08:00
Krish Dholakia
2bc710d8e9
Merge pull request #1843 from BerriAI/litellm_admin_ui_view_all_keys
feat(ui): enable admin to view all valid keys created on the proxy
2024-02-06 22:06:46 -08:00
Krrish Dholakia
4a0df3cb4f fix(proxy_cli.py-&&-proxy_server.py): bump reset budget intervals and fix pool limits for prisma connections 2024-02-06 19:39:49 -08:00
Ishaan Jaff
73c6ce890b
Merge pull request #1859 from BerriAI/litellm_allow_using_budgets_without_keys
[Feat] Budgets for 'user' param passed to /chat/completions, /embeddings etc
2024-02-06 16:32:25 -08:00
Krish Dholakia
9e9fb747ce
Merge branch 'main' into litellm_slack_langfuse_alerting 2024-02-06 15:48:52 -08:00
ishaan-jaff
52b864976b (feat) support max_user_budget 2024-02-06 15:19:36 -08:00
Krish Dholakia
e36566a212
Merge branch 'main' into litellm_admin_ui_view_all_keys 2024-02-06 14:34:57 -08:00
Krrish Dholakia
e5fec98e1f fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected) 2024-02-06 12:57:05 -08:00
Krrish Dholakia
f2a7e2ee98 feat(ui): enable admin to view all valid keys created on the proxy 2024-02-05 19:28:57 -08:00
Krrish Dholakia
e35a7c32cb fix(proxy/utils.py): if langfuse trace id passed in, just send that as part of alert 2024-02-05 16:34:33 -08:00
Krrish Dholakia
ef0171e063 feat(utils.py): support cost tracking for openai/azure image gen models 2024-02-03 17:09:54 -08:00
Krrish Dholakia
5f9ea8a94f fix(utils.py): add track cost callback to callback list for team id callbacks 2024-02-02 08:18:06 -08:00
Krrish Dholakia
92058cbcd4 fix(utils.py): override default success callbacks with dynamic callbacks if set 2024-02-02 06:21:43 -08:00
ishaan-jaff
e13e61ad3b (docs) proxy ui 2024-02-01 16:17:04 -08:00
ishaan-jaff
44bf1409e0 (fix) ui link 2024-02-01 16:14:29 -08:00
ishaan-jaff
83cbed8b20 (fix) default UI use master key for auth 2024-02-01 16:05:23 -08:00
ishaan-jaff
26520dd4e4 (fix) ui improve default flow 2024-02-01 15:03:48 -08:00
Krish Dholakia
ce415a243d
Merge branch 'main' into litellm_no_store_cache_control 2024-01-30 21:44:57 -08:00
Krrish Dholakia
f9acad87dc feat(proxy_server.py): enable cache controls per key + no-store cache flag 2024-01-30 20:46:50 -08:00
ishaan-jaff
8daabe16f4 (feat) allow users to use UI without SSO 2024-01-30 17:00:40 -08:00
Krrish Dholakia
bbe71c8375 fix(test_parallel_request_limiter): increase time limit for waiting for success logging event to happen 2024-01-30 13:26:17 -08:00
Sébastien Campion
4dd18b553a Merge remote-tracking branch 'src/main' 2024-01-27 19:24:35 +01:00
Sébastien Campion
4ba809b835 Allow optional usage of the tls encryption for SMTPA
For local dev, a local SMTP server like mailhog is useful and allow to manually manage user creation
2024-01-27 19:16:53 +01:00
ishaan-jaff
8b52333b08 (feat) fix alert formats for budgets 2024-01-26 17:14:47 -08:00
Krrish Dholakia
e989175c10 fix(proxy/utils.py): accept token hashes for deleting tokens 2024-01-26 13:29:16 -08:00
ishaan-jaff
64f1301033 (feat) SpendLogs show total_tokens, prompt_tokens, completion_tokens 2024-01-26 10:26:15 -08:00
ishaan-jaff
b9fc2c3735 (fix) SpendLogs stop logging model params 2024-01-26 10:13:34 -08:00
Sébastien Campion
a5d120a68b fix print verbose take only one argument 2024-01-26 18:03:55 +01:00
ishaan-jaff
5264a3eb53 (fix) do nothing if alerting is not switched on 2024-01-25 16:40:23 -08:00
ishaan-jaff
1c9b02ad99 (fix) alerting debug statements 2024-01-25 16:40:23 -08:00
ishaan-jaff
229e4920df (fix) better alert message on budgets 2024-01-25 16:40:23 -08:00
ishaan-jaff
7a2a7e047f (feat) slack alerting budgets 2024-01-25 16:40:23 -08:00
ishaan-jaff
55115a75b0 (feat) alerts proxy budgets 2024-01-25 16:40:23 -08:00
ishaan-jaff
565531fe9e v0 basic structure 2024-01-25 16:40:23 -08:00
Krrish Dholakia
09ec6d6458 fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
2024-01-25 12:49:45 -08:00
Krrish Dholakia
81846ffdec fix(proxy/utils.py): handle item not existing during batch updates 2024-01-24 21:49:47 -08:00
Krrish Dholakia
8e1157fc92 test(test_keys.py): reset proxy spend 2024-01-24 21:08:09 -08:00
Krish Dholakia
6501fdb76e
Merge branch 'main' into litellm_global_spend_updates 2024-01-24 20:20:15 -08:00
ishaan-jaff
2f3765a03f (fix) log cache hits on SpendLogs table 2024-01-24 18:51:39 -08:00
ishaan-jaff
bf851ef19a (fix) use litellm.cache for getting key 2024-01-24 18:34:22 -08:00
ishaan-jaff
2130a61b6e (feat) add cache_key in spend_log 2024-01-24 17:56:00 -08:00
Krrish Dholakia
f148094d18 test(test_key_generate_prisma.py): add unit testing for global proxy budget 2024-01-24 17:43:01 -08:00
ishaan-jaff
d694993703 (fix) bug from bb7705b494 2024-01-24 17:34:17 -08:00