Commit graph

878 commits

Author SHA1 Message Date
Krrish Dholakia
8f989235ea fix(proxy_server.py): restrict proxy to just listed models 2024-02-12 09:30:59 -08:00
Krish Dholakia
1391490d92
Merge pull request #1931 from BerriAI/litellm_microsoft_presidio_pii
feat(proxy_server.py): support for pii masking with microsoft presidio
2024-02-11 00:27:14 -08:00
Ishaan Jaff
1cb8d2d3a3
Merge pull request #1933 from BerriAI/litellm_team_specific_models
[FEAT] Proxy - set team specific models
2024-02-10 21:40:13 -08:00
ishaan-jaff
5ac5f6c53c (feat)team-specific models 2024-02-10 21:13:39 -08:00
Krrish Dholakia
71f772d2f5 fix(proxy_server.py): support list as well as direct input for custom callbacks 2024-02-10 20:38:09 -08:00
Krrish Dholakia
72ec488461 fix(proxy_server.py): fix import 2024-02-10 20:31:54 -08:00
Krrish Dholakia
2d845b12ed feat(proxy_server.py): support for pii masking with microsoft presidio 2024-02-10 20:21:12 -08:00
ishaan-jaff
afd0d7cb41 (fix) undo today's mistake where bedrock was async 2024-02-10 18:32:29 -08:00
Krrish Dholakia
7e2e545bed fix(proxy_server.py): don't change old /key/info endpoint 2024-02-10 17:31:23 -08:00
Krrish Dholakia
34c118e5e9 feat(ui): show key alias instead of hashed token 2024-02-10 15:45:42 -08:00
Krrish Dholakia
6b83001459 feat(proxy_server.py): support key lists for /key/info 2024-02-10 14:24:12 -08:00
ishaan-jaff
757334c85f (fix) proxy - use bedrock in sync streaming 2024-02-10 09:47:33 -08:00
Krrish Dholakia
7409460230 fix(ui): export ui npm build 2024-02-10 08:43:41 -08:00
Krish Dholakia
a8ef8e12bb
Merge branch 'main' into litellm_ui_improvements_time_series 2024-02-09 20:54:36 -08:00
Krrish Dholakia
4678c6b936 fix(usage.tsx): show top users and top keys driving spend 2024-02-09 19:50:07 -08:00
Krrish Dholakia
6710c2ee5d fix(proxy_server.py): fix /spend/logs endpoint 2024-02-09 18:11:33 -08:00
ishaan-jaff
924b7db540 (feat) support azure deployments for embeddings 2024-02-09 16:47:01 -08:00
Krrish Dholakia
43da22ae13 feat(proxy_server.py): show admin global spend as time series data 2024-02-09 16:31:35 -08:00
Krrish Dholakia
3a4ac8be79 fix: fixes 2024-02-08 21:54:48 -08:00
Krrish Dholakia
e98437104d fix(proxy_server.py): enable aggregate queries via /spend/keys 2024-02-08 20:29:08 -08:00
ishaan-jaff
4cee080e7c (fix) ui /login without sso 2024-02-08 10:47:45 -08:00
ishaan-jaff
3837c77df9 (feat) slack alerting when track callback fails 2024-02-07 20:09:28 -08:00
ishaan-jaff
8462e85792 (feat) alert for failing cost tracking 2024-02-07 18:49:45 -08:00
Krrish Dholakia
d2dceb3537 fix(proxy_server.py): check if prisma client is set before scheduling reset budget 2024-02-07 18:14:37 -08:00
Krrish Dholakia
8939593826 fix(proxy_server.py): fix merge errors 2024-02-07 00:04:52 -08:00
Krrish Dholakia
184e78772b refactor(proxy_server.py): fix merge error 2024-02-06 23:44:23 -08:00
Krish Dholakia
df60edfa07
Merge branch 'main' into litellm_spend_logging_high_traffic 2024-02-06 23:36:58 -08:00
Krrish Dholakia
fd9c7a90af fix(proxy_server.py): update user cache to with new spend 2024-02-06 23:06:05 -08:00
Krrish Dholakia
4174471dac fix(proxy_server.py): fix endpoint 2024-02-06 22:09:30 -08:00
Krish Dholakia
2bc710d8e9
Merge pull request #1843 from BerriAI/litellm_admin_ui_view_all_keys
feat(ui): enable admin to view all valid keys created on the proxy
2024-02-06 22:06:46 -08:00
Krrish Dholakia
0874c17a31 fix: export npm build into proxy 2024-02-06 20:12:50 -08:00
Krrish Dholakia
4a0df3cb4f fix(proxy_cli.py-&&-proxy_server.py): bump reset budget intervals and fix pool limits for prisma connections 2024-02-06 19:39:49 -08:00
ishaan-jaff
5a29f362ee (fix) allow litellm_settings to be None 2024-02-06 19:29:39 -08:00
Krrish Dholakia
b6adeec347 fix(proxy_server.py): prisma client fixes for high traffic 2024-02-06 17:30:36 -08:00
Ishaan Jaff
73c6ce890b
Merge pull request #1859 from BerriAI/litellm_allow_using_budgets_without_keys
[Feat] Budgets for 'user' param passed to /chat/completions, /embeddings etc
2024-02-06 16:32:25 -08:00
ishaan-jaff
52b864976b (feat) support max_user_budget 2024-02-06 15:19:36 -08:00
Krish Dholakia
e36566a212
Merge branch 'main' into litellm_admin_ui_view_all_keys 2024-02-06 14:34:57 -08:00
Krish Dholakia
f70bbc7b2e
Merge branch 'main' into litellm_vertex_ai_streaming_fix 2024-02-06 14:33:54 -08:00
ishaan-jaff
d9f407b4c2 (feat) show semantic-cache on health/readiness 2024-02-06 13:58:20 -08:00
ishaan-jaff
3d0ece828a (feat) show semantic-cache on health/readiness 2024-02-06 13:35:34 -08:00
ishaan-jaff
755f44613d (feat) redis-semantic cache on proxy 2024-02-06 13:32:03 -08:00
ishaan-jaff
4265c7affb (feat) redis-semantic cache on proxy 2024-02-06 13:30:59 -08:00
ishaan-jaff
a8d190f507 (feat) redis-semantic cache on proxy 2024-02-06 13:30:31 -08:00
ishaan-jaff
0871327ff0 (feat) upperbound_key_generate_params 2024-02-06 13:17:57 -08:00
Krrish Dholakia
e5fec98e1f fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected) 2024-02-06 12:57:05 -08:00
Ishaan Jaff
7cb69c72c8
Merge branch 'main' into litellm_add_semantic_cache 2024-02-06 11:18:43 -08:00
ishaan-jaff
2732c47b70 (feat) redis-semantic cache on proxy 2024-02-06 10:35:21 -08:00
Krrish Dholakia
3afa5230d6 fix(utils.py): return finish reason for last vertex ai chunk 2024-02-06 09:21:03 -08:00
Krrish Dholakia
e59aca925a fix(proxy_server.py): update dynamodb load config 2024-02-06 08:18:17 -08:00
ishaan-jaff
a712596d46 (feat) upperbound_key_generate_params 2024-02-05 22:38:47 -08:00