Commit graph

713 commits

Author SHA1 Message Date
Krrish Dholakia
6710c2ee5d fix(proxy_server.py): fix /spend/logs endpoint 2024-02-09 18:11:33 -08:00
ishaan-jaff
924b7db540 (feat) support azure deployments for embeddings 2024-02-09 16:47:01 -08:00
Krrish Dholakia
43da22ae13 feat(proxy_server.py): show admin global spend as time series data 2024-02-09 16:31:35 -08:00
Krrish Dholakia
3a4ac8be79 fix: fixes 2024-02-08 21:54:48 -08:00
Krrish Dholakia
e98437104d fix(proxy_server.py): enable aggregate queries via /spend/keys 2024-02-08 20:29:08 -08:00
ishaan-jaff
4cee080e7c (fix) ui /login without sso 2024-02-08 10:47:45 -08:00
ishaan-jaff
3837c77df9 (feat) slack alerting when track callback fails 2024-02-07 20:09:28 -08:00
ishaan-jaff
8462e85792 (feat) alert for failing cost tracking 2024-02-07 18:49:45 -08:00
Krrish Dholakia
d2dceb3537 fix(proxy_server.py): check if prisma client is set before scheduling reset budget 2024-02-07 18:14:37 -08:00
Krrish Dholakia
8939593826 fix(proxy_server.py): fix merge errors 2024-02-07 00:04:52 -08:00
Krrish Dholakia
184e78772b refactor(proxy_server.py): fix merge error 2024-02-06 23:44:23 -08:00
Krish Dholakia
df60edfa07
Merge branch 'main' into litellm_spend_logging_high_traffic 2024-02-06 23:36:58 -08:00
Krrish Dholakia
fd9c7a90af fix(proxy_server.py): update user cache to with new spend 2024-02-06 23:06:05 -08:00
Krrish Dholakia
4174471dac fix(proxy_server.py): fix endpoint 2024-02-06 22:09:30 -08:00
Krish Dholakia
2bc710d8e9
Merge pull request #1843 from BerriAI/litellm_admin_ui_view_all_keys
feat(ui): enable admin to view all valid keys created on the proxy
2024-02-06 22:06:46 -08:00
Krrish Dholakia
0874c17a31 fix: export npm build into proxy 2024-02-06 20:12:50 -08:00
Krrish Dholakia
4a0df3cb4f fix(proxy_cli.py-&&-proxy_server.py): bump reset budget intervals and fix pool limits for prisma connections 2024-02-06 19:39:49 -08:00
ishaan-jaff
5a29f362ee (fix) allow litellm_settings to be None 2024-02-06 19:29:39 -08:00
Krrish Dholakia
b6adeec347 fix(proxy_server.py): prisma client fixes for high traffic 2024-02-06 17:30:36 -08:00
Ishaan Jaff
73c6ce890b
Merge pull request #1859 from BerriAI/litellm_allow_using_budgets_without_keys
[Feat] Budgets for 'user' param passed to /chat/completions, /embeddings etc
2024-02-06 16:32:25 -08:00
ishaan-jaff
52b864976b (feat) support max_user_budget 2024-02-06 15:19:36 -08:00
Krish Dholakia
e36566a212
Merge branch 'main' into litellm_admin_ui_view_all_keys 2024-02-06 14:34:57 -08:00
Krish Dholakia
f70bbc7b2e
Merge branch 'main' into litellm_vertex_ai_streaming_fix 2024-02-06 14:33:54 -08:00
ishaan-jaff
d9f407b4c2 (feat) show semantic-cache on health/readiness 2024-02-06 13:58:20 -08:00
ishaan-jaff
3d0ece828a (feat) show semantic-cache on health/readiness 2024-02-06 13:35:34 -08:00
ishaan-jaff
755f44613d (feat) redis-semantic cache on proxy 2024-02-06 13:32:03 -08:00
ishaan-jaff
4265c7affb (feat) redis-semantic cache on proxy 2024-02-06 13:30:59 -08:00
ishaan-jaff
a8d190f507 (feat) redis-semantic cache on proxy 2024-02-06 13:30:31 -08:00
ishaan-jaff
0871327ff0 (feat) upperbound_key_generate_params 2024-02-06 13:17:57 -08:00
Krrish Dholakia
e5fec98e1f fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected) 2024-02-06 12:57:05 -08:00
Ishaan Jaff
7cb69c72c8
Merge branch 'main' into litellm_add_semantic_cache 2024-02-06 11:18:43 -08:00
ishaan-jaff
2732c47b70 (feat) redis-semantic cache on proxy 2024-02-06 10:35:21 -08:00
Krrish Dholakia
3afa5230d6 fix(utils.py): return finish reason for last vertex ai chunk 2024-02-06 09:21:03 -08:00
Krrish Dholakia
e59aca925a fix(proxy_server.py): update dynamodb load config 2024-02-06 08:18:17 -08:00
ishaan-jaff
a712596d46 (feat) upperbound_key_generate_params 2024-02-05 22:38:47 -08:00
Krrish Dholakia
f2a7e2ee98 feat(ui): enable admin to view all valid keys created on the proxy 2024-02-05 19:28:57 -08:00
ishaan-jaff
1f7c8e86a7 (fix) make sure route is str 2024-02-05 16:22:36 -08:00
ishaan-jaff
8d7698f24d (fix) litellm-ui keys can never access /chat/completions 2024-02-05 16:10:49 -08:00
Krrish Dholakia
77fe71ee08 fix(utils.py): support together ai function calling 2024-02-05 15:30:44 -08:00
Krish Dholakia
28df60b609
Merge pull request #1809 from BerriAI/litellm_embedding_caching_updates
Support caching individual items in embedding list (Async embedding only)
2024-02-03 21:04:23 -08:00
ishaan-jaff
c6aadcbd34 (feat) new ui build 2024-02-03 18:53:05 -08:00
Krish Dholakia
9ab59045a3
Merge branch 'main' into litellm_embedding_caching_updates 2024-02-03 18:08:47 -08:00
ishaan-jaff
1fa85c03b8 (feat) allow users to view their spend/logs 2024-02-03 17:33:19 -08:00
ishaan-jaff
44b6c73351 (feat) only allow master key to update users 2024-02-03 14:16:14 -08:00
ishaan-jaff
3f2f864cc8 (docs) /user/new 2024-02-03 10:59:06 -08:00
ishaan-jaff
c9958eb329 (feat) raise error when user_role not in known roles 2024-02-03 10:40:59 -08:00
ishaan-jaff
d41f1b4997 (feat) set user_role for Users on proxy 2024-02-03 10:11:42 -08:00
ishaan-jaff
ebb221f743 (fix) ui - don't fail when no DB connected 2024-02-02 20:17:26 -08:00
ishaan-jaff
cfec3c611e (fix) improve proxy api_key caching 2024-02-02 19:59:13 -08:00
ishaan-jaff
42fcce4645 (fix) /key/info test 2024-02-02 19:22:55 -08:00