Commit graph

654 commits

Author SHA1 Message Date
Krrish Dholakia
dfd027da35 fix(proxy_server.py): allow user to create key for themselves 2024-02-07 11:12:30 -08:00
Krrish Dholakia
8939593826 fix(proxy_server.py): fix merge errors 2024-02-07 00:04:52 -08:00
Krrish Dholakia
184e78772b refactor(proxy_server.py): fix merge error 2024-02-06 23:44:23 -08:00
Krish Dholakia
df60edfa07
Merge branch 'main' into litellm_spend_logging_high_traffic 2024-02-06 23:36:58 -08:00
Krrish Dholakia
fd9c7a90af fix(proxy_server.py): update user cache to with new spend 2024-02-06 23:06:05 -08:00
Krrish Dholakia
4174471dac fix(proxy_server.py): fix endpoint 2024-02-06 22:09:30 -08:00
Krish Dholakia
2bc710d8e9
Merge pull request #1843 from BerriAI/litellm_admin_ui_view_all_keys
feat(ui): enable admin to view all valid keys created on the proxy
2024-02-06 22:06:46 -08:00
Krrish Dholakia
0874c17a31 fix: export npm build into proxy 2024-02-06 20:12:50 -08:00
Krrish Dholakia
4a0df3cb4f fix(proxy_cli.py-&&-proxy_server.py): bump reset budget intervals and fix pool limits for prisma connections 2024-02-06 19:39:49 -08:00
ishaan-jaff
5a29f362ee (fix) allow litellm_settings to be None 2024-02-06 19:29:39 -08:00
Krrish Dholakia
b6adeec347 fix(proxy_server.py): prisma client fixes for high traffic 2024-02-06 17:30:36 -08:00
Ishaan Jaff
73c6ce890b
Merge pull request #1859 from BerriAI/litellm_allow_using_budgets_without_keys
[Feat] Budgets for 'user' param passed to /chat/completions, /embeddings etc
2024-02-06 16:32:25 -08:00
ishaan-jaff
52b864976b (feat) support max_user_budget 2024-02-06 15:19:36 -08:00
Krish Dholakia
e36566a212
Merge branch 'main' into litellm_admin_ui_view_all_keys 2024-02-06 14:34:57 -08:00
Krish Dholakia
f70bbc7b2e
Merge branch 'main' into litellm_vertex_ai_streaming_fix 2024-02-06 14:33:54 -08:00
ishaan-jaff
d9f407b4c2 (feat) show semantic-cache on health/readiness 2024-02-06 13:58:20 -08:00
ishaan-jaff
3d0ece828a (feat) show semantic-cache on health/readiness 2024-02-06 13:35:34 -08:00
ishaan-jaff
755f44613d (feat) redis-semantic cache on proxy 2024-02-06 13:32:03 -08:00
ishaan-jaff
4265c7affb (feat) redis-semantic cache on proxy 2024-02-06 13:30:59 -08:00
ishaan-jaff
a8d190f507 (feat) redis-semantic cache on proxy 2024-02-06 13:30:31 -08:00
ishaan-jaff
0871327ff0 (feat) upperbound_key_generate_params 2024-02-06 13:17:57 -08:00
Krrish Dholakia
e5fec98e1f fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected) 2024-02-06 12:57:05 -08:00
Ishaan Jaff
7cb69c72c8
Merge branch 'main' into litellm_add_semantic_cache 2024-02-06 11:18:43 -08:00
ishaan-jaff
2732c47b70 (feat) redis-semantic cache on proxy 2024-02-06 10:35:21 -08:00
Krrish Dholakia
3afa5230d6 fix(utils.py): return finish reason for last vertex ai chunk 2024-02-06 09:21:03 -08:00
ishaan-jaff
a712596d46 (feat) upperbound_key_generate_params 2024-02-05 22:38:47 -08:00
Krrish Dholakia
f2a7e2ee98 feat(ui): enable admin to view all valid keys created on the proxy 2024-02-05 19:28:57 -08:00
ishaan-jaff
1f7c8e86a7 (fix) make sure route is str 2024-02-05 16:22:36 -08:00
ishaan-jaff
8d7698f24d (fix) litellm-ui keys can never access /chat/completions 2024-02-05 16:10:49 -08:00
Krrish Dholakia
77fe71ee08 fix(utils.py): support together ai function calling 2024-02-05 15:30:44 -08:00
Krish Dholakia
28df60b609
Merge pull request #1809 from BerriAI/litellm_embedding_caching_updates
Support caching individual items in embedding list (Async embedding only)
2024-02-03 21:04:23 -08:00
ishaan-jaff
c6aadcbd34 (feat) new ui build 2024-02-03 18:53:05 -08:00
Krish Dholakia
9ab59045a3
Merge branch 'main' into litellm_embedding_caching_updates 2024-02-03 18:08:47 -08:00
ishaan-jaff
1fa85c03b8 (feat) allow users to view their spend/logs 2024-02-03 17:33:19 -08:00
ishaan-jaff
44b6c73351 (feat) only allow master key to update users 2024-02-03 14:16:14 -08:00
ishaan-jaff
3f2f864cc8 (docs) /user/new 2024-02-03 10:59:06 -08:00
ishaan-jaff
c9958eb329 (feat) raise error when user_role not in known roles 2024-02-03 10:40:59 -08:00
ishaan-jaff
d41f1b4997 (feat) set user_role for Users on proxy 2024-02-03 10:11:42 -08:00
ishaan-jaff
ebb221f743 (fix) ui - don't fail when no DB connected 2024-02-02 20:17:26 -08:00
ishaan-jaff
cfec3c611e (fix) improve proxy api_key caching 2024-02-02 19:59:13 -08:00
ishaan-jaff
42fcce4645 (fix) /key/info test 2024-02-02 19:22:55 -08:00
Krrish Dholakia
bfe2faa454 test(test_keys.py): separate streaming key info test from normal completion key info test 2024-02-02 19:03:47 -08:00
Krrish Dholakia
1f0598a277 fix(proxy_server.py): load default team config straight from config file 2024-02-02 19:03:47 -08:00
Krrish Dholakia
688193bea3 fix(proxy_server.py): don't silently fail load_team_config 2024-02-02 19:03:47 -08:00
ishaan-jaff
9852462d1f (fix) proxy - clear cache after /key/delete 2024-02-02 18:40:18 -08:00
Krrish Dholakia
24b8abe10d fix(view_key_table_tsx): show abbreviated key name instead of hashed token 2024-02-02 14:56:19 -08:00
Krrish Dholakia
e8785d5dff fix(proxy_server.py): have spend logs be admin controlled only 2024-02-02 13:43:48 -08:00
Krrish Dholakia
ada62192ad fix(proxy_server.py): stronger type checking for team based settings 2024-02-02 13:15:44 -08:00
Krish Dholakia
93fb0134e5
Merge pull request #1761 from BerriAI/litellm_fix_dynamic_callbacks
fix(utils.py): override default success callbacks with dynamic callbacks if set
2024-02-02 13:06:55 -08:00
ishaan-jaff
071d70ec2d (fix) proxy sso - use PROXY_BASE_URL 2024-02-02 11:05:48 -08:00