Commit graph

639 commits

Author SHA1 Message Date
Ishaan Jaff
2a89ff18e2 Merge pull request #1859 from BerriAI/litellm_allow_using_budgets_without_keys
[Feat] Budgets for 'user' param passed to /chat/completions, /embeddings etc
2024-02-06 16:32:25 -08:00
ishaan-jaff
4de77018cc (feat) support max_user_budget 2024-02-06 15:19:36 -08:00
Krish Dholakia
1fc2c74877 Merge branch 'main' into litellm_vertex_ai_streaming_fix 2024-02-06 14:33:54 -08:00
ishaan-jaff
9bf57170e7 (feat) show semantic-cache on health/readiness 2024-02-06 13:58:20 -08:00
ishaan-jaff
ab4e7f2be9 (feat) show semantic-cache on health/readiness 2024-02-06 13:35:34 -08:00
ishaan-jaff
f8472fe3cf (feat) redis-semantic cache on proxy 2024-02-06 13:30:59 -08:00
ishaan-jaff
48be4a2695 (feat) redis-semantic cache on proxy 2024-02-06 13:30:31 -08:00
Krrish Dholakia
97514b6bed fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected) 2024-02-06 12:57:05 -08:00
Ishaan Jaff
e9c42eb4ae Merge branch 'main' into litellm_add_semantic_cache 2024-02-06 11:18:43 -08:00
ishaan-jaff
3b869d7cd1 (feat) redis-semantic cache on proxy 2024-02-06 10:35:21 -08:00
Krrish Dholakia
32639bf398 fix(utils.py): return finish reason for last vertex ai chunk 2024-02-06 09:21:03 -08:00
ishaan-jaff
0ca4f962d9 (feat) upperbound_key_generate_params 2024-02-05 22:38:47 -08:00
ishaan-jaff
dadfef7eac (fix) make sure route is str 2024-02-05 16:22:36 -08:00
ishaan-jaff
bbdf9fe7d5 (fix) litellm-ui keys can never access /chat/completions 2024-02-05 16:10:49 -08:00
Krrish Dholakia
2e3c7088d1 fix(utils.py): support together ai function calling 2024-02-05 15:30:44 -08:00
Krish Dholakia
bf79d265d8 Merge pull request #1809 from BerriAI/litellm_embedding_caching_updates
Support caching individual items in embedding list (Async embedding only)
2024-02-03 21:04:23 -08:00
ishaan-jaff
f6d0cd027c (feat) new ui build 2024-02-03 18:53:05 -08:00
Krish Dholakia
45cbb3cf3d Merge branch 'main' into litellm_embedding_caching_updates 2024-02-03 18:08:47 -08:00
ishaan-jaff
df2ebd9ee3 (feat) allow users to view their spend/logs 2024-02-03 17:33:19 -08:00
ishaan-jaff
351d93b474 (feat) only allow master key to update users 2024-02-03 14:16:14 -08:00
ishaan-jaff
87bc8ded03 (docs) /user/new 2024-02-03 10:59:06 -08:00
ishaan-jaff
bf4399d35b (feat) raise error when user_role not in known roles 2024-02-03 10:40:59 -08:00
ishaan-jaff
cd2ef3d616 (feat) set user_role for Users on proxy 2024-02-03 10:11:42 -08:00
ishaan-jaff
76bc4beb3a (fix) ui - don't fail when no DB connected 2024-02-02 20:17:26 -08:00
ishaan-jaff
3cf070ffa8 (fix) improve proxy api_key caching 2024-02-02 19:59:13 -08:00
ishaan-jaff
4a0efa186a (fix) /key/info test 2024-02-02 19:22:55 -08:00
Krrish Dholakia
b1c695ae23 test(test_keys.py): separate streaming key info test from normal completion key info test 2024-02-02 19:03:47 -08:00
Krrish Dholakia
3db71fe414 fix(proxy_server.py): load default team config straight from config file 2024-02-02 19:03:47 -08:00
Krrish Dholakia
3f0aad68a9 fix(proxy_server.py): don't silently fail load_team_config 2024-02-02 19:03:47 -08:00
ishaan-jaff
00621f3ba4 (fix) proxy - clear cache after /key/delete 2024-02-02 18:40:18 -08:00
Krrish Dholakia
9137362aff fix(view_key_table_tsx): show abbreviated key name instead of hashed token 2024-02-02 14:56:19 -08:00
Krrish Dholakia
3b472ce3ed fix(proxy_server.py): have spend logs be admin controlled only 2024-02-02 13:43:48 -08:00
Krrish Dholakia
67dba58c65 fix(proxy_server.py): stronger type checking for team based settings 2024-02-02 13:15:44 -08:00
Krish Dholakia
6824014c5f Merge pull request #1761 from BerriAI/litellm_fix_dynamic_callbacks
fix(utils.py): override default success callbacks with dynamic callbacks if set
2024-02-02 13:06:55 -08:00
ishaan-jaff
f197d57cdc (fix) proxy sso - use PROXY_BASE_URL 2024-02-02 11:05:48 -08:00
ishaan-jaff
f96141220f (fix) docstring for /sso/key/generate 2024-02-02 11:01:46 -08:00
ishaan-jaff
312ba6bd5d (fix) proxy ui - without sso 2024-02-02 10:40:37 -08:00
Krrish Dholakia
e20e8beec3 test(test_keys.py): add more logging 2024-02-02 10:08:02 -08:00
Krrish Dholakia
16c3ab1da0 fix(utils.py): logging fixes 2024-02-02 08:31:17 -08:00
Krrish Dholakia
aa40663150 fix(utils.py): add track cost callback to callback list for team id callbacks 2024-02-02 08:18:06 -08:00
Sébastien Campion
eb0f388e3d Allow to specify user email created via /user/new 2024-02-02 11:08:47 +01:00
Krrish Dholakia
99678147df feat(utils.py): support dynamic langfuse params and team settings on proxy 2024-02-01 21:08:24 -08:00
ishaan-jaff
edffc5fd0d (fix) handle when users pass Malformed API Key 2024-02-01 16:29:50 -08:00
ishaan-jaff
2902cb1d82 (fix) ci/cd don't let importing litellm._version block starting proxy 2024-02-01 16:23:16 -08:00
ishaan-jaff
47985d2e75 (fix) only allow master_key to access UI 2024-02-01 16:12:53 -08:00
ishaan-jaff
d47fad5392 (fix) proxy - show Admin Panel on swagger 2024-02-01 16:02:57 -08:00
Ishaan Jaff
cb4ab543e9 Merge pull request #1748 from BerriAI/litellm_custom_auth_fixes
[Fix] user_custom_auth fixes when user passed bad api_keys
2024-02-01 15:42:39 -08:00
ishaan-jaff
e5158d3e83 (fix) proxy - remove Literal 2024-02-01 15:36:33 -08:00
ishaan-jaff
9c07985725 (fix) update v 2024-02-01 15:25:30 -08:00
ishaan-jaff
4db5668b08 (fix) ui improve default flow 2024-02-01 15:03:48 -08:00