Commit graph

691 commits

Author SHA1 Message Date
ishaan-jaff
b895ac8b08 (docs) add moderations endpoint to docs 2024-02-14 11:34:18 -08:00
ishaan-jaff
5c1d22e30e (feat) proxy add amoderation endpoint 2024-02-14 11:03:23 -08:00
Krish Dholakia
2965eaa1c9 Merge pull request #1971 from BerriAI/litellm_fix_team_id
fix(proxy_server.py): fix proxy server team id bug
2024-02-13 23:24:38 -08:00
Krish Dholakia
607c79a0ce Merge branch 'main' into litellm_fix_pii_output_parsing 2024-02-13 22:36:17 -08:00
Krrish Dholakia
b501af8f43 fix(proxy_server.py): fix proxy server team id bug 2024-02-13 22:33:56 -08:00
Krrish Dholakia
9936427669 feat(presidio_pii_masking.py): enable output parsing for pii masking 2024-02-13 21:36:57 -08:00
Ishaan Jaff
8b1ee3499e Merge branch 'main' into litellm_dynamo_use_arn 2024-02-13 21:27:38 -08:00
ishaan-jaff
8b2e08bc39 (fix) use correct value for os.environ dynamo 2024-02-12 21:41:13 -08:00
Krish Dholakia
23077f0503 Merge pull request #1946 from BerriAI/litellm_proxy_routing_fix
Litellm proxy routing fix
2024-02-12 18:12:52 -08:00
ishaan-jaff
01f5c60fa3 (feat) /model/info add 3rd fallback 2024-02-12 16:40:41 -08:00
ishaan-jaff
702dcfd166 (feat) model/info have fallback check 2024-02-12 16:13:36 -08:00
ishaan-jaff
95fa4daf31 (fix) allow ui to show /model/info 2024-02-12 15:42:42 -08:00
Krrish Dholakia
9bc0273880 fix(proxy_server.py): fix exception raising 2024-02-12 11:13:02 -08:00
Krrish Dholakia
76d08ab570 fix(proxy_server.py): restrict proxy to just listed models 2024-02-12 09:30:59 -08:00
Krish Dholakia
32b5dcc365 Merge pull request #1931 from BerriAI/litellm_microsoft_presidio_pii
feat(proxy_server.py): support for pii masking with microsoft presidio
2024-02-11 00:27:14 -08:00
Ishaan Jaff
8a46b50724 Merge pull request #1933 from BerriAI/litellm_team_specific_models
[FEAT] Proxy - set team specific models
2024-02-10 21:40:13 -08:00
ishaan-jaff
2b683f18e8 (feat)team-specific models 2024-02-10 21:13:39 -08:00
Krrish Dholakia
e1156c99d9 fix(proxy_server.py): support list as well as direct input for custom callbacks 2024-02-10 20:38:09 -08:00
Krrish Dholakia
75d474819e fix(proxy_server.py): fix import 2024-02-10 20:31:54 -08:00
Krrish Dholakia
c1a60176a5 feat(proxy_server.py): support for pii masking with microsoft presidio 2024-02-10 20:21:12 -08:00
ishaan-jaff
8316820112 (fix) undo today's mistake where bedrock was async 2024-02-10 18:32:29 -08:00
Krrish Dholakia
ba06132d56 fix(proxy_server.py): don't change old /key/info endpoint 2024-02-10 17:31:23 -08:00
Krrish Dholakia
8d9ed83389 feat(ui): show key alias instead of hashed token 2024-02-10 15:45:42 -08:00
Krrish Dholakia
31e8fbef54 feat(proxy_server.py): support key lists for /key/info 2024-02-10 14:24:12 -08:00
ishaan-jaff
5fcdc95279 (fix) proxy - use bedrock in sync streaming 2024-02-10 09:47:33 -08:00
Krrish Dholakia
b1ae8e40c5 fix(ui): export ui npm build 2024-02-10 08:43:41 -08:00
Krish Dholakia
8d51888d15 Merge branch 'main' into litellm_ui_improvements_time_series 2024-02-09 20:54:36 -08:00
Krrish Dholakia
8950ae2240 fix(usage.tsx): show top users and top keys driving spend 2024-02-09 19:50:07 -08:00
Krrish Dholakia
610d039b18 fix(proxy_server.py): fix /spend/logs endpoint 2024-02-09 18:11:33 -08:00
ishaan-jaff
da4441b1fc (feat) support azure deployments for embeddings 2024-02-09 16:47:01 -08:00
Krrish Dholakia
ecbcb45d7a feat(proxy_server.py): show admin global spend as time series data 2024-02-09 16:31:35 -08:00
Krrish Dholakia
11db12c023 fix: fixes 2024-02-08 21:54:48 -08:00
Krrish Dholakia
e4c8a6684e fix(proxy_server.py): enable aggregate queries via /spend/keys 2024-02-08 20:29:08 -08:00
ishaan-jaff
eb95a1c1ef (fix) ui /login without sso 2024-02-08 10:47:45 -08:00
ishaan-jaff
d55f75cc46 (feat) slack alerting when track callback fails 2024-02-07 20:09:28 -08:00
ishaan-jaff
e8532d4285 (feat) alert for failing cost tracking 2024-02-07 18:49:45 -08:00
Krrish Dholakia
5b8aa14f9b fix(proxy_server.py): check if prisma client is set before scheduling reset budget 2024-02-07 18:14:37 -08:00
Krrish Dholakia
605cfecf27 fix(proxy_server.py): fix merge errors 2024-02-07 00:04:52 -08:00
Krrish Dholakia
cf588a97fe refactor(proxy_server.py): fix merge error 2024-02-06 23:44:23 -08:00
Krish Dholakia
f5eca2f4ad Merge branch 'main' into litellm_spend_logging_high_traffic 2024-02-06 23:36:58 -08:00
Krrish Dholakia
c7b3c3d43f fix(proxy_server.py): update user cache to with new spend 2024-02-06 23:06:05 -08:00
Krrish Dholakia
1c78da4100 fix(proxy_server.py): fix endpoint 2024-02-06 22:09:30 -08:00
Krish Dholakia
8960031eae Merge pull request #1843 from BerriAI/litellm_admin_ui_view_all_keys
feat(ui): enable admin to view all valid keys created on the proxy
2024-02-06 22:06:46 -08:00
Krrish Dholakia
c43baff5c9 fix: export npm build into proxy 2024-02-06 20:12:50 -08:00
Krrish Dholakia
c429dfa746 fix(proxy_cli.py-&&-proxy_server.py): bump reset budget intervals and fix pool limits for prisma connections 2024-02-06 19:39:49 -08:00
ishaan-jaff
80f24fc29c (fix) allow litellm_settings to be None 2024-02-06 19:29:39 -08:00
Krrish Dholakia
c28d72ca8d fix(proxy_server.py): prisma client fixes for high traffic 2024-02-06 17:30:36 -08:00
Ishaan Jaff
2a89ff18e2 Merge pull request #1859 from BerriAI/litellm_allow_using_budgets_without_keys
[Feat] Budgets for 'user' param passed to /chat/completions, /embeddings etc
2024-02-06 16:32:25 -08:00
ishaan-jaff
4de77018cc (feat) support max_user_budget 2024-02-06 15:19:36 -08:00
Krish Dholakia
c68764005d Merge branch 'main' into litellm_admin_ui_view_all_keys 2024-02-06 14:34:57 -08:00