Commit graph

3156 commits

Author SHA1 Message Date
Ishaan Jaff
322258a1fa Merge pull request #5098 from BerriAI/litellm_provider_wildcard_routing
[Feat-Router + Proxy] Add provider wildcard routing
2024-08-07 14:51:42 -07:00
Ishaan Jaff
31e4fca748 fix use provider specific routing 2024-08-07 14:37:20 -07:00
Ishaan Jaff
25e6733da3 support provider wildcard routing 2024-08-07 14:20:22 -07:00
Krish Dholakia
77a33baabb Merge branch 'main' into litellm_add_pydantic_model_support 2024-08-07 13:07:46 -07:00
Krrish Dholakia
0de640700d fix(router.py): add reason for fallback failure to client-side exception string
make it easier to debug why a fallback failed to occur
2024-08-07 13:02:47 -07:00
Ishaan Jaff
426dcc9275 emit deployment_partial_outage on prometheus 2024-08-07 09:56:01 -07:00
Krish Dholakia
0044fd0041 Merge branch 'main' into litellm_support_lakera_config_thresholds 2024-08-06 22:47:13 -07:00
Ishaan Jaff
5eabef4318 fix pass through endpoint tests 2024-08-06 21:16:07 -07:00
Ishaan Jaff
7bcb088ac0 clean up unused func 2024-08-06 20:58:51 -07:00
Krrish Dholakia
8b028d41aa feat(utils.py): support validating json schema client-side if user opts in 2024-08-06 19:35:33 -07:00
Ishaan Jaff
22ca6d6d30 fix forward ui requests when base url set 2024-08-06 18:10:34 -07:00
Ishaan Jaff
e207ac577e add redirect_ui_middleware 2024-08-06 18:01:23 -07:00
Ishaan Jaff
53451834bd Merge pull request #5077 from BerriAI/litellm_fix_ui_emails
[Fix] Fix testing emails through Admin UI
2024-08-06 16:41:01 -07:00
Krrish Dholakia
ca87ad5378 fix(lakera_ai.py): fix hardcoded prompt_injection string in lakera integration 2024-08-06 16:12:54 -07:00
Ishaan Jaff
7fbd0855b6 update alerting settings on ui 2024-08-06 16:05:33 -07:00
Ishaan Jaff
00832bb8f2 fix email health checks 2024-08-06 15:59:26 -07:00
Ishaan Jaff
6a46899521 add debug statements on docker 2024-08-06 15:29:49 -07:00
Krrish Dholakia
b4ffa4e43c feat(lakera_ai.py): support lakera custom thresholds + custom api base
Allows user to configure thresholds to trigger prompt injection rejections
2024-08-06 15:21:45 -07:00
Krish Dholakia
78f1ad7e35 Merge pull request #5071 from BerriAI/litellm_auth_restricted_domains
feat(proxy_server.py): allow restricting allowed email domains for UI
2024-08-06 14:18:57 -07:00
Krrish Dholakia
5ffadd631d feat(proxy_server.py): allow restricting allowed email domains for the UI 2024-08-06 12:53:03 -07:00
Ishaan Jaff
662a9b1d7e Merge pull request #5062 from BerriAI/litellm_forward_headers
[Fix-Proxy] allow forwarding headers from request
2024-08-06 12:34:25 -07:00
Krrish Dholakia
2ec7cb4153 fix(utils.py): fix types 2024-08-06 12:23:22 -07:00
Ishaan Jaff
32e531eb07 init pass through endpoints 2024-08-06 12:04:04 -07:00
Krrish Dholakia
ff28823025 fix(encrypt_decrypt_utils.py): add helper line, explaining why there might be a key decryption error 2024-08-06 11:35:40 -07:00
Ishaan Jaff
4656f7981d use helper to forward headers from request 2024-08-06 11:34:10 -07:00
Ishaan Jaff
d3d13e40be use prints 2024-08-06 11:07:12 -07:00
Krish Dholakia
350e4b3830 Merge pull request #5057 from BerriAI/litellm_rds_iam_auth
feat(proxy_cli.py): support iam-based auth to rds
2024-08-06 10:44:33 -07:00
Krrish Dholakia
3a3381387f feat(utils.py): check env var for api base for openai-compatible endpoints
Closes https://github.com/BerriAI/litellm/issues/5066
2024-08-06 08:32:44 -07:00
Ishaan Jaff
e8f4ee56ad forward headers from request 2024-08-05 21:45:44 -07:00
Krrish Dholakia
99f728b1e5 fix(rds_iam_token.py): support sts based auth 2024-08-05 21:01:17 -07:00
Ishaan Jaff
51f5c2d08f use safe init_verbose_loggers 2024-08-05 20:56:48 -07:00
Krrish Dholakia
4fd583af43 fix(user_api_key_auth.py): fix _get_user_role 2024-08-05 20:54:27 -07:00
Krish Dholakia
9191afd48b Merge pull request #5052 from BerriAI/litellm_stability_fixes
fix: bump default allowed_fails + reduce default db pool limit
2024-08-05 20:54:23 -07:00
Ishaan Jaff
4c4cc1ba23 Merge pull request #5058 from BerriAI/litellm_add_debug_statements_connecting_prisma
Fix - add debug statements when connecting to prisma DB
2024-08-05 20:53:55 -07:00
Ishaan Jaff
5dc04d8479 Merge pull request #5059 from BerriAI/litelm_log_otel_args
OTEL - Log DB queries / functions on OTEL
2024-08-05 20:51:11 -07:00
Ishaan Jaff
bf72b7e567 otel fix async_service_failure_hook 2024-08-05 20:18:40 -07:00
Ishaan Jaff
3905825609 use otel callbacks 2024-08-05 20:00:06 -07:00
Ishaan Jaff
b80629b828 log event_metadata on otel service loggers 2024-08-05 19:58:55 -07:00
Krrish Dholakia
4ba576724c test: improve debugging for test 2024-08-05 19:41:08 -07:00
Ishaan Jaff
8ad43780cf add debugging utils to print when connecting to prisma 2024-08-05 19:19:28 -07:00
Ishaan Jaff
6fd1685106 add debug statements when connected to prisma db 2024-08-05 19:13:46 -07:00
Krrish Dholakia
24e20718e4 feat(proxy_cli.py): support iam-based auth to rds
Initial pr for iam-based auth support for rds
2024-08-05 17:35:48 -07:00
Ishaan Jaff
357ca893f8 build ui on custom path 2024-08-05 16:34:37 -07:00
Ishaan Jaff
e6f4d7a81d set PROXY_BASE_URL when server root path set 2024-08-05 15:48:44 -07:00
Krrish Dholakia
b5e22bde06 fix: bump default allowed_fails + reduce default db pool limit
Fixes issues with running proxy server in production
2024-08-05 15:07:46 -07:00
Ishaan Jaff
3d8befa655 fix get_request_route 2024-08-05 10:33:40 -07:00
Ishaan Jaff
7c7c8fe102 use get_request_route 2024-08-05 10:13:47 -07:00
Ishaan Jaff
9abe55fa86 add get_request_route 2024-08-05 10:12:34 -07:00
Krrish Dholakia
8fea55ffd7 fix(user_api_key_auth.py): handle older user_role's
Fixes issue where older user_role's (e.g. app_user) weren't being recognized. + Adds testing for it
2024-08-05 08:57:06 -07:00
Krish Dholakia
88a2428ee6 Merge branch 'main' into litellm_anthropic_api_streaming 2024-08-03 21:16:50 -07:00