Commit graph

1852 commits

Author SHA1 Message Date
Krrish Dholakia
9f83724697 feat(proxy_server.py): support disabling storing master key hash in db, for spend tracking 2024-08-21 12:35:37 -07:00
Krrish Dholakia
d163025fab fix(proxy_server.py): fix invalid login message to not show passed in pwd
Closes https://github.com/BerriAI/litellm/issues/5290
2024-08-20 08:56:57 -07:00
Ishaan Jaff
338b3a6bae Merge pull request #4868 from msabramo/allow-not-displaying-feedback-box
Allow not displaying feedback box
2024-08-20 08:53:45 -07:00
Ishaan Jaff
c82714757a Merge pull request #5288 from BerriAI/litellm_aporia_refactor
[Feat] V2 aporia guardrails litellm
2024-08-19 20:41:45 -07:00
Ishaan Jaff
319690ab5e feat - guardrails v2 2024-08-19 18:24:20 -07:00
Krrish Dholakia
4b15f5bc83 feat(langfuse_endpoints.py): support langfuse pass through endpoints by default 2024-08-19 17:28:34 -07:00
Ishaan Jaff
f16e0472c2 feat - return applied guardrails in response headers 2024-08-19 11:56:20 -07:00
Ishaan Jaff
b4bca8db82 feat - allow accessing data post success call 2024-08-19 11:35:33 -07:00
Krish Dholakia
5e6700f985 Merge pull request #5260 from BerriAI/google_ai_studio_pass_through
Pass-through endpoints for Gemini - Google AI Studio
2024-08-17 13:51:51 -07:00
Ishaan Jaff
db8f789318 Merge pull request #5259 from BerriAI/litellm_return_remaining_tokens_in_header
[Feat] return `x-litellm-key-remaining-requests-{model}`: 1, `x-litellm-key-remaining-tokens-{model}: None` in response headers
2024-08-17 12:41:16 -07:00
Ishaan Jaff
9f6630912d feat return rmng tokens for model for api key 2024-08-17 12:35:10 -07:00
Krrish Dholakia
29bedae79f feat(google_ai_studio_endpoints.py): support pass-through endpoint for all google ai studio requests
New Feature
2024-08-17 10:46:59 -07:00
Ishaan Jaff
a62277a6aa feat - use commong helper for getting model group 2024-08-17 10:46:04 -07:00
Krrish Dholakia
2874b94fb1 refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
Krish Dholakia
0f1b48162c Merge branch 'main' into litellm_pass_through_endpoints_api 2024-08-15 22:39:19 -07:00
Krrish Dholakia
1c2decbfdd feat(ui): for adding pass-through endpoints 2024-08-15 21:58:11 -07:00
Krrish Dholakia
362605ba65 feat(pass_through_endpoints.py): initial working CRUD endpoints for /pass_through_endoints 2024-08-15 21:23:26 -07:00
Ishaan Jaff
654df03678 refactor use 1 util for llm routing 2024-08-15 08:42:20 -07:00
Ishaan Jaff
4cbde8af39 use route_request for making llm call 2024-08-15 08:16:44 -07:00
Krrish Dholakia
7a67551927 feat(pass_through_endpoints.py): initial commit of crud endpoints for pass through endpoints 2024-08-14 21:36:07 -07:00
Krrish Dholakia
3ea4a3b8bd feat(proxy_server.py): support returning available fields for pass_through_endpoints via `/config/field/list 2024-08-14 19:07:10 -07:00
Ishaan Jaff
2e3e06844c feat read config from s3 2024-08-13 20:18:59 -07:00
Krrish Dholakia
3fa00408f1 fix(proxy_server.py): add info log when spend logs is skipped because disable_spend_logs=True. 2024-08-12 11:20:30 -07:00
Ishaan Jaff
dcf50ff219 feat add cron job for sending stats from prometheus 2024-08-10 16:56:03 -07:00
Krrish Dholakia
c919c15c4a fix(proxy_server.py): ensure internal_user params only apply to internal_user role 2024-08-08 17:50:29 -07:00
Krrish Dholakia
488a78e5f4 fix(proxy_server.py): respect internal_user_budget_duration for sso user 2024-08-08 17:28:28 -07:00
Krrish Dholakia
384f8f4f54 fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 17:19:12 -07:00
Krrish Dholakia
eb292e0b31 feat: set max_internal_budget for user w/ sso 2024-08-08 12:44:07 -07:00
Ishaan Jaff
25e6733da3 support provider wildcard routing 2024-08-07 14:20:22 -07:00
Ishaan Jaff
7bcb088ac0 clean up unused func 2024-08-06 20:58:51 -07:00
Ishaan Jaff
22ca6d6d30 fix forward ui requests when base url set 2024-08-06 18:10:34 -07:00
Ishaan Jaff
e207ac577e add redirect_ui_middleware 2024-08-06 18:01:23 -07:00
Ishaan Jaff
53451834bd Merge pull request #5077 from BerriAI/litellm_fix_ui_emails
[Fix] Fix testing emails through Admin UI
2024-08-06 16:41:01 -07:00
Ishaan Jaff
7fbd0855b6 update alerting settings on ui 2024-08-06 16:05:33 -07:00
Ishaan Jaff
6a46899521 add debug statements on docker 2024-08-06 15:29:49 -07:00
Krrish Dholakia
5ffadd631d feat(proxy_server.py): allow restricting allowed email domains for the UI 2024-08-06 12:53:03 -07:00
Ishaan Jaff
8ad43780cf add debugging utils to print when connecting to prisma 2024-08-05 19:19:28 -07:00
Ishaan Jaff
357ca893f8 build ui on custom path 2024-08-05 16:34:37 -07:00
Ishaan Jaff
e6f4d7a81d set PROXY_BASE_URL when server root path set 2024-08-05 15:48:44 -07:00
Krish Dholakia
88a2428ee6 Merge branch 'main' into litellm_anthropic_api_streaming 2024-08-03 21:16:50 -07:00
Krrish Dholakia
5810708c71 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint
Fixes https://github.com/BerriAI/litellm/issues/5011
2024-08-03 20:16:19 -07:00
Ishaan Jaff
c206a9c2d7 set native vertex endpoints 2024-08-03 16:52:03 -07:00
Krrish Dholakia
e6bc7e938a fix(utils.py): handle scenario where model="azure/*" and custom_llm_provider="azure"
Fixes https://github.com/BerriAI/litellm/issues/4912
2024-08-02 17:48:53 -07:00
Krrish Dholakia
e60bec92ac feat(ui): add ability to enable traceloop + langsmith via ui 2024-07-31 21:40:29 -07:00
Krrish Dholakia
c5e38b3bec feat(ui): add braintrust logging to ui 2024-07-31 21:15:19 -07:00
Ishaan Jaff
4f21ce2873 Merge pull request #4987 from BerriAI/litellm_add_ft_endpoints
[Feat-Proxy] Add List fine-tuning jobs
2024-07-31 16:49:59 -07:00
Ishaan Jaff
f90f3f28fb fix fine tuning endpoint postion on swagger 2024-07-31 16:46:58 -07:00
Ishaan Jaff
8a266a0493 fix routes order 2024-07-31 16:36:50 -07:00
Ishaan Jaff
d7c0e0c471 allow setting files config 2024-07-31 15:28:41 -07:00
Krrish Dholakia
368af6975a fix(http_handler.py): correctly re-raise timeout exception 2024-07-31 14:51:28 -07:00