Commit graph

3392 commits

Author SHA1 Message Date
Krish Dholakia
0f1b48162c Merge branch 'main' into litellm_pass_through_endpoints_api 2024-08-15 22:39:19 -07:00
Krrish Dholakia
1c2decbfdd feat(ui): for adding pass-through endpoints 2024-08-15 21:58:11 -07:00
Krrish Dholakia
362605ba65 feat(pass_through_endpoints.py): initial working CRUD endpoints for /pass_through_endoints 2024-08-15 21:23:26 -07:00
Ishaan Jaff
62314c7f8e fix using prompt caching on proxy 2024-08-15 20:12:11 -07:00
Krrish Dholakia
b08492bc29 fix(s3.py): fix s3 logging payload to have valid json values
Previously pydantic objects were being stringified, making them unparsable
2024-08-15 17:09:02 -07:00
Ishaan Jaff
e79a81522e fix ImportError 2024-08-15 13:02:44 -07:00
Ishaan Jaff
4a89a30f12 fix - don't require boto3 on the cli 2024-08-15 12:36:38 -07:00
Ishaan Jaff
1c9d824151 fix /moderations endpoint 2024-08-15 08:58:28 -07:00
Ishaan Jaff
54d888f566 fix test proxy exception mapping 2024-08-15 08:52:28 -07:00
Ishaan Jaff
654df03678 refactor use 1 util for llm routing 2024-08-15 08:42:20 -07:00
Ishaan Jaff
4a30781919 simplify logic for routing llm request 2024-08-15 08:29:28 -07:00
Ishaan Jaff
4cbde8af39 use route_request for making llm call 2024-08-15 08:16:44 -07:00
Krrish Dholakia
7a67551927 feat(pass_through_endpoints.py): initial commit of crud endpoints for pass through endpoints 2024-08-14 21:36:07 -07:00
Krrish Dholakia
3ea4a3b8bd feat(proxy_server.py): support returning available fields for pass_through_endpoints via `/config/field/list 2024-08-14 19:07:10 -07:00
Krish Dholakia
bda1ee16a9 Merge branch 'main' into litellm_azure_ai_openai_support 2024-08-14 17:53:27 -07:00
Krish Dholakia
6b14dbc885 Merge branch 'main' into litellm_fix_pass_through_endpoints 2024-08-14 14:59:38 -07:00
Krrish Dholakia
1ff93ed664 docs(model_management.md): add section on adding additional model information to proxy config 2024-08-14 14:39:48 -07:00
Krrish Dholakia
3026e69926 fix(utils.py): support calling openai models via azure_ai/ 2024-08-14 13:41:04 -07:00
Krish Dholakia
3445307297 Merge pull request #5176 from BerriAI/litellm_key_logging
Allow specifying langfuse project for logging in key metadata
2024-08-14 12:55:07 -07:00
Ishaan Jaff
9bd112d970 fix test for gcs bucket 2024-08-14 08:40:02 -07:00
Ishaan Jaff
da61511a8e feat log fail events on gcs 2024-08-14 08:39:16 -07:00
Krrish Dholakia
9387662eab fix(user_api_key_auth.py): more precisely expand scope to handle 'basic' tokens 2024-08-13 22:00:33 -07:00
Ishaan Jaff
acb31c0acd return detailed error message on check_valid_ip 2024-08-13 21:29:21 -07:00
Ishaan Jaff
11345c4689 fix use s3 get_credentials to get boto3 creds 2024-08-13 21:18:06 -07:00
Ishaan Jaff
702f6bca00 comment on using boto3 2024-08-13 20:28:40 -07:00
Krrish Dholakia
8b4b378562 feat(user_api_key_auth.py): support calling langfuse with litellm user_api_key_auth 2024-08-13 20:26:24 -07:00
Ishaan Jaff
2e3e06844c feat read config from s3 2024-08-13 20:18:59 -07:00
Ishaan Jaff
b39cd3b9b4 add helper to load config from s3 2024-08-13 20:16:54 -07:00
Ishaan Jaff
84051cc693 ui new build 2024-08-13 18:45:09 -07:00
Ishaan Jaff
f04751013e Merge pull request #5181 from BerriAI/litellm_check_x_fwded_for
[Feat-Proxy Security] Allow Using `x-forwarded-for` for enforcing + tracking  ip address
2024-08-13 16:07:31 -07:00
Ishaan Jaff
7d439865e7 add test for test_check_valid_ip_sent_with_x_forwarded_for 2024-08-13 15:54:53 -07:00
Ishaan Jaff
e62aa0d1c2 use _check_valid_ip 2024-08-13 15:41:01 -07:00
Ishaan Jaff
d872a7e32e feat log use_x_forwarded_for 2024-08-13 15:22:54 -07:00
Krrish Dholakia
a181af3d2e fix(langsmith.py): support langsmith 'extra' field object
Closes https://github.com/BerriAI/litellm/issues/5179
2024-08-13 15:20:50 -07:00
Ishaan Jaff
eb18d0a26b check use_x_forwarded_for 2024-08-13 15:18:24 -07:00
Ishaan Jaff
8afcba8d90 add langfuse_default_tags 2024-08-13 12:28:28 -07:00
Krrish Dholakia
9fcb6f8f57 fix(litellm_pre_call_utils.py): support routing to logging project by api key 2024-08-12 21:21:40 -07:00
Krrish Dholakia
dd10896f32 refactor(test_users.py): refactor test for user info to use mock endpoints 2024-08-12 19:35:07 -07:00
Krrish Dholakia
4bbabb4039 refactor(test_users.py): refactor test for user info to use mock endpoints 2024-08-12 18:48:43 -07:00
Ishaan Jaff
2e94d3003b Merge pull request #5168 from BerriAI/litellm_use_user_api_key_auth_int_usr_endpoints
[Feat Proxy] Send slack alert on CRUD endpoints for Internal Users
2024-08-12 12:20:16 -07:00
Ishaan Jaff
c088d1cc91 Merge pull request #5167 from BerriAI/litellm_fix_docstring
[Proxy docstring] fix curl on docstring on /team endpoints
2024-08-12 12:20:03 -07:00
Ishaan Jaff
b0629e5947 Merge pull request #5166 from BerriAI/litellm_log_key_created_slack
[Feat-Security] Send Slack Alert when CRUD ops done on Virtual Keys, Teams, Internal Users
2024-08-12 12:18:04 -07:00
Ishaan Jaff
2b79e44fc5 fix internal user tests to pass 2024-08-12 12:11:23 -07:00
Ishaan Jaff
f4b1aa2074 log new_user, delete user 2024-08-12 12:01:26 -07:00
Ishaan Jaff
63c15359a6 send slack alert on team events 2024-08-12 11:56:13 -07:00
Ishaan Jaff
79874caf98 fix doc string for team endpoints 2024-08-12 11:54:28 -07:00
Ishaan Jaff
0f7d575992 send alert on all key events 2024-08-12 11:39:24 -07:00
Krrish Dholakia
3fa00408f1 fix(proxy_server.py): add info log when spend logs is skipped because disable_spend_logs=True. 2024-08-12 11:20:30 -07:00
Ishaan Jaff
97626b1c89 make send_management_endpoint_alert a premium feature 2024-08-12 11:12:38 -07:00
Ishaan Jaff
0c13986db9 send management endpoint alert 2024-08-12 11:07:48 -07:00