Commit graph

3482 commits

Author SHA1 Message Date
Ishaan Jaff
d50f26d73d simplify logic for routing llm request 2024-08-15 08:29:28 -07:00
Ishaan Jaff
fdd6664420 use route_request for making llm call 2024-08-15 08:16:44 -07:00
Krrish Dholakia
28faafadb1 feat(pass_through_endpoints.py): initial commit of crud endpoints for pass through endpoints 2024-08-14 21:36:07 -07:00
Krrish Dholakia
a020563149 feat(proxy_server.py): support returning available fields for pass_through_endpoints via `/config/field/list 2024-08-14 19:07:10 -07:00
Krish Dholakia
435d39bb24
Merge branch 'main' into litellm_azure_ai_openai_support 2024-08-14 17:53:27 -07:00
Krish Dholakia
aa2267bddb
Merge branch 'main' into litellm_fix_pass_through_endpoints 2024-08-14 14:59:38 -07:00
Krrish Dholakia
179dd7b893 docs(model_management.md): add section on adding additional model information to proxy config 2024-08-14 14:39:48 -07:00
Krrish Dholakia
583a3b330d fix(utils.py): support calling openai models via azure_ai/ 2024-08-14 13:41:04 -07:00
Krish Dholakia
22243c6571
Merge pull request #5176 from BerriAI/litellm_key_logging
Allow specifying langfuse project for logging in key metadata
2024-08-14 12:55:07 -07:00
Ishaan Jaff
bb877f6ead fix test for gcs bucket 2024-08-14 08:40:02 -07:00
Ishaan Jaff
63af2942ab feat log fail events on gcs 2024-08-14 08:39:16 -07:00
Krrish Dholakia
5fdbfcee44 fix(user_api_key_auth.py): more precisely expand scope to handle 'basic' tokens 2024-08-13 22:00:33 -07:00
Ishaan Jaff
e0978378c1 return detailed error message on check_valid_ip 2024-08-13 21:29:21 -07:00
Ishaan Jaff
09535b25f4 fix use s3 get_credentials to get boto3 creds 2024-08-13 21:18:06 -07:00
Ishaan Jaff
86818ddffc comment on using boto3 2024-08-13 20:28:40 -07:00
Krrish Dholakia
742e3cbccf feat(user_api_key_auth.py): support calling langfuse with litellm user_api_key_auth 2024-08-13 20:26:24 -07:00
Ishaan Jaff
4e7b0ce76e feat read config from s3 2024-08-13 20:18:59 -07:00
Ishaan Jaff
1475ae59f3 add helper to load config from s3 2024-08-13 20:16:54 -07:00
Ishaan Jaff
c7804e1ea2 ui new build 2024-08-13 18:45:09 -07:00
Ishaan Jaff
063fb380e1
Merge pull request #5181 from BerriAI/litellm_check_x_fwded_for
[Feat-Proxy Security] Allow Using `x-forwarded-for` for enforcing + tracking  ip address
2024-08-13 16:07:31 -07:00
Ishaan Jaff
d0e6ca659f add test for test_check_valid_ip_sent_with_x_forwarded_for 2024-08-13 15:54:53 -07:00
Ishaan Jaff
b94c982ec9 use _check_valid_ip 2024-08-13 15:41:01 -07:00
Ishaan Jaff
0c6c350c23 feat log use_x_forwarded_for 2024-08-13 15:22:54 -07:00
Krrish Dholakia
a9a3282031 fix(langsmith.py): support langsmith 'extra' field object
Closes https://github.com/BerriAI/litellm/issues/5179
2024-08-13 15:20:50 -07:00
Ishaan Jaff
ab208eb546 check use_x_forwarded_for 2024-08-13 15:18:24 -07:00
Ishaan Jaff
82dd3fcc73 add langfuse_default_tags 2024-08-13 12:28:28 -07:00
Krrish Dholakia
93a1335e46 fix(litellm_pre_call_utils.py): support routing to logging project by api key 2024-08-12 21:21:40 -07:00
Krrish Dholakia
f322ffc413 refactor(test_users.py): refactor test for user info to use mock endpoints 2024-08-12 19:35:07 -07:00
Krrish Dholakia
d1d28487f7 refactor(test_users.py): refactor test for user info to use mock endpoints 2024-08-12 18:48:43 -07:00
Ishaan Jaff
12f9894d69
Merge pull request #5168 from BerriAI/litellm_use_user_api_key_auth_int_usr_endpoints
[Feat Proxy] Send slack alert on CRUD endpoints for Internal Users
2024-08-12 12:20:16 -07:00
Ishaan Jaff
0fbcfef08a
Merge pull request #5167 from BerriAI/litellm_fix_docstring
[Proxy docstring] fix curl on docstring on /team endpoints
2024-08-12 12:20:03 -07:00
Ishaan Jaff
c401970522
Merge pull request #5166 from BerriAI/litellm_log_key_created_slack
[Feat-Security] Send Slack Alert when CRUD ops done on Virtual Keys, Teams, Internal Users
2024-08-12 12:18:04 -07:00
Ishaan Jaff
1c71e4db17 fix internal user tests to pass 2024-08-12 12:11:23 -07:00
Ishaan Jaff
a44bd23631 log new_user, delete user 2024-08-12 12:01:26 -07:00
Ishaan Jaff
06eb9c4e39 send slack alert on team events 2024-08-12 11:56:13 -07:00
Ishaan Jaff
f6896aaaf7 fix doc string for team endpoints 2024-08-12 11:54:28 -07:00
Ishaan Jaff
4435a23121 send alert on all key events 2024-08-12 11:39:24 -07:00
Krrish Dholakia
b3c7d63ec1 fix(proxy_server.py): add info log when spend logs is skipped because disable_spend_logs=True. 2024-08-12 11:20:30 -07:00
Ishaan Jaff
65ac139b6b make send_management_endpoint_alert a premium feature 2024-08-12 11:12:38 -07:00
Ishaan Jaff
1335859e5d send management endpoint alert 2024-08-12 11:07:48 -07:00
Ishaan Jaff
47953aaa96 use management_endpoint_wrapper for key endpoints 2024-08-12 11:02:21 -07:00
Ishaan Jaff
30a54ef007 v0 log KeyCreatedEvent 2024-08-12 10:56:11 -07:00
Krrish Dholakia
2ed2ae96af fix(user_api_key_auth.py): move warning to debug log 2024-08-12 10:35:44 -07:00
Ishaan Jaff
e46009f3d2
Merge pull request #5154 from BerriAI/litellm_send_prometheus_fallbacks_from_slack
[Feat-Proxy] send prometheus fallbacks stats to slack
2024-08-10 17:14:01 -07:00
Krrish Dholakia
a0a1feb7da fix(management/utils.py): fix add_member to team when adding user_email
Fixes https://github.com/BerriAI/litellm/issues/5112
2024-08-10 17:12:09 -07:00
Ishaan Jaff
aef13a37f4 feat add cron job for sending stats from prometheus 2024-08-10 16:56:03 -07:00
Ishaan Jaff
017ba7a0fe add slack alerting on proxy_config.yaml 2024-08-10 16:37:59 -07:00
Krrish Dholakia
575afa8029 fix(internal_user_endpoints.py): return all teams if user is admin 2024-08-10 16:36:43 -07:00
Ishaan Jaff
ffb7f9f280 add fallback_reports as slack alert 2024-08-10 15:26:32 -07:00
Ishaan Jaff
3bc39af1b9
Merge pull request #5153 from BerriAI/litellm_track_fallback_prometheus
Feat - Proxy track fallback metrics on prometheus
2024-08-10 14:10:42 -07:00