Commit graph

3417 commits

Author SHA1 Message Date
Krrish Dholakia
d163025fab fix(proxy_server.py): fix invalid login message to not show passed in pwd
Closes https://github.com/BerriAI/litellm/issues/5290
2024-08-20 08:56:57 -07:00
Ishaan Jaff
338b3a6bae Merge pull request #4868 from msabramo/allow-not-displaying-feedback-box
Allow not displaying feedback box
2024-08-20 08:53:45 -07:00
Ishaan Jaff
09d67eb7a9 test guardrails with API Key 2024-08-20 08:40:00 -07:00
Ishaan Jaff
50e9d05921 feat control guardrails per API Key 2024-08-20 08:16:28 -07:00
Krrish Dholakia
3713101904 fix(pass_through_endpoints.py): fix query param pass through 2024-08-19 21:38:30 -07:00
Krrish Dholakia
2b4d692353 fix(litellm_pre_call_utils.py): handle no query params in request 2024-08-19 21:09:03 -07:00
Ishaan Jaff
6d0f96f437 fix _get_request_ip_address 2024-08-19 21:08:27 -07:00
Ishaan Jaff
2d75e7a8d4 fix import error guardrails 2024-08-19 21:03:37 -07:00
Ishaan Jaff
fb9f79e64d fix importing _ENTERPRISE_Aporia 2024-08-19 21:03:37 -07:00
Ishaan Jaff
75c7b660b1 add testing for aporia guardrails 2024-08-19 21:03:37 -07:00
Ishaan Jaff
0540ebb91a fix aporia typo 2024-08-19 21:03:37 -07:00
Ishaan Jaff
bcd58be51b feat - guardrails v2 2024-08-19 21:03:37 -07:00
Ishaan Jaff
92593daff2 doc aporia_w_litellm 2024-08-19 21:03:37 -07:00
Ishaan Jaff
64d0299a31 run during_call_hook 2024-08-19 21:03:37 -07:00
Ishaan Jaff
19c2a0a631 feat - return applied guardrails in response headers 2024-08-19 21:03:37 -07:00
Ishaan Jaff
e22195710d feat - allow accessing data post success call 2024-08-19 21:03:37 -07:00
Ishaan Jaff
dd423f9fcc feat run aporia as post call success hook 2024-08-19 21:03:37 -07:00
Krrish Dholakia
cc341ddf35 feat(langfuse_endpoints.py): support team based logging for langfuse pass-through endpoints 2024-08-19 21:03:37 -07:00
Krrish Dholakia
c3b604ca2f feat(langfuse_endpoints.py): support langfuse pass through endpoints by default 2024-08-19 21:03:37 -07:00
Krrish Dholakia
65fb83ed40 fix(proxy_cli.py): support database_host, database_username, database_password, database_name 2024-08-19 21:03:37 -07:00
Ishaan Jaff
6b7a88d350 fix import error guardrails 2024-08-19 20:59:39 -07:00
Ishaan Jaff
c82714757a Merge pull request #5288 from BerriAI/litellm_aporia_refactor
[Feat] V2 aporia guardrails litellm
2024-08-19 20:41:45 -07:00
Ishaan Jaff
cf0d2baee8 fix importing _ENTERPRISE_Aporia 2024-08-19 20:39:24 -07:00
Ishaan Jaff
6aaaa091ef add testing for aporia guardrails 2024-08-19 18:50:14 -07:00
Ishaan Jaff
0920c5ece1 fix aporia typo 2024-08-19 18:34:45 -07:00
Ishaan Jaff
319690ab5e feat - guardrails v2 2024-08-19 18:24:20 -07:00
Krrish Dholakia
a9025280bd feat(langfuse_endpoints.py): support team based logging for langfuse pass-through endpoints 2024-08-19 17:58:39 -07:00
Krrish Dholakia
4b15f5bc83 feat(langfuse_endpoints.py): support langfuse pass through endpoints by default 2024-08-19 17:28:34 -07:00
Krrish Dholakia
727035913b fix(proxy_cli.py): support database_host, database_username, database_password, database_name 2024-08-19 16:17:45 -07:00
Ishaan Jaff
181be05cb5 doc aporia_w_litellm 2024-08-19 14:36:55 -07:00
Krrish Dholakia
d08479b52c feat(azure.py): support dynamic api versions
Closes https://github.com/BerriAI/litellm/issues/5228
2024-08-19 12:17:43 -07:00
Ishaan Jaff
249df0a78e run during_call_hook 2024-08-19 12:07:46 -07:00
Ishaan Jaff
f16e0472c2 feat - return applied guardrails in response headers 2024-08-19 11:56:20 -07:00
Ishaan Jaff
b4bca8db82 feat - allow accessing data post success call 2024-08-19 11:35:33 -07:00
Ishaan Jaff
6af497e383 feat run aporia as post call success hook 2024-08-19 11:25:31 -07:00
Krrish Dholakia
5e8a2ced04 fix(user_api_key_auth.py): log requester ip address to logs on request rejection
Closes https://github.com/BerriAI/litellm/issues/5220
2024-08-19 11:03:58 -07:00
Krrish Dholakia
0d82089136 test(test_caching.py): re-introduce testing for s3 cache w/ streaming
Closes https://github.com/BerriAI/litellm/issues/3268
2024-08-19 10:56:48 -07:00
Krrish Dholakia
c0b7f56fc2 fix(ollama_chat.py): fix sync tool calling
Fixes https://github.com/BerriAI/litellm/issues/5245
2024-08-19 08:31:46 -07:00
Ishaan Jaff
94e74b9ede inly write model tpm/rpm tracking when user set it 2024-08-18 09:58:09 -07:00
Krish Dholakia
db30aa6382 Merge pull request #5264 from BerriAI/litellm_bedrock_pass_through
feat: Bedrock pass-through endpoint support (All endpoints)
2024-08-18 09:55:22 -07:00
Krrish Dholakia
c5d1899940 feat(Support-pass-through-for-bedrock-endpoints): Allows pass-through support for bedrock endpoints 2024-08-17 17:57:43 -07:00
Ishaan Jaff
888afa2d08 Merge pull request #5263 from BerriAI/litellm_support_access_groups
[Feat-Proxy] Use model access groups for teams
2024-08-17 17:11:11 -07:00
Krrish Dholakia
1856ac585d feat(pass_through_endpoints.py): add pass-through support for all cohere endpoints 2024-08-17 16:57:55 -07:00
Ishaan Jaff
7171efc729 use model access groups for teams 2024-08-17 16:45:53 -07:00
Ishaan Jaff
ec671b491d fix proxy all models test 2024-08-17 15:54:51 -07:00
Ishaan Jaff
a2178c026b update tpm / rpm limit per model 2024-08-17 15:26:12 -07:00
Krrish Dholakia
5dc52aedc9 style(vertex_httpx.py): make vertex error string more helpful 2024-08-17 15:09:55 -07:00
Ishaan Jaff
7854652696 Merge pull request #5261 from BerriAI/litellm_set_model_rpm_tpm_limit
[Feat-Proxy] set rpm/tpm limits per api key per model
2024-08-17 14:30:54 -07:00
Krish Dholakia
5e6700f985 Merge pull request #5260 from BerriAI/google_ai_studio_pass_through
Pass-through endpoints for Gemini - Google AI Studio
2024-08-17 13:51:51 -07:00
Ishaan Jaff
2c5f5996f3 add tpm limits per api key per model 2024-08-17 13:20:55 -07:00