Ishaan Jaff
|
83e8f99ecf
|
add example using litellm proxy with gemini context caching
|
2024-08-08 19:20:18 -07:00 |
|
Krrish Dholakia
|
c91382a310
|
fix(anthropic.py): fix translation from /v1/messages format to openai format
|
2024-08-08 19:19:58 -07:00 |
|
Krrish Dholakia
|
8a0cb413ff
|
fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
|
2024-08-08 19:19:52 -07:00 |
|
Krrish Dholakia
|
766f712555
|
fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111
|
2024-08-08 19:19:11 -07:00 |
|
Krrish Dholakia
|
856ede4a05
|
test(test_proxy_server.py): unit testing to make sure internal user params don't impact admin
|
2024-08-08 17:59:30 -07:00 |
|
Krrish Dholakia
|
c919c15c4a
|
fix(proxy_server.py): ensure internal_user params only apply to internal_user role
|
2024-08-08 17:50:29 -07:00 |
|
Krrish Dholakia
|
488a78e5f4
|
fix(proxy_server.py): respect internal_user_budget_duration for sso user
|
2024-08-08 17:28:28 -07:00 |
|
Ishaan Jaff
|
a37b6f5edf
|
add default_vertex_config
|
2024-08-08 17:19:12 -07:00 |
|
Ishaan Jaff
|
ad79f6447f
|
docs cachedContent endpoint
|
2024-08-08 17:19:12 -07:00 |
|
Ishaan Jaff
|
7aacc4cf56
|
add native cachedContents endpoint
|
2024-08-08 17:19:12 -07:00 |
|
Ishaan Jaff
|
d58713e47b
|
add example using litellm proxy with gemini context caching
|
2024-08-08 17:19:12 -07:00 |
|
Krrish Dholakia
|
384f8f4f54
|
fix(anthropic.py): fix translation from /v1/messages format to openai format
|
2024-08-08 17:19:12 -07:00 |
|
Krrish Dholakia
|
6266937c75
|
fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
|
2024-08-08 17:19:05 -07:00 |
|
Krrish Dholakia
|
43b1bf692d
|
fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111
|
2024-08-08 17:18:59 -07:00 |
|
Krrish Dholakia
|
eb292e0b31
|
feat: set max_internal_budget for user w/ sso
|
2024-08-08 12:44:07 -07:00 |
|
Krrish Dholakia
|
dc35ddd88e
|
build: ui - update to include max budget per team
|
2024-08-08 09:09:23 -07:00 |
|
Krish Dholakia
|
7d28b6ebc3
|
Merge branch 'main' into litellm_personal_user_budgets
|
2024-08-07 19:59:50 -07:00 |
|
Krrish Dholakia
|
182d63853b
|
fix: use more descriptive flag
|
2024-08-07 18:59:46 -07:00 |
|
Krrish Dholakia
|
e60b2d9258
|
fix(internal_user_endpoints.py): respect 'max_user_budget' for new internal user's
|
2024-08-07 18:50:40 -07:00 |
|
Krrish Dholakia
|
86a3dba1bf
|
refactor(user_api_key_auth.py): refactor to replace user_id_information list with pydantic user_obj
Allows using the 'get_user_object' function in user_api_key_auth, keeping it consistent across jwt-auth and key-auth
|
2024-08-07 15:33:55 -07:00 |
|
Krrish Dholakia
|
228da08b81
|
fix: fix tests
|
2024-08-07 15:02:04 -07:00 |
|
Ishaan Jaff
|
322258a1fa
|
Merge pull request #5098 from BerriAI/litellm_provider_wildcard_routing
[Feat-Router + Proxy] Add provider wildcard routing
|
2024-08-07 14:51:42 -07:00 |
|
Ishaan Jaff
|
31e4fca748
|
fix use provider specific routing
|
2024-08-07 14:37:20 -07:00 |
|
Krrish Dholakia
|
57a730095c
|
fix(user_api_key_auth.py): respect team budgets over user budget, if key belongs to team
Closes https://github.com/BerriAI/litellm/issues/5097
|
2024-08-07 14:32:27 -07:00 |
|
Ishaan Jaff
|
25e6733da3
|
support provider wildcard routing
|
2024-08-07 14:20:22 -07:00 |
|
Krish Dholakia
|
77a33baabb
|
Merge branch 'main' into litellm_add_pydantic_model_support
|
2024-08-07 13:07:46 -07:00 |
|
Krrish Dholakia
|
0de640700d
|
fix(router.py): add reason for fallback failure to client-side exception string
make it easier to debug why a fallback failed to occur
|
2024-08-07 13:02:47 -07:00 |
|
Ishaan Jaff
|
426dcc9275
|
emit deployment_partial_outage on prometheus
|
2024-08-07 09:56:01 -07:00 |
|
Krish Dholakia
|
0044fd0041
|
Merge branch 'main' into litellm_support_lakera_config_thresholds
|
2024-08-06 22:47:13 -07:00 |
|
Ishaan Jaff
|
5eabef4318
|
fix pass through endpoint tests
|
2024-08-06 21:16:07 -07:00 |
|
Ishaan Jaff
|
7bcb088ac0
|
clean up unused func
|
2024-08-06 20:58:51 -07:00 |
|
Krrish Dholakia
|
8b028d41aa
|
feat(utils.py): support validating json schema client-side if user opts in
|
2024-08-06 19:35:33 -07:00 |
|
Ishaan Jaff
|
22ca6d6d30
|
fix forward ui requests when base url set
|
2024-08-06 18:10:34 -07:00 |
|
Ishaan Jaff
|
e207ac577e
|
add redirect_ui_middleware
|
2024-08-06 18:01:23 -07:00 |
|
Ishaan Jaff
|
53451834bd
|
Merge pull request #5077 from BerriAI/litellm_fix_ui_emails
[Fix] Fix testing emails through Admin UI
|
2024-08-06 16:41:01 -07:00 |
|
Krrish Dholakia
|
ca87ad5378
|
fix(lakera_ai.py): fix hardcoded prompt_injection string in lakera integration
|
2024-08-06 16:12:54 -07:00 |
|
Ishaan Jaff
|
7fbd0855b6
|
update alerting settings on ui
|
2024-08-06 16:05:33 -07:00 |
|
Ishaan Jaff
|
00832bb8f2
|
fix email health checks
|
2024-08-06 15:59:26 -07:00 |
|
Ishaan Jaff
|
6a46899521
|
add debug statements on docker
|
2024-08-06 15:29:49 -07:00 |
|
Krrish Dholakia
|
b4ffa4e43c
|
feat(lakera_ai.py): support lakera custom thresholds + custom api base
Allows user to configure thresholds to trigger prompt injection rejections
|
2024-08-06 15:21:45 -07:00 |
|
Krish Dholakia
|
78f1ad7e35
|
Merge pull request #5071 from BerriAI/litellm_auth_restricted_domains
feat(proxy_server.py): allow restricting allowed email domains for UI
|
2024-08-06 14:18:57 -07:00 |
|
Krrish Dholakia
|
5ffadd631d
|
feat(proxy_server.py): allow restricting allowed email domains for the UI
|
2024-08-06 12:53:03 -07:00 |
|
Ishaan Jaff
|
662a9b1d7e
|
Merge pull request #5062 from BerriAI/litellm_forward_headers
[Fix-Proxy] allow forwarding headers from request
|
2024-08-06 12:34:25 -07:00 |
|
Krrish Dholakia
|
2ec7cb4153
|
fix(utils.py): fix types
|
2024-08-06 12:23:22 -07:00 |
|
Ishaan Jaff
|
32e531eb07
|
init pass through endpoints
|
2024-08-06 12:04:04 -07:00 |
|
Krrish Dholakia
|
ff28823025
|
fix(encrypt_decrypt_utils.py): add helper line, explaining why there might be a key decryption error
|
2024-08-06 11:35:40 -07:00 |
|
Ishaan Jaff
|
4656f7981d
|
use helper to forward headers from request
|
2024-08-06 11:34:10 -07:00 |
|
Ishaan Jaff
|
d3d13e40be
|
use prints
|
2024-08-06 11:07:12 -07:00 |
|
Krish Dholakia
|
350e4b3830
|
Merge pull request #5057 from BerriAI/litellm_rds_iam_auth
feat(proxy_cli.py): support iam-based auth to rds
|
2024-08-06 10:44:33 -07:00 |
|
Krrish Dholakia
|
3a3381387f
|
feat(utils.py): check env var for api base for openai-compatible endpoints
Closes https://github.com/BerriAI/litellm/issues/5066
|
2024-08-06 08:32:44 -07:00 |
|