Ishaan Jaff
7f461dbf68
fix linting
2024-09-06 16:54:43 -07:00
Ishaan Jaff
aed59abe35
allow passing expiry time to /key/regenerate
2024-09-06 08:36:34 -07:00
Ishaan Jaff
c40f6f0437
fix on /user/info show all keys - even expired ones
2024-09-05 15:31:41 -07:00
Krish Dholakia
fa2d9002b5
security - Prevent sql injection in /team/update query ( #5513 )
...
* fix(team_endpoints.py): replace `.get_data()` usage with prisma interface
Prevent sql injection in `/team/update` query
Fixes https://huntr.com/bounties/a4f6d357-5b44-4e00-9cac-f1cc351211d2
* fix(vertex_ai_non_gemini.py): handle message being a pydantic model
2024-09-04 16:03:02 -07:00
Krish Dholakia
be3c7b401e
LiteLLM Minor fixes + improvements (08/03/2024) ( #5488 )
...
* fix(internal_user_endpoints.py): set budget_reset_at for /user/update
* fix(vertex_and_google_ai_studio_gemini.py): handle accumulated json
Fixes https://github.com/BerriAI/litellm/issues/5479
* fix(vertex_ai_and_gemini.py): fix assistant message function call when content is not None
Fixes https://github.com/BerriAI/litellm/issues/5490
* fix(proxy_server.py): generic state uuid for okta sso
* fix(lago.py): improve debug logs
Debugging for https://github.com/BerriAI/litellm/issues/5477
* docs(bedrock.md): add bedrock cross-region inferencing to docs
* fix(azure.py): return azure response headers on aembedding call
* feat(azure.py): return azure response headers for `/audio/transcription`
* fix(types/utils.py): standardize deepseek / anthropic prompt caching usage information
Closes https://github.com/BerriAI/litellm/issues/5285
* docs(usage.md): add docs on litellm usage object
* test(test_completion.py): mark flaky test
2024-09-03 21:21:34 -07:00
Krish Dholakia
f9e6507cd1
LiteLLM Minor Fixes + Improvements ( #5474 )
...
* feat(proxy/_types.py): add lago billing to callbacks ui
Closes https://github.com/BerriAI/litellm/issues/5472
* fix(anthropic.py): return anthropic prompt caching information
Fixes https://github.com/BerriAI/litellm/issues/5364
* feat(bedrock/chat.py): support 'json_schema' for bedrock models
Closes https://github.com/BerriAI/litellm/issues/5434
* fix(bedrock/embed/embeddings.py): support async embeddings for amazon titan models
* fix: linting fixes
* fix: handle key errors
* fix(bedrock/chat.py): fix bedrock ai21 streaming object
* feat(bedrock/embed): support bedrock embedding optional params
* fix(databricks.py): fix usage chunk
* fix(internal_user_endpoints.py): apply internal user defaults, if user role updated
Fixes issue where user update wouldn't apply defaults
* feat(slack_alerting.py): provide multiple slack channels for a given alert type
multiple channels might be interested in receiving an alert for a given type
* docs(alerting.md): add multiple channel alerting to docs
2024-09-02 14:29:57 -07:00
Ishaan Jaff
ffeb5ce22a
add set / update tags for a team
2024-08-29 13:05:00 -07:00
Krish Dholakia
8ae0fc693f
Merge pull request #5414 from BerriAI/litellm_main_staging
...
fixes: minor litellm fixes
2024-08-28 22:01:01 -07:00
Krrish Dholakia
2119030738
fix(team_endpoints.py): update to include the budget in the response
2024-08-28 21:58:41 -07:00
Krrish Dholakia
18689c25e9
feat(team_endpoints.py): return team member budgets in /team/info call
...
Fixes https://github.com/BerriAI/litellm/issues/5390
2024-08-28 19:14:01 -07:00
Krrish Dholakia
325538f8a4
fix(key_management_endpoints.py): expose 'key' param, for setting your own key value
2024-08-28 12:27:32 -07:00
Ishaan Jaff
75cbbea071
enforce regenerating keys in enterprise tier
2024-08-26 18:54:50 -07:00
Ishaan Jaff
4dc2eea58d
update key name when regenerating a key
2024-08-26 18:40:51 -07:00
Ishaan Jaff
2615edc468
allow using hashed api keys on regen key
2024-08-26 18:15:52 -07:00
Ishaan Jaff
7230ee1f55
add regenerate_key_fn
2024-08-26 17:59:44 -07:00
Ishaan Jaff
20840eaad3
fix linting errors when adding a new team member
2024-08-24 16:38:43 -07:00
Krrish Dholakia
8782ee444d
feat(team_endpoints.py): expose 2 new fields - updated_users and updated_team_memberships, on /team/member_add
...
Fixes https://github.com/BerriAI/litellm/issues/5345#issuecomment-2307863265
Helps user see the stored budget per team member
2024-08-24 09:22:16 -07:00
Ishaan Jaff
374bef4326
fix /user/delete doc string
2024-08-22 09:09:51 -07:00
Ishaan Jaff
03c65c889a
fix team_member_add
2024-08-21 19:10:37 -07:00
Krrish Dholakia
83bed56b66
fix(internal_user_endpoints.py): pass in user api key dict value
2024-08-21 12:46:43 -07:00
Krrish Dholakia
5ba517819c
test(test_proxy_server.py): fix test to specify user role
2024-08-21 08:37:04 -07:00
Krrish Dholakia
a61f3e7656
refactor(team_endpoints.py): refactor auth checks for team member endpoints to ui team admin to manage it
2024-08-20 16:57:18 -07:00
Krrish Dholakia
fa6c9bf42e
feat(user_api_key_auth.py): allow team admin to add new members to team
2024-08-20 14:01:12 -07:00
Ishaan Jaff
30e985d79c
feat control guardrails per API Key
2024-08-20 08:16:28 -07:00
Ishaan Jaff
b83fa87880
update tpm / rpm limit per model
2024-08-17 15:26:12 -07:00
Ishaan Jaff
68b54bed85
add tpm limits per api key per model
2024-08-17 13:20:55 -07:00
Krrish Dholakia
d1d28487f7
refactor(test_users.py): refactor test for user info to use mock endpoints
2024-08-12 18:48:43 -07:00
Ishaan Jaff
12f9894d69
Merge pull request #5168 from BerriAI/litellm_use_user_api_key_auth_int_usr_endpoints
...
[Feat Proxy] Send slack alert on CRUD endpoints for Internal Users
2024-08-12 12:20:16 -07:00
Ishaan Jaff
1c71e4db17
fix internal user tests to pass
2024-08-12 12:11:23 -07:00
Ishaan Jaff
f6896aaaf7
fix doc string for team endpoints
2024-08-12 11:54:28 -07:00
Ishaan Jaff
47953aaa96
use management_endpoint_wrapper for key endpoints
2024-08-12 11:02:21 -07:00
Krrish Dholakia
575afa8029
fix(internal_user_endpoints.py): return all teams if user is admin
2024-08-10 16:36:43 -07:00
Krrish Dholakia
7b6db63d30
fix(router.py): fallback on 400-status code requests
2024-08-09 12:16:49 -07:00
Krrish Dholakia
1d39c0fb7d
fix(management_helpers/utils.py): use user_default max_budget, budget duration on new user upsert during team member add
...
Fixes https://github.com/BerriAI/litellm/issues/5106
2024-08-08 19:14:43 -07:00
Krrish Dholakia
6af9d9d2b3
test(test_proxy_server.py): unit testing to make sure internal user params don't impact admin
2024-08-08 17:59:30 -07:00
Krrish Dholakia
2776d9cb0d
fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
...
Relevant to - https://github.com/BerriAI/litellm/issues/5106
2024-08-08 17:19:05 -07:00
Krrish Dholakia
ec0b511119
fix: use more descriptive flag
2024-08-07 18:59:46 -07:00
Krrish Dholakia
b7e31638fd
fix(internal_user_endpoints.py): respect 'max_user_budget' for new internal user's
2024-08-07 18:50:40 -07:00
Krrish Dholakia
1080c7014e
build(ui): allow admin_viewer to view teams tab
...
Allows admin viewe role to see available teams on proxy ui
2024-08-02 16:19:40 -07:00
Krrish Dholakia
142f4fefd0
fix(auth_checks.py): fix redis usage for team cached objects
2024-07-30 17:30:00 -07:00
Krish Dholakia
c2086300b7
Merge branch 'main' into litellm_redis_team_object
2024-07-25 19:31:52 -07:00
Krrish Dholakia
b376ee71b0
fix(internal_user_endpoints.py): support updating budgets for /user/update
2024-07-24 21:51:46 -07:00
Krrish Dholakia
6ab2527fdc
feat(auth_check.py): support using redis cache for team objects
...
Allows team update / check logic to work across instances instantly
2024-07-24 18:14:49 -07:00
Krrish Dholakia
b5c5ed2209
fix(key_management_endpoints.py): if budget duration set, set budget_reset_at
2024-07-24 15:02:22 -07:00
Ishaan Jaff
1a33c40713
add endpoint to disable logging for a team
2024-07-23 08:38:23 -07:00
Krish Dholakia
c4db6aa15e
Merge pull request #4810 from BerriAI/litellm_team_modify_guardrails
...
feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails
2024-07-22 22:32:24 -07:00
Ishaan Jaff
2e5da5ea18
GET endpoint to get team callbacks
2024-07-22 20:46:20 -07:00
Ishaan Jaff
447bab4d46
only allow unique callbacks for team callbacks
2024-07-22 20:43:42 -07:00
Ishaan Jaff
5ed82ba5ce
feat add return types on team/callback
2024-07-22 20:35:27 -07:00
Ishaan Jaff
c34c123fe3
feat - add endpoint to set team callbacks
2024-07-22 18:18:09 -07:00
