Ishaan Jaff
186db292ae
[Feat] Add Error Handling for /key/list endpoint ( #5787 )
...
* raise error from unsupported param
* add testing for key list endpoint
* add testing for key list error handling
* fix key list test
2024-09-19 17:14:12 -07:00
Ishaan Jaff
8fbe2abb89
[Feat-Proxy] Add upperbound key duration param ( #5727 )
...
* add upperbound key duration param
* use upper bound values when None set
* docs upperbound params
2024-09-16 16:28:36 -07:00
Krish Dholakia
60709a0753
LiteLLM Minor Fixes and Improvements (09/13/2024) ( #5689 )
...
* refactor: cleanup unused variables + fix pyright errors
* feat(health_check.py): Closes https://github.com/BerriAI/litellm/issues/5686
* fix(o1_reasoning.py): add stricter check for o-1 reasoning model
* refactor(mistral/): make it easier to see mistral transformation logic
* fix(openai.py): fix openai o-1 model param mapping
Fixes https://github.com/BerriAI/litellm/issues/5685
* feat(main.py): infer finetuned gemini model from base model
Fixes https://github.com/BerriAI/litellm/issues/5678
* docs(vertex.md): update docs to call finetuned gemini models
* feat(proxy_server.py): allow admin to hide proxy model aliases
Closes https://github.com/BerriAI/litellm/issues/5692
* docs(load_balancing.md): add docs on hiding alias models from proxy config
* fix(base.py): don't raise notimplemented error
* fix(user_api_key_auth.py): fix model max budget check
* fix(router.py): fix elif
* fix(user_api_key_auth.py): don't set team_id to empty str
* fix(team_endpoints.py): fix response type
* test(test_completion.py): handle predibase error
* test(test_proxy_server.py): fix test
* fix(o1_transformation.py): fix max_completion_token mapping
* test(test_image_generation.py): mark flaky test
2024-09-14 10:02:55 -07:00
Krish Dholakia
0295a22561
LiteLLM Minor Fixes and Improvements (09/10/2024) ( #5618 )
...
* fix(cost_calculator.py): move to debug for noisy warning message on cost calculation error
Fixes https://github.com/BerriAI/litellm/issues/5610
* fix(databricks/cost_calculator.py): Handles model name issues for databricks models
* fix(main.py): fix stream chunk builder for multiple tool calls
Fixes https://github.com/BerriAI/litellm/issues/5591
* fix: correctly set user_alias when passed in
Fixes https://github.com/BerriAI/litellm/issues/5612
* fix(types/utils.py): allow passing role for message object
https://github.com/BerriAI/litellm/issues/5621
* fix(litellm_logging.py): Fix langfuse logging across multiple projects
Fixes issue where langfuse logger was re-using the old logging object
* feat(proxy/_types.py): support adding key-based tags for tag-based routing
Enable tag based routing at key-level
* fix(proxy/_types.py): fix inheritance
* test(test_key_generate_prisma.py): fix test
* test: fix test
* fix(litellm_logging.py): return used callback object
2024-09-11 11:30:29 -07:00
Ishaan Jaff
aed59abe35
allow passing expiry time to /key/regenerate
2024-09-06 08:36:34 -07:00
Ishaan Jaff
18f019f87d
move prisma test to correct location
2024-09-05 15:50:39 -07:00
Ishaan Jaff
3d9049df6d
move folder key gen prisma is in
2024-09-05 15:24:00 -07:00
Ishaan Jaff
48cf7ac52f
fix tests on viewing spend logs
2024-09-05 13:17:03 -07:00
Ishaan Jaff
8d9a724400
fix test_call_with_key_over_budget
2024-09-05 13:08:13 -07:00
Ishaan Jaff
dbe1879707
reset general settings post test
2024-09-03 15:33:22 -07:00
Ishaan Jaff
45e89f977a
add test for admin only routes
2024-09-03 15:26:42 -07:00
Ishaan Jaff
d2ddc5aba9
add test_team_tags to set / update tags
2024-08-29 13:02:57 -07:00
Ishaan Jaff
3d71e2228f
def test_get_bearer_token():
...
fix
2024-08-27 22:03:54 -07:00
Ishaan Jaff
4dc2eea58d
update key name when regenerating a key
2024-08-26 18:40:51 -07:00
Ishaan Jaff
6b8bb69af3
test test_regenerate_api_key
2024-08-26 18:00:51 -07:00
Ishaan Jaff
f0f1d50734
fix test_master_key_hashing
2024-08-21 17:56:09 -07:00
Ishaan Jaff
30e985d79c
feat control guardrails per API Key
2024-08-20 08:16:28 -07:00
Ishaan Jaff
83515e88ce
Merge pull request #5263 from BerriAI/litellm_support_access_groups
...
[Feat-Proxy] Use model access groups for teams
2024-08-17 17:11:11 -07:00
Ishaan Jaff
6fee350938
feat add model access groups for teams
2024-08-17 17:10:10 -07:00
Ishaan Jaff
9b239111f4
fix test update tpm / rpm limits for a key
2024-08-17 16:57:23 -07:00
Ishaan Jaff
68b54bed85
add tpm limits per api key per model
2024-08-17 13:20:55 -07:00
Ishaan Jaff
1c71e4db17
fix internal user tests to pass
2024-08-12 12:11:23 -07:00
Krrish Dholakia
9f0a05d406
fix(utils.py): only return non-null default values
2024-08-09 16:34:59 -07:00
Krrish Dholakia
f76261af35
refactor(user_api_key_auth.py): refactor to replace user_id_information list with pydantic user_obj
...
Allows using the 'get_user_object' function in user_api_key_auth, keeping it consistent across jwt-auth and key-auth
2024-08-07 15:33:55 -07:00
Krrish Dholakia
ff373663a3
fix: fix tests
2024-08-07 15:02:04 -07:00
Ishaan Jaff
0bf4554b80
fix test cache_key
2024-08-05 21:09:36 -07:00
Ishaan Jaff
5425861a54
fix cache_key check
2024-08-05 21:04:25 -07:00
Krrish Dholakia
e9df81ac19
test(test_key_generate_prisma.py): cleanup test
2024-08-05 20:29:53 -07:00
Krrish Dholakia
5c6dcd6029
test: improve debugging for test
2024-08-05 19:41:08 -07:00
Krrish Dholakia
6974b45c75
test: fix testing
2024-07-31 11:50:03 -07:00
Krrish Dholakia
e7f8ee2aba
fix(test_key_generate_prisma.py): pass user_api_key_dict to test call
2024-07-17 08:29:21 -07:00
Ishaan Jaff
824256c50b
test_custom_api_key_header_name
2024-07-16 16:37:43 -07:00
Ishaan Jaff
56b69eba18
test updating user role
2024-07-13 13:13:40 -07:00
Ishaan Jaff
7918f41aca
test expired key raises correct exception
2024-07-12 18:45:01 -07:00
Ishaan Jaff
e9b14a56d2
test /threads endpoint
2024-07-09 12:17:42 -07:00
Ishaan Jaff
2cc70ddfd7
test type of budget errors
2024-07-08 12:52:40 -07:00
Ishaan Jaff
fff928b10b
fix testing spend_tracking
2024-06-21 16:52:42 -07:00
Ishaan Jaff
f2677620fd
test_call_with_end_user_over_budget
2024-06-20 21:08:06 -07:00
Ishaan Jaff
1db25d5b6a
fix test_call_with_end_user_over_budget
2024-06-20 19:54:34 -07:00
Ishaan Jaff
76145a94fb
test - key test_call_with_key_over_budget_no_cache
2024-06-20 17:30:03 -07:00
Ishaan Jaff
b718e7ec79
fix- refactor proxy place internal user endpoints in sep file
2024-06-15 16:39:06 -07:00
Ishaan Jaff
0f8237e263
fix - refactor key endpoints
2024-06-15 14:13:32 -07:00
Ishaan Jaff
349724a630
use directories for importing new endpoints
2024-06-15 13:35:21 -07:00
Ishaan Jaff
b4057dc022
refactor spend endpoints
2024-06-15 12:17:33 -07:00
Ishaan Jaff
f2570fdf00
feat - refactor team endpoints
2024-06-15 11:40:36 -07:00
Ishaan Jaff
94aa6ec543
test fix _get_bearer_token
2024-06-15 10:51:44 -07:00
Ishaan Jaff
5cb8c0557e
test fix key gen prisma
2024-06-15 10:49:14 -07:00
Ishaan Jaff
6add69a819
fix - update team
2024-06-13 17:34:17 -07:00
Ishaan Jaff
6d2134ad2a
Merge pull request #4138 from BerriAI/litellm_log_management_endpoint_logs_otel
...
[FEAT] log management endpoint logs to otel
2024-06-11 19:00:13 -07:00
Ishaan Jaff
fba7d2e623
fix team endpoints
2024-06-11 18:10:20 -07:00
