Krish Dholakia
7f47c48b35
LiteLLM Minor Fixes and Improvements (09/10/2024) ( #5618 )
...
* fix(cost_calculator.py): move to debug for noisy warning message on cost calculation error
Fixes https://github.com/BerriAI/litellm/issues/5610
* fix(databricks/cost_calculator.py): Handles model name issues for databricks models
* fix(main.py): fix stream chunk builder for multiple tool calls
Fixes https://github.com/BerriAI/litellm/issues/5591
* fix: correctly set user_alias when passed in
Fixes https://github.com/BerriAI/litellm/issues/5612
* fix(types/utils.py): allow passing role for message object
https://github.com/BerriAI/litellm/issues/5621
* fix(litellm_logging.py): Fix langfuse logging across multiple projects
Fixes issue where langfuse logger was re-using the old logging object
* feat(proxy/_types.py): support adding key-based tags for tag-based routing
Enable tag based routing at key-level
* fix(proxy/_types.py): fix inheritance
* test(test_key_generate_prisma.py): fix test
* test: fix test
* fix(litellm_logging.py): return used callback object
2024-09-11 11:30:29 -07:00
Ishaan Jaff
b3629ebdc5
allow passing expiry time to /key/regenerate
2024-09-06 08:36:34 -07:00
Ishaan Jaff
db9507367f
move prisma test to correct location
2024-09-05 15:50:39 -07:00
Ishaan Jaff
dee88751ed
move folder key gen prisma is in
2024-09-05 15:24:00 -07:00
Ishaan Jaff
04d9398c64
fix tests on viewing spend logs
2024-09-05 13:17:03 -07:00
Ishaan Jaff
0d153a23b0
fix test_call_with_key_over_budget
2024-09-05 13:08:13 -07:00
Ishaan Jaff
7a367bddc4
reset general settings post test
2024-09-03 15:33:22 -07:00
Ishaan Jaff
daaca2760e
add test for admin only routes
2024-09-03 15:26:42 -07:00
Ishaan Jaff
bdffca4f12
add test_team_tags to set / update tags
2024-08-29 13:02:57 -07:00
Ishaan Jaff
d25c8ce31a
def test_get_bearer_token():
...
fix
2024-08-27 22:03:54 -07:00
Ishaan Jaff
dd0d8658e1
update key name when regenerating a key
2024-08-26 18:40:51 -07:00
Ishaan Jaff
d14b1433ee
test test_regenerate_api_key
2024-08-26 18:00:51 -07:00
Ishaan Jaff
5ffee5875c
fix test_master_key_hashing
2024-08-21 17:56:09 -07:00
Ishaan Jaff
50e9d05921
feat control guardrails per API Key
2024-08-20 08:16:28 -07:00
Ishaan Jaff
888afa2d08
Merge pull request #5263 from BerriAI/litellm_support_access_groups
...
[Feat-Proxy] Use model access groups for teams
2024-08-17 17:11:11 -07:00
Ishaan Jaff
b718bf9b0a
feat add model access groups for teams
2024-08-17 17:10:10 -07:00
Ishaan Jaff
77177ff469
fix test update tpm / rpm limits for a key
2024-08-17 16:57:23 -07:00
Ishaan Jaff
2c5f5996f3
add tpm limits per api key per model
2024-08-17 13:20:55 -07:00
Ishaan Jaff
2b79e44fc5
fix internal user tests to pass
2024-08-12 12:11:23 -07:00
Krrish Dholakia
83180c50f7
fix(utils.py): only return non-null default values
2024-08-09 16:34:59 -07:00
Krrish Dholakia
86a3dba1bf
refactor(user_api_key_auth.py): refactor to replace user_id_information list with pydantic user_obj
...
Allows using the 'get_user_object' function in user_api_key_auth, keeping it consistent across jwt-auth and key-auth
2024-08-07 15:33:55 -07:00
Krrish Dholakia
228da08b81
fix: fix tests
2024-08-07 15:02:04 -07:00
Ishaan Jaff
936fa63468
fix test cache_key
2024-08-05 21:09:36 -07:00
Ishaan Jaff
cff124433c
fix cache_key check
2024-08-05 21:04:25 -07:00
Krrish Dholakia
77dbc1e723
test(test_key_generate_prisma.py): cleanup test
2024-08-05 20:29:53 -07:00
Krrish Dholakia
4ba576724c
test: improve debugging for test
2024-08-05 19:41:08 -07:00
Krrish Dholakia
030092e555
test: fix testing
2024-07-31 11:50:03 -07:00
Krrish Dholakia
04a646c321
fix(test_key_generate_prisma.py): pass user_api_key_dict to test call
2024-07-17 08:29:21 -07:00
Ishaan Jaff
cfcfd6da9c
test_custom_api_key_header_name
2024-07-16 16:37:43 -07:00
Ishaan Jaff
411ebf8f85
test updating user role
2024-07-13 13:13:40 -07:00
Ishaan Jaff
59bf9275b2
test expired key raises correct exception
2024-07-12 18:45:01 -07:00
Ishaan Jaff
a7a6567da4
test /threads endpoint
2024-07-09 12:17:42 -07:00
Ishaan Jaff
6327ce339a
test type of budget errors
2024-07-08 12:52:40 -07:00
Ishaan Jaff
6d16a1e20a
fix testing spend_tracking
2024-06-21 16:52:42 -07:00
Ishaan Jaff
bd9b9ad9d5
test_call_with_end_user_over_budget
2024-06-20 21:08:06 -07:00
Ishaan Jaff
74bfac739d
fix test_call_with_end_user_over_budget
2024-06-20 19:54:34 -07:00
Ishaan Jaff
9b913c7aae
test - key test_call_with_key_over_budget_no_cache
2024-06-20 17:30:03 -07:00
Ishaan Jaff
b7c5700b54
fix- refactor proxy place internal user endpoints in sep file
2024-06-15 16:39:06 -07:00
Ishaan Jaff
abb544190a
fix - refactor key endpoints
2024-06-15 14:13:32 -07:00
Ishaan Jaff
9b655c9ef7
use directories for importing new endpoints
2024-06-15 13:35:21 -07:00
Ishaan Jaff
b1599c3f40
refactor spend endpoints
2024-06-15 12:17:33 -07:00
Ishaan Jaff
897f6bc7ea
feat - refactor team endpoints
2024-06-15 11:40:36 -07:00
Ishaan Jaff
b0b9bb9906
test fix _get_bearer_token
2024-06-15 10:51:44 -07:00
Ishaan Jaff
5b6f22b5dd
test fix key gen prisma
2024-06-15 10:49:14 -07:00
Ishaan Jaff
83a7d1e4aa
fix - update team
2024-06-13 17:34:17 -07:00
Ishaan Jaff
206791f166
Merge pull request #4138 from BerriAI/litellm_log_management_endpoint_logs_otel
...
[FEAT] log management endpoint logs to otel
2024-06-11 19:00:13 -07:00
Ishaan Jaff
f9fd962191
fix team endpoints
2024-06-11 18:10:20 -07:00
Krrish Dholakia
2a5a30fa7a
fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
...
standardizes error code for budget exceeded errors to status code 400
2024-06-11 16:10:58 -07:00
Krish Dholakia
b2cc37c971
Merge pull request #4084 from BerriAI/litellm_batch_add_team_members
...
fix(proxy_server.py): allow passing in a list of team members
2024-06-10 20:26:35 -07:00
Ishaan Jaff
185da8fd61
feat - log exceptions to OTEL
2024-06-10 12:34:18 -07:00
