Krrish Dholakia
def648ed3f
fix(proxy_server.py): allow passing in a list of team members
...
allows batch adding members to a team by passing in a list. fixes concurrency issue caused by calling team/member_add in parallel
2024-06-08 19:03:45 -07:00
Krrish Dholakia
5c4abcbdb4
fix(proxy_server.py): fix team member delete endpoint
...
fixes issue in for loop, removing member from team
2024-06-08 16:27:33 -07:00
Krrish Dholakia
79287a7584
feat(scheduler.py): add request prioritization scheduler
...
allow user to set priority for a request
2024-05-31 18:51:13 -07:00
Ishaan Jaff
6166381579
fix migrate to LitellmUserRoles
2024-05-30 13:57:50 -07:00
Krrish Dholakia
95566dc249
fix(proxy_server.py): fix model list returned for /model/info when team has restricted access
2024-05-25 13:21:33 -07:00
Krrish Dholakia
25a2f00db6
fix(proxy_server.py): fix model check for /v1/models endpoint when team has restricted access
2024-05-25 13:02:03 -07:00
Ishaan Jaff
595a2a5b1b
fix test_key_model_list
2024-05-22 20:49:19 -07:00
Ishaan Jaff
20aa84e110
test - team member budgets
2024-05-22 19:19:51 -07:00
Ishaan Jaff
a4cf453ad1
fix - end user rate limiting tests
2024-05-22 16:46:19 -07:00
Ishaan Jaff
4175d00a24
fix - test end user rate limits with master key
2024-05-22 16:23:15 -07:00
Ishaan Jaff
bef10f4b01
test - end user tpm / rpm limiting
2024-05-22 15:42:41 -07:00
Ishaan Jaff
7af7610929
fix - test num callbacks
2024-05-17 22:06:51 -07:00
Krrish Dholakia
e0c1fe91f5
test(test_end_users.py): fix end user test
2024-05-14 22:34:26 -07:00
Krrish Dholakia
54587db402
fix(alerting.py): fix datetime comparison logic
2024-05-14 22:10:09 -07:00
Ishaan Jaff
11d3c86cf1
test /spend/report
2024-05-13 15:26:39 -07:00
Ishaan Jaff
514c5737f8
Merge pull request #3587 from BerriAI/litellm_proxy_use_batch_completions_model_csv
...
[Feat] Use csv values for proxy batch completions (OpenAI Python compatible)
2024-05-13 07:55:12 -07:00
Krrish Dholakia
99e8f0715e
test(test_end_users.py): fix end user region routing test
2024-05-11 22:42:43 -07:00
Ishaan Jaff
d4288b134b
fix - use csv list for batch completions
2024-05-11 14:24:48 -07:00
Ishaan Jaff
e1f94fcbbb
test batch completions on litellm proxy
2024-05-11 13:32:30 -07:00
Ishaan Jaff
414af64343
test - OpenAI client is re-used for Azure, OpenAI
2024-05-10 13:43:19 -07:00
Krrish Dholakia
3d18897d69
feat(router.py): enable filtering model group by 'allowed_model_region'
2024-05-08 22:10:17 -07:00
Krrish Dholakia
f2766fddbf
fix(proxy_server.py): fix /v1/models bug where it would return empty list
...
handle 'all-team-models' being set for a given key
2024-05-07 13:43:15 -07:00
Ishaan Jaff
d94065ca43
fix - num active callbacks
2024-05-06 18:20:27 -07:00
Ishaan Jaff
15b264bd4e
fix num callbacks test
2024-05-06 18:13:15 -07:00
Ishaan Jaff
5368382c03
fix num callbacks test
2024-05-06 18:12:45 -07:00
Ishaan Jaff
562ef2d2e1
fix - add better debugging on num_callbacks test
2024-05-06 13:42:20 -07:00
Ishaan Jaff
31c4f5f811
(ci/cd) add detailed debugging info
2024-05-06 11:40:16 -07:00
Ishaan Jaff
4f8ee64e8a
ci/cd run again
2024-05-06 11:32:14 -07:00
Krrish Dholakia
b014a72f7a
test(test_openai_endpoints.py): change key
2024-05-06 11:19:47 -07:00
Krrish Dholakia
918367cc7b
test: skip hanging test
2024-05-05 00:27:38 -07:00
Ishaan Jaff
2084cfd959
fix - test_check_num_callbacks
2024-05-03 16:41:08 -07:00
Ishaan Jaff
a369867e02
test - num alerts on callbacks
2024-05-03 14:46:44 -07:00
Ishaan Jaff
e5311d35f2
fix test len active callbacks
2024-05-03 14:32:13 -07:00
Ishaan Jaff
e9eead2f25
test - size of callbacks, alerts
2024-05-03 14:22:15 -07:00
Ishaan Jaff
9ba5685722
test active callbacks on proxy
2024-05-03 10:05:06 -07:00
Ishaan Jaff
fe6e465466
test - num callbacks on proxy should not increase
2024-05-03 09:59:59 -07:00
Ishaan Jaff
a1814a3e4c
test - num callbacks on proxy
2024-05-03 09:13:37 -07:00
Krrish Dholakia
b9f5b3c1a0
build(test_keys.py): improve error message for test
2024-05-01 08:22:28 -07:00
Krrish Dholakia
e2eddac406
test(test_ratelimit.py): fix test to send below rpm
2024-04-30 19:35:21 -07:00
Krrish Dholakia
5583197d63
fix(proxy_server.py): fix setting offset-aware datetime
2024-04-25 21:18:32 -07:00
Krrish Dholakia
f54510b6ee
fix(proxy_server.py): fix /config/update/
...
allows updating router config via UI and having the change be propogated across all proxy instances by persisting config changes to the db
2024-04-24 16:42:42 -07:00
Krrish Dholakia
e31eb6a6b2
test(test_openai_endpoints.py): add unit testing for streaming + logprobs on docker image
2024-04-23 19:26:19 -07:00
Krish Dholakia
fcde3ba213
Merge pull request #3192 from BerriAI/litellm_calculate_max_parallel_requests
...
fix(router.py): Make TPM limits concurrency-safe
2024-04-20 13:24:29 -07:00
Ishaan Jaff
f89f8a4157
Merge pull request #3184 from BerriAI/litellm_ui_non_admins_flow
...
[UI] - non admin flow - only Create + Test Key available
2024-04-20 12:40:43 -07:00
Ishaan Jaff
7b24a74e77
test fix - test_key_delete_ui
2024-04-20 12:30:58 -07:00
Krrish Dholakia
1507b23e30
test(test_openai_endpoints.py): make test stricter
2024-04-20 12:11:54 -07:00
Ishaan Jaff
a34f725db7
fix - test keys
2024-04-20 11:43:43 -07:00
Krrish Dholakia
01a1a8f731
fix(caching.py): dual cache async_batch_get_cache fix + testing
...
this fixes a bug in usage-based-routing-v2 which was caused b/c of how the result was being returned from dual cache async_batch_get_cache. it also adds unit testing for that function (and it's sync equivalent)
2024-04-19 15:03:25 -07:00
Krrish Dholakia
2ffd057042
test(test_models.py): ensure only admin can call /health
2024-04-16 18:13:40 -07:00
Krrish Dholakia
70716b3373
fix(proxy_server.py): fix key create logic + add unit tests
2024-04-16 13:08:34 -07:00
