Commit graph

150 commits

Author SHA1 Message Date
Ishaan Jaff
595a2a5b1b fix test_key_model_list 2024-05-22 20:49:19 -07:00
Ishaan Jaff
20aa84e110 test - team member budgets 2024-05-22 19:19:51 -07:00
Ishaan Jaff
a4cf453ad1 fix - end user rate limiting tests 2024-05-22 16:46:19 -07:00
Ishaan Jaff
4175d00a24 fix - test end user rate limits with master key 2024-05-22 16:23:15 -07:00
Ishaan Jaff
bef10f4b01 test - end user tpm / rpm limiting 2024-05-22 15:42:41 -07:00
Ishaan Jaff
7af7610929 fix - test num callbacks 2024-05-17 22:06:51 -07:00
Krrish Dholakia
e0c1fe91f5 test(test_end_users.py): fix end user test 2024-05-14 22:34:26 -07:00
Krrish Dholakia
54587db402 fix(alerting.py): fix datetime comparison logic 2024-05-14 22:10:09 -07:00
Ishaan Jaff
11d3c86cf1 test /spend/report 2024-05-13 15:26:39 -07:00
Ishaan Jaff
514c5737f8
Merge pull request #3587 from BerriAI/litellm_proxy_use_batch_completions_model_csv
[Feat] Use csv values for proxy batch completions (OpenAI Python compatible)
2024-05-13 07:55:12 -07:00
Krrish Dholakia
99e8f0715e test(test_end_users.py): fix end user region routing test 2024-05-11 22:42:43 -07:00
Ishaan Jaff
d4288b134b fix - use csv list for batch completions 2024-05-11 14:24:48 -07:00
Ishaan Jaff
e1f94fcbbb test batch completions on litellm proxy 2024-05-11 13:32:30 -07:00
Ishaan Jaff
414af64343 test - OpenAI client is re-used for Azure, OpenAI 2024-05-10 13:43:19 -07:00
Krrish Dholakia
3d18897d69 feat(router.py): enable filtering model group by 'allowed_model_region' 2024-05-08 22:10:17 -07:00
Krrish Dholakia
f2766fddbf fix(proxy_server.py): fix /v1/models bug where it would return empty list
handle 'all-team-models' being set for a given key
2024-05-07 13:43:15 -07:00
Ishaan Jaff
d94065ca43 fix - num active callbacks 2024-05-06 18:20:27 -07:00
Ishaan Jaff
15b264bd4e fix num callbacks test 2024-05-06 18:13:15 -07:00
Ishaan Jaff
5368382c03 fix num callbacks test 2024-05-06 18:12:45 -07:00
Ishaan Jaff
562ef2d2e1 fix - add better debugging on num_callbacks test 2024-05-06 13:42:20 -07:00
Ishaan Jaff
31c4f5f811 (ci/cd) add detailed debugging info 2024-05-06 11:40:16 -07:00
Ishaan Jaff
4f8ee64e8a ci/cd run again 2024-05-06 11:32:14 -07:00
Krrish Dholakia
b014a72f7a test(test_openai_endpoints.py): change key 2024-05-06 11:19:47 -07:00
Krrish Dholakia
918367cc7b test: skip hanging test 2024-05-05 00:27:38 -07:00
Ishaan Jaff
2084cfd959 fix - test_check_num_callbacks 2024-05-03 16:41:08 -07:00
Ishaan Jaff
a369867e02 test - num alerts on callbacks 2024-05-03 14:46:44 -07:00
Ishaan Jaff
e5311d35f2 fix test len active callbacks 2024-05-03 14:32:13 -07:00
Ishaan Jaff
e9eead2f25 test - size of callbacks, alerts 2024-05-03 14:22:15 -07:00
Ishaan Jaff
9ba5685722 test active callbacks on proxy 2024-05-03 10:05:06 -07:00
Ishaan Jaff
fe6e465466 test - num callbacks on proxy should not increase 2024-05-03 09:59:59 -07:00
Ishaan Jaff
a1814a3e4c test - num callbacks on proxy 2024-05-03 09:13:37 -07:00
Krrish Dholakia
b9f5b3c1a0 build(test_keys.py): improve error message for test 2024-05-01 08:22:28 -07:00
Krrish Dholakia
e2eddac406 test(test_ratelimit.py): fix test to send below rpm 2024-04-30 19:35:21 -07:00
Krrish Dholakia
5583197d63 fix(proxy_server.py): fix setting offset-aware datetime 2024-04-25 21:18:32 -07:00
Krrish Dholakia
f54510b6ee fix(proxy_server.py): fix /config/update/
allows updating router config via UI and having the change be propogated across all proxy instances by persisting config changes to the db
2024-04-24 16:42:42 -07:00
Krrish Dholakia
e31eb6a6b2 test(test_openai_endpoints.py): add unit testing for streaming + logprobs on docker image 2024-04-23 19:26:19 -07:00
Krish Dholakia
fcde3ba213
Merge pull request #3192 from BerriAI/litellm_calculate_max_parallel_requests
fix(router.py): Make TPM limits concurrency-safe
2024-04-20 13:24:29 -07:00
Ishaan Jaff
f89f8a4157
Merge pull request #3184 from BerriAI/litellm_ui_non_admins_flow
[UI] - non admin flow - only Create + Test Key available
2024-04-20 12:40:43 -07:00
Ishaan Jaff
7b24a74e77 test fix - test_key_delete_ui 2024-04-20 12:30:58 -07:00
Krrish Dholakia
1507b23e30 test(test_openai_endpoints.py): make test stricter 2024-04-20 12:11:54 -07:00
Ishaan Jaff
a34f725db7 fix - test keys 2024-04-20 11:43:43 -07:00
Krrish Dholakia
01a1a8f731 fix(caching.py): dual cache async_batch_get_cache fix + testing
this fixes a bug in usage-based-routing-v2 which was caused b/c of how the result was being returned from dual cache async_batch_get_cache. it also adds unit testing for that function (and it's sync equivalent)
2024-04-19 15:03:25 -07:00
Krrish Dholakia
2ffd057042 test(test_models.py): ensure only admin can call /health 2024-04-16 18:13:40 -07:00
Krrish Dholakia
70716b3373 fix(proxy_server.py): fix key create logic + add unit tests 2024-04-16 13:08:34 -07:00
Krrish Dholakia
3f8abe2754 fix(proxy_server.py): secure /team/info endpoint
make sure user requesting team info is part of team or admin
2024-04-16 11:40:08 -07:00
Ishaan Jaff
b27e1f5c5c test - setting up langfuse callback on proxy 2024-04-16 08:45:51 -07:00
Krrish Dholakia
2d4fe072ad fix(proxy_server.py): fix delete models endpoint
https://github.com/BerriAI/litellm/issues/2951
2024-04-15 18:34:58 -07:00
Ishaan Jaff
756966c8be
Merge pull request #3047 from BerriAI/litellm_fix_key_delete_bug
[Fix + Test]  key delete bug
2024-04-15 17:38:25 -07:00
Krrish Dholakia
f9a9556f6c test(test_models.py): assert model id in db is the model id passed in 2024-04-15 17:37:45 -07:00
Ishaan Jaff
e20d3f29b0 test - delete keys 2024-04-15 16:37:20 -07:00