Ishaan Jaff
595a2a5b1b
fix test_key_model_list
2024-05-22 20:49:19 -07:00
Ishaan Jaff
20aa84e110
test - team member budgets
2024-05-22 19:19:51 -07:00
Ishaan Jaff
a4cf453ad1
fix - end user rate limiting tests
2024-05-22 16:46:19 -07:00
Ishaan Jaff
4175d00a24
fix - test end user rate limits with master key
2024-05-22 16:23:15 -07:00
Ishaan Jaff
bef10f4b01
test - end user tpm / rpm limiting
2024-05-22 15:42:41 -07:00
Ishaan Jaff
7af7610929
fix - test num callbacks
2024-05-17 22:06:51 -07:00
Krrish Dholakia
e0c1fe91f5
test(test_end_users.py): fix end user test
2024-05-14 22:34:26 -07:00
Krrish Dholakia
54587db402
fix(alerting.py): fix datetime comparison logic
2024-05-14 22:10:09 -07:00
Ishaan Jaff
11d3c86cf1
test /spend/report
2024-05-13 15:26:39 -07:00
Ishaan Jaff
514c5737f8
Merge pull request #3587 from BerriAI/litellm_proxy_use_batch_completions_model_csv
...
[Feat] Use csv values for proxy batch completions (OpenAI Python compatible)
2024-05-13 07:55:12 -07:00
Krrish Dholakia
99e8f0715e
test(test_end_users.py): fix end user region routing test
2024-05-11 22:42:43 -07:00
Ishaan Jaff
d4288b134b
fix - use csv list for batch completions
2024-05-11 14:24:48 -07:00
Ishaan Jaff
e1f94fcbbb
test batch completions on litellm proxy
2024-05-11 13:32:30 -07:00
Ishaan Jaff
414af64343
test - OpenAI client is re-used for Azure, OpenAI
2024-05-10 13:43:19 -07:00
Krrish Dholakia
3d18897d69
feat(router.py): enable filtering model group by 'allowed_model_region'
2024-05-08 22:10:17 -07:00
Krrish Dholakia
f2766fddbf
fix(proxy_server.py): fix /v1/models
bug where it would return empty list
...
handle 'all-team-models' being set for a given key
2024-05-07 13:43:15 -07:00
Ishaan Jaff
d94065ca43
fix - num active callbacks
2024-05-06 18:20:27 -07:00
Ishaan Jaff
15b264bd4e
fix num callbacks test
2024-05-06 18:13:15 -07:00
Ishaan Jaff
5368382c03
fix num callbacks test
2024-05-06 18:12:45 -07:00
Ishaan Jaff
562ef2d2e1
fix - add better debugging on num_callbacks test
2024-05-06 13:42:20 -07:00
Ishaan Jaff
31c4f5f811
(ci/cd) add detailed debugging info
2024-05-06 11:40:16 -07:00
Ishaan Jaff
4f8ee64e8a
ci/cd run again
2024-05-06 11:32:14 -07:00
Krrish Dholakia
b014a72f7a
test(test_openai_endpoints.py): change key
2024-05-06 11:19:47 -07:00
Krrish Dholakia
918367cc7b
test: skip hanging test
2024-05-05 00:27:38 -07:00
Ishaan Jaff
2084cfd959
fix - test_check_num_callbacks
2024-05-03 16:41:08 -07:00
Ishaan Jaff
a369867e02
test - num alerts on callbacks
2024-05-03 14:46:44 -07:00
Ishaan Jaff
e5311d35f2
fix test len active callbacks
2024-05-03 14:32:13 -07:00
Ishaan Jaff
e9eead2f25
test - size of callbacks, alerts
2024-05-03 14:22:15 -07:00
Ishaan Jaff
9ba5685722
test active callbacks on proxy
2024-05-03 10:05:06 -07:00
Ishaan Jaff
fe6e465466
test - num callbacks on proxy should not increase
2024-05-03 09:59:59 -07:00
Ishaan Jaff
a1814a3e4c
test - num callbacks on proxy
2024-05-03 09:13:37 -07:00
Krrish Dholakia
b9f5b3c1a0
build(test_keys.py): improve error message for test
2024-05-01 08:22:28 -07:00
Krrish Dholakia
e2eddac406
test(test_ratelimit.py): fix test to send below rpm
2024-04-30 19:35:21 -07:00
Krrish Dholakia
5583197d63
fix(proxy_server.py): fix setting offset-aware datetime
2024-04-25 21:18:32 -07:00
Krrish Dholakia
f54510b6ee
fix(proxy_server.py): fix /config/update
/
...
allows updating router config via UI and having the change be propogated across all proxy instances by persisting config changes to the db
2024-04-24 16:42:42 -07:00
Krrish Dholakia
e31eb6a6b2
test(test_openai_endpoints.py): add unit testing for streaming + logprobs on docker image
2024-04-23 19:26:19 -07:00
Krish Dholakia
fcde3ba213
Merge pull request #3192 from BerriAI/litellm_calculate_max_parallel_requests
...
fix(router.py): Make TPM limits concurrency-safe
2024-04-20 13:24:29 -07:00
Ishaan Jaff
f89f8a4157
Merge pull request #3184 from BerriAI/litellm_ui_non_admins_flow
...
[UI] - non admin flow - only Create + Test Key available
2024-04-20 12:40:43 -07:00
Ishaan Jaff
7b24a74e77
test fix - test_key_delete_ui
2024-04-20 12:30:58 -07:00
Krrish Dholakia
1507b23e30
test(test_openai_endpoints.py): make test stricter
2024-04-20 12:11:54 -07:00
Ishaan Jaff
a34f725db7
fix - test keys
2024-04-20 11:43:43 -07:00
Krrish Dholakia
01a1a8f731
fix(caching.py): dual cache async_batch_get_cache fix + testing
...
this fixes a bug in usage-based-routing-v2 which was caused b/c of how the result was being returned from dual cache async_batch_get_cache. it also adds unit testing for that function (and it's sync equivalent)
2024-04-19 15:03:25 -07:00
Krrish Dholakia
2ffd057042
test(test_models.py): ensure only admin can call /health
2024-04-16 18:13:40 -07:00
Krrish Dholakia
70716b3373
fix(proxy_server.py): fix key create logic + add unit tests
2024-04-16 13:08:34 -07:00
Krrish Dholakia
3f8abe2754
fix(proxy_server.py): secure /team/info
endpoint
...
make sure user requesting team info is part of team or admin
2024-04-16 11:40:08 -07:00
Ishaan Jaff
b27e1f5c5c
test - setting up langfuse callback on proxy
2024-04-16 08:45:51 -07:00
Krrish Dholakia
2d4fe072ad
fix(proxy_server.py): fix delete models endpoint
...
https://github.com/BerriAI/litellm/issues/2951
2024-04-15 18:34:58 -07:00
Ishaan Jaff
756966c8be
Merge pull request #3047 from BerriAI/litellm_fix_key_delete_bug
...
[Fix + Test] key delete bug
2024-04-15 17:38:25 -07:00
Krrish Dholakia
f9a9556f6c
test(test_models.py): assert model id in db is the model id passed in
2024-04-15 17:37:45 -07:00
Ishaan Jaff
e20d3f29b0
test - delete keys
2024-04-15 16:37:20 -07:00