phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
18125 commits 1603 branches 645 tags 320 MiB
Commit graph

359 commits

Author SHA1 Message Date
Ishaan Jaff
cb386fda20 test - making mistral embedding request on proxy 2024-06-12 15:10:20 -07:00
Krrish Dholakia
0ab0111d57 test(test_team.py): fix error string asserted 2024-06-11 18:05:20 -07:00
Krrish Dholakia
c27ae34a39 fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors 
standardizes error code for budget exceeded errors to status code 400
 2024-06-11 16:10:58 -07:00
Krrish Dholakia
def648ed3f fix(proxy_server.py): allow passing in a list of team members 
allows batch adding members to a team by passing in a list. fixes concurrency issue caused by calling team/member_add in parallel
 2024-06-08 19:03:45 -07:00
Krrish Dholakia
5c4abcbdb4 fix(proxy_server.py): fix team member delete endpoint 
fixes issue in for loop, removing member from team
 2024-06-08 16:27:33 -07:00
Krrish Dholakia
79287a7584 feat(scheduler.py): add request prioritization scheduler 
allow user to set priority for a request
 2024-05-31 18:51:13 -07:00
Ishaan Jaff
6166381579 fix migrate to LitellmUserRoles 2024-05-30 13:57:50 -07:00
Krrish Dholakia
95566dc249 fix(proxy_server.py): fix model list returned for /model/info when team has restricted access 2024-05-25 13:21:33 -07:00
Krrish Dholakia
25a2f00db6 fix(proxy_server.py): fix model check for /v1/models endpoint when team has restricted access 2024-05-25 13:02:03 -07:00
Ishaan Jaff
595a2a5b1b fix test_key_model_list 2024-05-22 20:49:19 -07:00
Ishaan Jaff
20aa84e110 test - team member budgets 2024-05-22 19:19:51 -07:00
Ishaan Jaff
a4cf453ad1 fix - end user rate limiting tests 2024-05-22 16:46:19 -07:00
Ishaan Jaff
4175d00a24 fix - test end user rate limits with master key 2024-05-22 16:23:15 -07:00
Ishaan Jaff
bef10f4b01 test - end user tpm / rpm limiting 2024-05-22 15:42:41 -07:00
Ishaan Jaff
7af7610929 fix - test num callbacks 2024-05-17 22:06:51 -07:00
Krrish Dholakia
e0c1fe91f5 test(test_end_users.py): fix end user test 2024-05-14 22:34:26 -07:00
Krrish Dholakia
54587db402 fix(alerting.py): fix datetime comparison logic 2024-05-14 22:10:09 -07:00
Ishaan Jaff
11d3c86cf1 test /spend/report 2024-05-13 15:26:39 -07:00
Ishaan Jaff
514c5737f8
Merge pull request #3587 from BerriAI/litellm_proxy_use_batch_completions_model_csv 
[Feat] Use csv values for proxy batch completions (OpenAI Python compatible)
 2024-05-13 07:55:12 -07:00
Krrish Dholakia
99e8f0715e test(test_end_users.py): fix end user region routing test 2024-05-11 22:42:43 -07:00
Ishaan Jaff
d4288b134b fix - use csv list for batch completions 2024-05-11 14:24:48 -07:00
Ishaan Jaff
e1f94fcbbb test batch completions on litellm proxy 2024-05-11 13:32:30 -07:00
Ishaan Jaff
414af64343 test - OpenAI client is re-used for Azure, OpenAI 2024-05-10 13:43:19 -07:00
Krrish Dholakia
3d18897d69 feat(router.py): enable filtering model group by 'allowed_model_region' 2024-05-08 22:10:17 -07:00
Krrish Dholakia
f2766fddbf fix(proxy_server.py): fix /v1/models bug where it would return empty list 
handle 'all-team-models' being set for a given key
 2024-05-07 13:43:15 -07:00
Ishaan Jaff
d94065ca43 fix - num active callbacks 2024-05-06 18:20:27 -07:00
Ishaan Jaff
15b264bd4e fix num callbacks test 2024-05-06 18:13:15 -07:00
Ishaan Jaff
5368382c03 fix num callbacks test 2024-05-06 18:12:45 -07:00
Ishaan Jaff
562ef2d2e1 fix - add better debugging on num_callbacks test 2024-05-06 13:42:20 -07:00
Ishaan Jaff
31c4f5f811 (ci/cd) add detailed debugging info 2024-05-06 11:40:16 -07:00
Ishaan Jaff
4f8ee64e8a ci/cd run again 2024-05-06 11:32:14 -07:00
Krrish Dholakia
b014a72f7a test(test_openai_endpoints.py): change key 2024-05-06 11:19:47 -07:00
Krrish Dholakia
918367cc7b test: skip hanging test 2024-05-05 00:27:38 -07:00
Ishaan Jaff
2084cfd959 fix - test_check_num_callbacks 2024-05-03 16:41:08 -07:00
Ishaan Jaff
a369867e02 test - num alerts on callbacks 2024-05-03 14:46:44 -07:00
Ishaan Jaff
e5311d35f2 fix test len active callbacks 2024-05-03 14:32:13 -07:00
Ishaan Jaff
e9eead2f25 test - size of callbacks, alerts 2024-05-03 14:22:15 -07:00
Ishaan Jaff
9ba5685722 test active callbacks on proxy 2024-05-03 10:05:06 -07:00
Ishaan Jaff
fe6e465466 test - num callbacks on proxy should not increase 2024-05-03 09:59:59 -07:00
Ishaan Jaff
a1814a3e4c test - num callbacks on proxy 2024-05-03 09:13:37 -07:00
Krrish Dholakia
b9f5b3c1a0 build(test_keys.py): improve error message for test 2024-05-01 08:22:28 -07:00
Krrish Dholakia
e2eddac406 test(test_ratelimit.py): fix test to send below rpm 2024-04-30 19:35:21 -07:00
Krrish Dholakia
5583197d63 fix(proxy_server.py): fix setting offset-aware datetime 2024-04-25 21:18:32 -07:00
Krrish Dholakia
f54510b6ee fix(proxy_server.py): fix /config/update/ 
allows updating router config via UI and having the change be propogated across all proxy instances by persisting config changes to the db
 2024-04-24 16:42:42 -07:00
Krrish Dholakia
e31eb6a6b2 test(test_openai_endpoints.py): add unit testing for streaming + logprobs on docker image 2024-04-23 19:26:19 -07:00
Krish Dholakia
fcde3ba213
Merge pull request #3192 from BerriAI/litellm_calculate_max_parallel_requests 
fix(router.py): Make TPM limits concurrency-safe
 2024-04-20 13:24:29 -07:00
Ishaan Jaff
f89f8a4157
Merge pull request #3184 from BerriAI/litellm_ui_non_admins_flow 
[UI] - non admin flow - only Create + Test Key available
 2024-04-20 12:40:43 -07:00
Ishaan Jaff
7b24a74e77 test fix - test_key_delete_ui 2024-04-20 12:30:58 -07:00
Krrish Dholakia
1507b23e30 test(test_openai_endpoints.py): make test stricter 2024-04-20 12:11:54 -07:00
Ishaan Jaff
a34f725db7 fix - test keys 2024-04-20 11:43:43 -07:00