phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
17554 commits 1603 branches 645 tags 320 MiB
Commit graph

232 commits

Author SHA1 Message Date
Ishaan Jaff
aed59abe35 allow passing expiry time to /key/regenerate 2024-09-06 08:36:34 -07:00
Ishaan Jaff
18f019f87d move prisma test to correct location 2024-09-05 15:50:39 -07:00
Ishaan Jaff
edc51f45ac add error message on test 2024-09-05 15:46:13 -07:00
Ishaan Jaff
3d9049df6d move folder key gen prisma is in 2024-09-05 15:24:00 -07:00
Ishaan Jaff
9aff6a4c9d add test for ui usage endpoints 2024-09-05 15:06:53 -07:00
Ishaan Jaff
94d6e800ee add test for internal vs admin user 2024-09-05 13:30:51 -07:00
Ishaan Jaff
f9a3e343bb add ui testing folder 2024-09-05 13:13:58 -07:00
Ishaan Jaff
cdc312d51d mark test_team_logging as flaky 2024-09-04 20:29:21 -07:00
Krrish Dholakia
25e49a59b2 test: skip flaky test 2024-09-04 08:20:57 -07:00
Ishaan Jaff
3c898e23ea refactor secret managers 2024-09-03 10:58:02 -07:00
Krish Dholakia
9f3fa29624
feat(router.py): Support Loadbalancing batch azure api endpoints (#5469) 
* feat(router.py): initial commit for loadbalancing azure batch api endpoints

Closes https://github.com/BerriAI/litellm/issues/5396

* fix(router.py): working `router.acreate_file()`

* feat(router.py): working router.acreate_batch endpoint

* feat(router.py): expose router.aretrieve_batch function

Make it easy for user to retrieve the batch information

* feat(router.py): support 'router.alist_batches' endpoint

Adds support for getting all batches across all endpoints

* feat(router.py): working loadbalancing on `/v1/files`

* feat(proxy_server.py): working loadbalancing on `/v1/batches`

* feat(proxy_server.py): working loadbalancing on Retrieve + List batch
 2024-09-02 21:32:55 -07:00
Ishaan Jaff
e9427205ef add test for pass through streaming usage tracking 2024-09-02 16:17:49 -07:00
Ishaan Jaff
9e557ed072 fix test 2024-08-31 08:39:52 -07:00
Ishaan Jaff
b35bfb0302 fix cost tracking for vertex ai native 2024-08-31 08:22:27 -07:00
Ishaan Jaff
06857d108d fix /spend logs call 2024-08-30 17:02:24 -07:00
Ishaan Jaff
2c86a62474 fix vertex ai test 2024-08-30 16:50:23 -07:00
Ishaan Jaff
f43060e8df mark as async 2024-08-30 16:40:41 -07:00
Ishaan Jaff
414d2dcb52 call spend logs endpoint 2024-08-30 16:35:07 -07:00
Ishaan Jaff
f3f85f6141 add test for vertex basic pass throgh 2024-08-30 16:26:00 -07:00
Krish Dholakia
8d6a0bdc81
- merge - fix TypeError: 'CompletionUsage' object is not subscriptable #5441 (#5448) 
* fix TypeError: 'CompletionUsage' object is not subscriptable (#5441)

* test(test_team_logging.py): mark flaky test

---------

Co-authored-by: yafei lee <yafei@dao42.com>
 2024-08-30 08:54:42 -07:00
Ishaan Jaff
e329c4509a
Merge branch 'main' into litellm_add_tag_control_team 2024-08-29 17:34:40 -07:00
Ishaan Jaff
4b7ceade64 mark test_key_info_spend_values_streaming as flaky 2024-08-29 14:39:53 -07:00
Ishaan Jaff
da2cefc45a fix team based tag routing 2024-08-29 14:37:44 -07:00
Ishaan Jaff
f592aeaa38 add test_chat_completion_with_no_tags 2024-08-29 13:54:11 -07:00
Ishaan Jaff
34f1d32799 add test for tag based routing 2024-08-29 13:45:24 -07:00
Ishaan Jaff
bcf7f3e437 handle flaky pytests 2024-08-27 22:44:49 -07:00
Ishaan Jaff
c27640e6e4 add /rerank test 2024-08-27 17:50:37 -07:00
Ishaan Jaff
918e4fcfe5 feat add test for custom guardrails 2024-08-23 12:01:43 -07:00
Ishaan Jaff
1f0cc72531 test bedrock guardrails 2024-08-22 17:24:42 -07:00
Krish Dholakia
409306b266
Merge branch 'main' into litellm_fix_azure_api_version 2024-08-20 11:40:53 -07:00
Ishaan Jaff
aceab2669f test guardrails with API Key 2024-08-20 08:40:00 -07:00
Ishaan Jaff
04efdd66c0 fix test guardrails 2024-08-19 21:03:37 -07:00
Ishaan Jaff
b2d63f752c add testing for guardrails 2024-08-19 21:03:37 -07:00
Ishaan Jaff
6fa421ed8e test_llm_guard_triggered 2024-08-19 21:03:37 -07:00
Ishaan Jaff
9f927e0e4e add testing for aporia guardrails 2024-08-19 21:03:37 -07:00
Ishaan Jaff
57bbcba079 fix test guardrails 2024-08-19 18:58:31 -07:00
Ishaan Jaff
5d262a6ee7 add testing for guardrails 2024-08-19 18:57:02 -07:00
Ishaan Jaff
37e6d8a3aa test_llm_guard_triggered 2024-08-19 18:53:12 -07:00
Ishaan Jaff
0431600f7b add testing for aporia guardrails 2024-08-19 18:50:14 -07:00
Krrish Dholakia
d1d28487f7 refactor(test_users.py): refactor test for user info to use mock endpoints 2024-08-12 18:48:43 -07:00
Krrish Dholakia
a0a1feb7da fix(management/utils.py): fix add_member to team when adding user_email 
Fixes https://github.com/BerriAI/litellm/issues/5112
 2024-08-10 17:12:09 -07:00
Krrish Dholakia
575afa8029 fix(internal_user_endpoints.py): return all teams if user is admin 2024-08-10 16:36:43 -07:00
Krrish Dholakia
5703da9b42 fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 10:30:15 -07:00
Ishaan Jaff
f1ffa82062 fix use provider specific routing 2024-08-07 14:37:20 -07:00
Ishaan Jaff
56f110cd04 test test_basic_passthrough 2024-08-06 21:17:07 -07:00
Ishaan Jaff
404360b28d test pass through endpoint 2024-08-06 12:16:00 -07:00
Krrish Dholakia
28c12e6702 fix(utils.py): fix togetherai streaming cost calculation 2024-08-01 15:03:08 -07:00
Ishaan Jaff
a6e62da9fb fix cancel ft job route 2024-07-31 16:19:15 -07:00
Ishaan Jaff
729f876f81 test cancel ft jobs 2024-07-31 16:12:52 -07:00
Ishaan Jaff
9b6231810b add GET fine_tuning/jobs 2024-07-31 15:58:35 -07:00