phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
11411 commits 1603 branches 645 tags 320 MiB
Commit graph

44 commits

Author SHA1 Message Date
Krrish Dholakia
f2766fddbf fix(proxy_server.py): fix /v1/models bug where it would return empty list 
handle 'all-team-models' being set for a given key
 2024-05-07 13:43:15 -07:00
Ishaan Jaff
31c4f5f811 (ci/cd) add detailed debugging info 2024-05-06 11:40:16 -07:00
Krrish Dholakia
918367cc7b test: skip hanging test 2024-05-05 00:27:38 -07:00
Krrish Dholakia
b9f5b3c1a0 build(test_keys.py): improve error message for test 2024-05-01 08:22:28 -07:00
Krrish Dholakia
5583197d63 fix(proxy_server.py): fix setting offset-aware datetime 2024-04-25 21:18:32 -07:00
Ishaan Jaff
7b24a74e77 test fix - test_key_delete_ui 2024-04-20 12:30:58 -07:00
Ishaan Jaff
a34f725db7 fix - test keys 2024-04-20 11:43:43 -07:00
Krrish Dholakia
70716b3373 fix(proxy_server.py): fix key create logic + add unit tests 2024-04-16 13:08:34 -07:00
Ishaan Jaff
e20d3f29b0 test - delete keys 2024-04-15 16:37:20 -07:00
Krrish Dholakia
af2eabba91 fix(proxy_server.py): fix /key/update endpoint to update key duration 
also adds a test for this to our ci/cd
 2024-03-29 21:47:10 -07:00
Krrish Dholakia
c81c9c2583 fix(proxy_server.py): fix model info check 2024-03-23 15:59:17 -07:00
Krrish Dholakia
066346b8c8 test: handle flaky tests locally - causing db timeout issues on circle ci 2024-03-19 20:39:53 -07:00
Krrish Dholakia
f588bff69b fix(proxy_server.py): fix spend log update 2024-03-18 20:26:28 -07:00
Krrish Dholakia
b9854a99d2 test: increase time before checking budget reset - avoid deadlocking 2024-03-06 22:16:59 -08:00
Krrish Dholakia
ad55f4dbb5 feat(proxy_server.py): retry if virtual key is rate limited 
currently for chat completions
 2024-03-05 19:00:03 -08:00
Krrish Dholakia
2b595bfdc9 test(test_keys.py): add more duration for test 2024-03-05 15:42:19 -08:00
Krrish Dholakia
4f3d1ee11f test(test_keys.py): extend time for test 2024-03-02 21:19:34 -08:00
Krrish Dholakia
37ad5efc61 fix(proxy/utils.py): fix resetting budget logic 2024-03-02 20:52:54 -08:00
Krrish Dholakia
f7a2d3faef test: skip sagemaker test - aws account suspended 2024-02-28 15:00:53 -08:00
Krrish Dholakia
5265d9042d test: testing fixes 2024-02-27 20:35:42 -08:00
Krrish Dholakia
4a0df3cb4f fix(proxy_cli.py-&&-proxy_server.py): bump reset budget intervals and fix pool limits for prisma connections 2024-02-06 19:39:49 -08:00
Krrish Dholakia
b6adeec347 fix(proxy_server.py): prisma client fixes for high traffic 2024-02-06 17:30:36 -08:00
Krrish Dholakia
ef0171e063 feat(utils.py): support cost tracking for openai/azure image gen models 2024-02-03 17:09:54 -08:00
ishaan-jaff
419bddae93 (fix) show error in test_keys 2024-02-02 19:15:03 -08:00
Krrish Dholakia
bfe2faa454 test(test_keys.py): separate streaming key info test from normal completion key info test 2024-02-02 19:03:47 -08:00
ishaan-jaff
d7d1aa1266 (ci/cd) run again 2024-02-02 18:56:03 -08:00
Krrish Dholakia
92ebe132e8 test(test_keys.py): fix test 2024-01-31 11:26:49 -08:00
Krrish Dholakia
ecc6855e49 build(config.yml): add more logging for docker build and test 2024-01-31 10:58:25 -08:00
Krrish Dholakia
eea4325e60 test(test_keys.py): add more retries for checking if budget updated 2024-01-31 10:44:19 -08:00
Krrish Dholakia
70d5f9ef96 test(test_keys.py): reorder tests 2024-01-31 09:37:37 -08:00
Krrish Dholakia
f9acad87dc feat(proxy_server.py): enable cache controls per key + no-store cache flag 2024-01-30 20:46:50 -08:00
ishaan-jaff
9c4d9c2f58 (test) /key/info 2024-01-26 19:26:55 -08:00
ishaan-jaff
2a60af7164 (test) key crossing budget 2024-01-26 14:43:16 -08:00
ishaan-jaff
55b95e87dd (fix) SpendLogs Table 2024-01-26 13:23:51 -08:00
Krrish Dholakia
554f1a090d test(test_keys.py): add delay for test check 
n
 2024-01-25 18:31:07 -08:00
Krrish Dholakia
09ec6d6458 fix(utils.py): fix sagemaker async logging for sync streaming 
https://github.com/BerriAI/litellm/issues/1592
 2024-01-25 12:49:45 -08:00
Krrish Dholakia
8e1157fc92 test(test_keys.py): reset proxy spend 2024-01-24 21:08:09 -08:00
Krrish Dholakia
bb7705b494 test(test_users.py): test budgets with resets 2024-01-24 15:30:30 -08:00
Krrish Dholakia
e471157d57 test(test_keys.py): add testing to make sure budget resets are working as expected 2024-01-24 15:13:11 -08:00
Krrish Dholakia
f0ada5c950 test(test_spend_logs): new endpoint test for /spend/logs 2024-01-24 11:20:31 -08:00
Krrish Dholakia
d6844f43c8 test(test_keys.py): use correct model name for token counting 2024-01-23 17:46:14 -08:00
Krrish Dholakia
f47db44b4f test(test_keys.py): fix streaming test 2024-01-23 16:27:45 -08:00
Krrish Dholakia
f8870fb48e fix(utils.py): fix proxy streaming spend tracking 2024-01-23 15:59:03 -08:00
Krrish Dholakia
f5ced089d6 test(tests/): add unit testing for proxy server endpoints 2024-01-19 14:54:29 -08:00