phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
7327 commits 1603 branches 645 tags 320 MiB
Commit graph

29 commits

Author SHA1 Message Date
Krrish Dholakia
83d43809a7 fix(proxy_server.py): fix proxy server team id bug 2024-02-13 22:33:56 -08:00
Krrish Dholakia
4a0df3cb4f fix(proxy_cli.py-&&-proxy_server.py): bump reset budget intervals and fix pool limits for prisma connections 2024-02-06 19:39:49 -08:00
Krrish Dholakia
b6adeec347 fix(proxy_server.py): prisma client fixes for high traffic 2024-02-06 17:30:36 -08:00
Krrish Dholakia
ef0171e063 feat(utils.py): support cost tracking for openai/azure image gen models 2024-02-03 17:09:54 -08:00
ishaan-jaff
419bddae93 (fix) show error in test_keys 2024-02-02 19:15:03 -08:00
Krrish Dholakia
bfe2faa454 test(test_keys.py): separate streaming key info test from normal completion key info test 2024-02-02 19:03:47 -08:00
ishaan-jaff
d7d1aa1266 (ci/cd) run again 2024-02-02 18:56:03 -08:00
Krrish Dholakia
92ebe132e8 test(test_keys.py): fix test 2024-01-31 11:26:49 -08:00
Krrish Dholakia
ecc6855e49 build(config.yml): add more logging for docker build and test 2024-01-31 10:58:25 -08:00
Krrish Dholakia
eea4325e60 test(test_keys.py): add more retries for checking if budget updated 2024-01-31 10:44:19 -08:00
Krrish Dholakia
a0022410fa test(test_users.py): add more reattempts and delays 2024-01-31 10:05:35 -08:00
Krrish Dholakia
70d5f9ef96 test(test_keys.py): reorder tests 2024-01-31 09:37:37 -08:00
Krrish Dholakia
f9acad87dc feat(proxy_server.py): enable cache controls per key + no-store cache flag 2024-01-30 20:46:50 -08:00
ishaan-jaff
6097102c21 (test) /health/readiness 2024-01-29 15:27:25 -08:00
ishaan-jaff
9c4d9c2f58 (test) /key/info 2024-01-26 19:26:55 -08:00
ishaan-jaff
2a60af7164 (test) key crossing budget 2024-01-26 14:43:16 -08:00
ishaan-jaff
55b95e87dd (fix) SpendLogs Table 2024-01-26 13:23:51 -08:00
Krrish Dholakia
554f1a090d test(test_keys.py): add delay for test check 
n
 2024-01-25 18:31:07 -08:00
Krrish Dholakia
09ec6d6458 fix(utils.py): fix sagemaker async logging for sync streaming 
https://github.com/BerriAI/litellm/issues/1592
 2024-01-25 12:49:45 -08:00
Krrish Dholakia
8e1157fc92 test(test_keys.py): reset proxy spend 2024-01-24 21:08:09 -08:00
Krrish Dholakia
624da17698 test(test_users.py): add testing for global proxy spend tracking 2024-01-24 16:24:50 -08:00
Krrish Dholakia
bb7705b494 test(test_users.py): test budgets with resets 2024-01-24 15:30:30 -08:00
Krrish Dholakia
e471157d57 test(test_keys.py): add testing to make sure budget resets are working as expected 2024-01-24 15:13:11 -08:00
Krrish Dholakia
f0ada5c950 test(test_spend_logs): new endpoint test for /spend/logs 2024-01-24 11:20:31 -08:00
Krrish Dholakia
d6844f43c8 test(test_keys.py): use correct model name for token counting 2024-01-23 17:46:14 -08:00
Krrish Dholakia
f47db44b4f test(test_keys.py): fix streaming test 2024-01-23 16:27:45 -08:00
Krrish Dholakia
f8870fb48e fix(utils.py): fix proxy streaming spend tracking 2024-01-23 15:59:03 -08:00
Krrish Dholakia
f5ced089d6 test(tests/): add unit testing for proxy server endpoints 2024-01-19 14:54:29 -08:00
Krrish Dholakia
1a29272b47 fix(parallel_request_limiter.py): handle tpm/rpm limits being null 2024-01-19 10:22:27 -08:00