Commit graph

66 commits

Author SHA1 Message Date
Krrish Dholakia
b9854a99d2 test: increase time before checking budget reset - avoid deadlocking 2024-03-06 22:16:59 -08:00
Krrish Dholakia
ad55f4dbb5 feat(proxy_server.py): retry if virtual key is rate limited
currently for chat completions
2024-03-05 19:00:03 -08:00
Krrish Dholakia
cd419eb8a5 test(test_keys.py): add more duration for testing budget updates 2024-03-05 15:35:13 -08:00
Krrish Dholakia
37ad5efc61 fix(proxy/utils.py): fix resetting budget logic 2024-03-02 20:52:54 -08:00
Krrish Dholakia
5265d9042d test: testing fixes 2024-02-27 20:35:42 -08:00
ishaan-jaff
d07846646c (ui) fix build command 2024-02-21 21:02:46 -08:00
Krrish Dholakia
ef0171e063 feat(utils.py): support cost tracking for openai/azure image gen models 2024-02-03 17:09:54 -08:00
Krrish Dholakia
09ec6d6458 fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
2024-01-25 12:49:45 -08:00
Krrish Dholakia
30d615f442 build(proxy_server_config.yaml): add proxy budget to default yaml 2024-01-24 20:12:03 -08:00
Krrish Dholakia
09b7235b31 fix: support info level logging on pkg + proxy 2024-01-20 17:45:47 -08:00
Krrish Dholakia
f5ced089d6 test(tests/): add unit testing for proxy server endpoints 2024-01-19 14:54:29 -08:00
Krrish Dholakia
21d951f279 build(config.yml): add /key/generate load test 2024-01-10 19:23:42 +05:30
Krrish Dholakia
9f23cf5852 build(config.yml): add keys to ci build 2024-01-10 18:13:34 +05:30
Ishaan Jaff
e3d37b9bdc
Update proxy_server_config.yaml 2023-11-30 09:30:41 -08:00
Ishaan Jaff
a965c4dfb1
Update proxy_server_config.yaml 2023-11-30 09:26:54 -08:00
ishaan-jaff
ecdc5bdad6 (dos) config.yaml 2023-11-30 08:34:36 -08:00