phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
21024 commits 2490 branches 894 tags 548 MiB
Commit graph

513 commits

Author SHA1 Message Date
ishaan-jaff
71a6f7fcc4 (feat) slack alerting budgets 2024-01-25 16:40:23 -08:00
ishaan-jaff
1f62453719 (feat) alerts proxy budgets 2024-01-25 16:40:23 -08:00
ishaan-jaff
1d36b8da31 v0 basic structure 2024-01-25 16:40:23 -08:00
Krrish Dholakia
402235dc5d fix(utils.py): fix sagemaker async logging for sync streaming 
https://github.com/BerriAI/litellm/issues/1592
 2024-01-25 12:49:45 -08:00
Krrish Dholakia
d1b563fbf4 fix(proxy/utils.py): handle item not existing during batch updates 2024-01-24 21:49:47 -08:00
Krrish Dholakia
2f25a8db8d test(test_keys.py): reset proxy spend 2024-01-24 21:08:09 -08:00
Krish Dholakia
f1d309d700 Merge branch 'main' into litellm_global_spend_updates 2024-01-24 20:20:15 -08:00
ishaan-jaff
40a8c1af2d (fix) log cache hits on SpendLogs table 2024-01-24 18:51:39 -08:00
ishaan-jaff
52fb8c5b40 (fix) use litellm.cache for getting key 2024-01-24 18:34:22 -08:00
ishaan-jaff
c8b2e5c80b (feat) add cache_key in spend_log 2024-01-24 17:56:00 -08:00
Krrish Dholakia
7a8f10c1c0 test(test_key_generate_prisma.py): add unit testing for global proxy budget 2024-01-24 17:43:01 -08:00
ishaan-jaff
a0f2bae4e2 (fix) bug from bb7705b494 2024-01-24 17:34:17 -08:00
Krrish Dholakia
8518e2e2d1 fix(proxy_server.py): enforce budget limit if global proxy limit reached 2024-01-24 17:11:40 -08:00
Ishaan Jaff
6dac4ab8aa Merge pull request #1601 from BerriAI/litellm_improve_slack_alertign 
[Feat] Proxy - Improve Slack Alerting
 2024-01-24 16:43:23 -08:00
ishaan-jaff
2addde9279 (FIX) improve slack alerting messages 2024-01-24 16:07:46 -08:00
Krrish Dholakia
d536374be0 fix(proxy_server.py): track cost for global proxy 2024-01-24 16:06:10 -08:00
ishaan-jaff
2686d1f087 (fix) only alert users when requests are hanging 2024-01-24 15:58:07 -08:00
Krrish Dholakia
39ed3d42f4 test(test_users.py): test budgets with resets 2024-01-24 15:30:30 -08:00
ishaan-jaff
0f51cd0bab (fix) alerting - show timestamps in alert 2024-01-24 15:25:40 -08:00
ishaan-jaff
44718e59e9 (feat) add request_info to slack alerts 2024-01-24 15:17:33 -08:00
Krish Dholakia
65c971e60e Merge pull request #1600 from BerriAI/litellm_global_budget 
feat(proxy_server.py): support global budget and resets
 2024-01-24 14:55:36 -08:00
ishaan-jaff
3fe475c9ce (feat) slack alerting - log request/response 2024-01-24 14:55:21 -08:00
Krish Dholakia
e92cf9e6a3 Merge pull request #1590 from BerriAI/litellm_spend_logs_by_key 
feat(proxy_server.py): enable returning spend logs by api key
 2024-01-24 14:45:25 -08:00
Krrish Dholakia
f21e003f5b feat(proxy_server.py): support global budget and resets 2024-01-24 14:27:13 -08:00
ishaan-jaff
5211e5ca99 (fix) stop logging messages, response in SpendLogs 2024-01-24 13:16:34 -08:00
Ishaan Jaff
00c98f3169 Merge branch 'main' into litellm_spend_per_user 2024-01-24 12:24:15 -08:00
ishaan-jaff
b1c91a987a (feat) /spend/users endpoint 2024-01-24 11:34:28 -08:00
ishaan-jaff
722a5a5132 (test) setting model in SpendTable logs 2024-01-24 11:09:20 -08:00
Krrish Dholakia
55344e836d feat(proxy_server.py): enable returning spend logs by api key 
https://github.com/BerriAI/litellm/issues/1582
 2024-01-24 10:48:23 -08:00
Krish Dholakia
89e420b243 Merge branch 'main' into litellm_reset_key_budget 2024-01-23 18:10:32 -08:00
Krrish Dholakia
503ce7020b test(test_keys.py): use correct model name for token counting 2024-01-23 17:46:14 -08:00
Krrish Dholakia
3cf1623727 refactor(proxy/utils.py): fix linting issue 2024-01-23 17:22:22 -08:00
Krish Dholakia
2ba8863f75 Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking 
[WIP] fix(utils.py): fix proxy streaming spend tracking
 2024-01-23 17:07:40 -08:00
ishaan-jaff
9ae3d8c243 (feat) /spend/logs 2024-01-23 16:57:51 -08:00
Krrish Dholakia
e53717f050 fix(proxy/utils.py): remove original auth sk-.. key before logging to spend logs 2024-01-23 16:19:32 -08:00
Krrish Dholakia
a5e53271d3 fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss 
ue for spend logs
 2024-01-23 16:14:01 -08:00
ishaan-jaff
9c85d05d24 (feat) add /spend/keys endpoint 2024-01-23 15:10:10 -08:00
Krrish Dholakia
88486a3123 fix(utils.py): fix streaming cost tracking 2024-01-23 14:39:45 -08:00
Krrish Dholakia
e6f05e858b feat(proxy/utils.py): enable background process to reset key budgets 2024-01-23 12:33:13 -08:00
Krrish Dholakia
e423aeff85 fix: support streaming custom cost completion tracking 2024-01-22 15:15:34 -08:00
ishaan-jaff
f4aef679c9 (feat) proxy - track cost for user_ids that do not exist 2024-01-18 17:44:39 -08:00
ishaan-jaff
b6af86a933 (feat) track - api_key in spendLogs 2024-01-18 13:16:25 -08:00
ishaan-jaff
772aa0ad8d (feat) insert_data to spend table 2024-01-18 10:09:02 -08:00
Krrish Dholakia
c2813594ea fix(proxy/utils.py): fix isoformat to string logic 2024-01-18 09:32:30 -08:00
Krrish Dholakia
1365e9d3ae fix(proxy/utils.py): prisma client fix get data to handle list return 2024-01-18 07:49:13 -08:00
Krish Dholakia
05682f6eb4 Merge pull request #1483 from BerriAI/litellm_model_access_groups_feature 
feat(proxy_server.py): support model access groups
 2024-01-17 18:16:53 -08:00
Krrish Dholakia
5242200243 feat(proxy_server.py): support model access groups 2024-01-17 15:45:31 -08:00
ishaan-jaff
32cc9b1559 (fix) prisma - non expiring keys 2024-01-17 12:56:26 -08:00
ishaan-jaff
dfef9c2986 (feat) improve Prisma Auth Error 2024-01-17 11:57:48 -08:00
ishaan-jaff
772547d625 (fix) proxy check expires time 2024-01-16 15:38:58 -08:00