phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 18:54:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
7072 commits 2481 branches 894 tags 535 MiB
Commit graph

654 commits

Author SHA1 Message Date
ishaan-jaff
a4acece4c1 (docstring) /key/info 2024-01-27 08:17:08 -08:00
Krish Dholakia
e1f1e4fefb
Merge pull request #1642 from BerriAI/litellm_key_aliases 
feat(proxy_server.py): save abbreviated key name if `allow_user_auth` enabled
 2024-01-26 22:07:17 -08:00
Krrish Dholakia
b1b582ffe2 fix(proxy_server.py): check if api key string before asserting it starts with sk- 2024-01-26 20:06:57 -08:00
ishaan-jaff
ec3f497db8 (feat) /key/info without using key in query param 2024-01-26 19:26:43 -08:00
Krrish Dholakia
5dfe54d20d feat(proxy_server.py): save abbreviated key name if allow_user_auth enabled 2024-01-26 15:31:37 -08:00
ishaan-jaff
2873365f02 (fix) proxy - always use hashed_token as /key cache key 2024-01-26 14:30:26 -08:00
Krrish Dholakia
511510a1cc refactor(proxy_server.py): fix docstring for /key/delete to show hashed tokens as well 2024-01-26 13:33:17 -08:00
Krish Dholakia
612f74a426
Merge pull request #1618 from BerriAI/litellm_sagemaker_cost_tracking_fixes 
fix(utils.py): fix sagemaker cost tracking for streaming
 2024-01-25 19:01:57 -08:00
ishaan-jaff
81c528f6ce (fix) raise correct error when proxy crossed budget 2024-01-25 16:40:23 -08:00
ishaan-jaff
56f49a87ba (fix) raise exception budget_duration is set and max_budget is Not 2024-01-25 16:40:23 -08:00
ishaan-jaff
565531fe9e v0 basic structure 2024-01-25 16:40:23 -08:00
ishaan-jaff
e56721d6c3 (feat) view spend/logs by user_id, view spend/user by user 2024-01-25 16:12:28 -08:00
Krrish Dholakia
09ec6d6458 fix(utils.py): fix sagemaker async logging for sync streaming 
https://github.com/BerriAI/litellm/issues/1592
 2024-01-25 12:49:45 -08:00
Ishaan Jaff
06a5dbfb5e
Merge pull request #1615 from BerriAI/litellm_alerts_budget_tracking 
[Feat] Alerts for Proxy Budgets
 2024-01-25 12:00:18 -08:00
ishaan-jaff
450b0a0ad1 (fix) raise correct error when proxy crossed budget 2024-01-25 11:39:57 -08:00
ishaan-jaff
126b87e3fa (fix) raise exception budget_duration is set and max_budget is Not 2024-01-25 11:32:05 -08:00
ishaan-jaff
d328a4bad0 v0 basic structure 2024-01-25 09:58:43 -08:00
Krrish Dholakia
39d5407e67 fix(proxy_server.py): don't set tpm/rpm limits unless set 
https://github.com/BerriAI/litellm/issues/1594
 2024-01-25 09:53:10 -08:00
Krrish Dholakia
0752048b81 fix(dynamo_db.py): fix update bug 2024-01-24 21:29:56 -08:00
Krrish Dholakia
8e1157fc92 test(test_keys.py): reset proxy spend 2024-01-24 21:08:09 -08:00
Krrish Dholakia
34c4532e7e fix(proxy_server.py): fix handling none value for existing spend object pt.2 2024-01-24 20:39:00 -08:00
Krish Dholakia
6501fdb76e
Merge branch 'main' into litellm_global_spend_updates 2024-01-24 20:20:15 -08:00
ishaan-jaff
2f3765a03f (fix) log cache hits on SpendLogs table 2024-01-24 18:51:39 -08:00
ishaan-jaff
bf851ef19a (fix) use litellm.cache for getting key 2024-01-24 18:34:22 -08:00
Krrish Dholakia
f148094d18 test(test_key_generate_prisma.py): add unit testing for global proxy budget 2024-01-24 17:43:01 -08:00
Krrish Dholakia
30a8071bf1 fix(proxy_server.py): enforce budget limit if global proxy limit reached 2024-01-24 17:11:40 -08:00
Ishaan Jaff
45ca7343d0
Merge pull request #1601 from BerriAI/litellm_improve_slack_alertign 
[Feat] Proxy - Improve Slack Alerting
 2024-01-24 16:43:23 -08:00
Krrish Dholakia
574208f005 fix(proxy_server.py): track cost for global proxy 2024-01-24 16:06:10 -08:00
ishaan-jaff
b993c62144 (fix) only alert users when requests are hanging 2024-01-24 15:58:07 -08:00
Krrish Dholakia
f9d159797a fix(proxy_server.py): handle view spend logs for api key none object 2024-01-24 14:57:21 -08:00
Krish Dholakia
3e7ed4082a
Merge pull request #1600 from BerriAI/litellm_global_budget 
feat(proxy_server.py): support global budget and resets
 2024-01-24 14:55:36 -08:00
Krish Dholakia
ed77f2d682
Merge pull request #1590 from BerriAI/litellm_spend_logs_by_key 
feat(proxy_server.py): enable returning spend logs by api key
 2024-01-24 14:45:25 -08:00
Krrish Dholakia
159e54d8be feat(proxy_server.py): support global budget and resets 2024-01-24 14:27:13 -08:00
ishaan-jaff
63f18e7163 (fix) use get_attr for valid_token 2024-01-24 13:01:37 -08:00
ishaan-jaff
2692afca75 (feat) /spend/users endpoint 2024-01-24 11:34:28 -08:00
Krrish Dholakia
dd05c6e6e3 feat(proxy_server.py): enable returning spend logs by api key 
https://github.com/BerriAI/litellm/issues/1582
 2024-01-24 10:48:23 -08:00
ishaan-jaff
d3848b6e6c (v0) 2024-01-24 10:13:57 -08:00
ishaan-jaff
2d26875eb0 (fix) together_ai use sync generator 2024-01-23 20:07:26 -08:00
Ishaan Jaff
a0cd4e78fc
Merge branch 'main' into litellm_map_openai_auth_errors 2024-01-23 18:31:48 -08:00
Krish Dholakia
9784d03d65
Merge branch 'main' into litellm_reset_key_budget 2024-01-23 18:10:32 -08:00
ishaan-jaff
feb367bbb9 (feat) all endpoints raise OpenAI compatible exceptions 2024-01-23 17:32:47 -08:00
Krrish Dholakia
7b5e3b9934 refactor(proxy/utils.py): fix linting issue 2024-01-23 17:22:22 -08:00
Krish Dholakia
4ca4913468
Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking 
[WIP] fix(utils.py): fix proxy streaming spend tracking
 2024-01-23 17:07:40 -08:00
ishaan-jaff
0e9339b390 (feat) /spend/logs 2024-01-23 16:57:51 -08:00
ishaan-jaff
8ae8edfdb4 (fix) add doc string for /spend/keys 2024-01-23 16:27:25 -08:00
Krrish Dholakia
d52f5234b4 fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss 
ue for spend logs
 2024-01-23 16:14:01 -08:00
Krrish Dholakia
f8870fb48e fix(utils.py): fix proxy streaming spend tracking 2024-01-23 15:59:03 -08:00
ishaan-jaff
a2da9c30fb (feat) add /spend/keys endpoint 2024-01-23 15:10:10 -08:00
Krrish Dholakia
afada01ffc fix(utils.py): fix streaming cost tracking 2024-01-23 14:39:45 -08:00
Krrish Dholakia
b1a105e309 feat(proxy/utils.py): enable background process to reset key budgets 2024-01-23 12:33:13 -08:00