phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
6070 commits 1603 branches 645 tags 320 MiB
Commit graph

475 commits

Author SHA1 Message Date
Krrish Dholakia
574208f005 fix(proxy_server.py): track cost for global proxy 2024-01-24 16:06:10 -08:00
Krrish Dholakia
f9d159797a fix(proxy_server.py): handle view spend logs for api key none object 2024-01-24 14:57:21 -08:00
Krish Dholakia
3e7ed4082a
Merge pull request #1600 from BerriAI/litellm_global_budget 
feat(proxy_server.py): support global budget and resets
 2024-01-24 14:55:36 -08:00
Krish Dholakia
ed77f2d682
Merge pull request #1590 from BerriAI/litellm_spend_logs_by_key 
feat(proxy_server.py): enable returning spend logs by api key
 2024-01-24 14:45:25 -08:00
Krrish Dholakia
159e54d8be feat(proxy_server.py): support global budget and resets 2024-01-24 14:27:13 -08:00
ishaan-jaff
63f18e7163 (fix) use get_attr for valid_token 2024-01-24 13:01:37 -08:00
ishaan-jaff
2692afca75 (feat) /spend/users endpoint 2024-01-24 11:34:28 -08:00
Krrish Dholakia
dd05c6e6e3 feat(proxy_server.py): enable returning spend logs by api key 
https://github.com/BerriAI/litellm/issues/1582
 2024-01-24 10:48:23 -08:00
ishaan-jaff
d3848b6e6c (v0) 2024-01-24 10:13:57 -08:00
ishaan-jaff
2d26875eb0 (fix) together_ai use sync generator 2024-01-23 20:07:26 -08:00
Ishaan Jaff
a0cd4e78fc
Merge branch 'main' into litellm_map_openai_auth_errors 2024-01-23 18:31:48 -08:00
Krish Dholakia
9784d03d65
Merge branch 'main' into litellm_reset_key_budget 2024-01-23 18:10:32 -08:00
ishaan-jaff
feb367bbb9 (feat) all endpoints raise OpenAI compatible exceptions 2024-01-23 17:32:47 -08:00
Krrish Dholakia
7b5e3b9934 refactor(proxy/utils.py): fix linting issue 2024-01-23 17:22:22 -08:00
Krish Dholakia
4ca4913468
Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking 
[WIP] fix(utils.py): fix proxy streaming spend tracking
 2024-01-23 17:07:40 -08:00
ishaan-jaff
0e9339b390 (feat) /spend/logs 2024-01-23 16:57:51 -08:00
ishaan-jaff
8ae8edfdb4 (fix) add doc string for /spend/keys 2024-01-23 16:27:25 -08:00
Krrish Dholakia
d52f5234b4 fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss 
ue for spend logs
 2024-01-23 16:14:01 -08:00
Krrish Dholakia
f8870fb48e fix(utils.py): fix proxy streaming spend tracking 2024-01-23 15:59:03 -08:00
ishaan-jaff
a2da9c30fb (feat) add /spend/keys endpoint 2024-01-23 15:10:10 -08:00
Krrish Dholakia
afada01ffc fix(utils.py): fix streaming cost tracking 2024-01-23 14:39:45 -08:00
Krrish Dholakia
b1a105e309 feat(proxy/utils.py): enable background process to reset key budgets 2024-01-23 12:33:13 -08:00
ishaan-jaff
44e213e842 (fix) select_data_generator 2024-01-23 12:13:34 -08:00
ishaan-jaff
a61dbc1613 (fix) select_data_generator - sagemaker 2024-01-23 12:08:58 -08:00
ishaan-jaff
bd37a9cb5e (fix) proxy - streaming sagemaker 2024-01-23 11:12:16 -08:00
Krish Dholakia
bedb08bdef
Merge pull request #1557 from BerriAI/litellm_emit_spend_logs 
feat(utils.py): emit response cost as part of logs
 2024-01-22 21:02:40 -08:00
Krrish Dholakia
11e3ee4411 test: fix tests 2024-01-22 20:20:17 -08:00
Krrish Dholakia
3e8c8ef507 fix(openai.py): fix linting issue 2024-01-22 18:20:15 -08:00
Krrish Dholakia
e917d0eee6 feat(utils.py): emit response cost as part of logs 2024-01-22 15:53:04 -08:00
Ishaan Jaff
db68774d60
Merge branch 'main' into litellm_budget_per_key 2024-01-22 15:49:57 -08:00
Krrish Dholakia
074ea17325 fix: support streaming custom cost completion tracking 2024-01-22 15:15:34 -08:00
Ishaan Jaff
5700d60e1a
Merge pull request #1538 from BerriAI/litellm_use_custom_key_gen 
[Feat] Proxy Auth - Use custom_key_generate
 2024-01-22 14:21:19 -08:00
ishaan-jaff
9d34281025 (fix) spend tracking per key - when no cache hit 2024-01-22 13:18:33 -08:00
ishaan-jaff
8979b74d49 (feat) working budgets per key 2024-01-22 12:13:19 -08:00
ishaan-jaff
7ed3141c7d (feat) working create budgets per key 2024-01-22 11:58:20 -08:00
Krrish Dholakia
e2831e9c80 fix: fix proxy logging 2024-01-20 18:22:45 -08:00
Krrish Dholakia
09b7235b31 fix: support info level logging on pkg + proxy 2024-01-20 17:45:47 -08:00
Krrish Dholakia
3e5b743b89 fix(caching.py): add logging module support for caching 2024-01-20 17:34:29 -08:00
ishaan-jaff
13eb40e7bd v0 using custom_key_generate 2024-01-20 08:39:52 -08:00
Krrish Dholakia
7cf0bb475f fix(proxy_server.py): run all endpoints through custom auth 2024-01-19 20:24:33 -08:00
Krrish Dholakia
2c2163e4e5 fix(proxy_server.py): fix key info to handle pydantic v1 2024-01-19 18:52:09 -08:00
Krrish Dholakia
f5ced089d6 test(tests/): add unit testing for proxy server endpoints 2024-01-19 14:54:29 -08:00
Krrish Dholakia
c5e144af23 docs(health.md): add /health/readiness and /health/liveliness to docs 2024-01-19 08:45:23 -08:00
Ishaan Jaff
79e261f533
Merge pull request #1509 from BerriAI/litellm_track_cost_user_id_chat_completions 
[Feat] Proxy - Track Cost Per User (Using `user` passed to requests)
 2024-01-18 20:44:02 -08:00
Krrish Dholakia
f7694bc193 Merge branch 'main' into litellm_tpm_rpm_rate_limits 2024-01-18 19:10:07 -08:00
ishaan-jaff
5698be0df1 (fix) safe access litellm_params, proxy_server_request 2024-01-18 18:05:51 -08:00
ishaan-jaff
16f3d7e0ed (feat) use user_id passed to request - cost track 2024-01-18 17:51:48 -08:00
Krrish Dholakia
1e5efdfa37 fix(proxy_server.py): support setting tpm/rpm limits per user / per key 2024-01-18 17:03:18 -08:00
Ishaan Jaff
a8ba5df90e
Merge pull request #1500 from BerriAI/litellm_create_keys_with_team_id 
[Feat] /key/generate - create keys with`team_id`
 2024-01-18 16:35:14 -08:00
ishaan-jaff
340706565f (fix) add team_id to doc string 2024-01-18 15:23:05 -08:00