phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 19:54:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
6473 commits 2497 branches 898 tags 550 MiB
Commit graph

580 commits

Author SHA1 Message Date
ishaan-jaff
52fb8c5b40 (fix) use litellm.cache for getting key 2024-01-24 18:34:22 -08:00
Krrish Dholakia
7a8f10c1c0 test(test_key_generate_prisma.py): add unit testing for global proxy budget 2024-01-24 17:43:01 -08:00
Krrish Dholakia
8518e2e2d1 fix(proxy_server.py): enforce budget limit if global proxy limit reached 2024-01-24 17:11:40 -08:00
Ishaan Jaff
6dac4ab8aa Merge pull request #1601 from BerriAI/litellm_improve_slack_alertign 
[Feat] Proxy - Improve Slack Alerting
 2024-01-24 16:43:23 -08:00
Krrish Dholakia
d536374be0 fix(proxy_server.py): track cost for global proxy 2024-01-24 16:06:10 -08:00
ishaan-jaff
2686d1f087 (fix) only alert users when requests are hanging 2024-01-24 15:58:07 -08:00
Krrish Dholakia
222ddfbd8e fix(proxy_server.py): handle view spend logs for api key none object 2024-01-24 14:57:21 -08:00
Krish Dholakia
65c971e60e Merge pull request #1600 from BerriAI/litellm_global_budget 
feat(proxy_server.py): support global budget and resets
 2024-01-24 14:55:36 -08:00
Krish Dholakia
e92cf9e6a3 Merge pull request #1590 from BerriAI/litellm_spend_logs_by_key 
feat(proxy_server.py): enable returning spend logs by api key
 2024-01-24 14:45:25 -08:00
Krrish Dholakia
f21e003f5b feat(proxy_server.py): support global budget and resets 2024-01-24 14:27:13 -08:00
ishaan-jaff
c493b5f07c (fix) use get_attr for valid_token 2024-01-24 13:01:37 -08:00
ishaan-jaff
b1c91a987a (feat) /spend/users endpoint 2024-01-24 11:34:28 -08:00
Krrish Dholakia
55344e836d feat(proxy_server.py): enable returning spend logs by api key 
https://github.com/BerriAI/litellm/issues/1582
 2024-01-24 10:48:23 -08:00
ishaan-jaff
b9e3403e8e (v0) 2024-01-24 10:13:57 -08:00
ishaan-jaff
9b3628bc4c (fix) together_ai use sync generator 2024-01-23 20:07:26 -08:00
Ishaan Jaff
85232f9b6e Merge branch 'main' into litellm_map_openai_auth_errors 2024-01-23 18:31:48 -08:00
Krish Dholakia
89e420b243 Merge branch 'main' into litellm_reset_key_budget 2024-01-23 18:10:32 -08:00
ishaan-jaff
29aa7a6c0f (feat) all endpoints raise OpenAI compatible exceptions 2024-01-23 17:32:47 -08:00
Krrish Dholakia
3cf1623727 refactor(proxy/utils.py): fix linting issue 2024-01-23 17:22:22 -08:00
Krish Dholakia
2ba8863f75 Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking 
[WIP] fix(utils.py): fix proxy streaming spend tracking
 2024-01-23 17:07:40 -08:00
ishaan-jaff
9ae3d8c243 (feat) /spend/logs 2024-01-23 16:57:51 -08:00
ishaan-jaff
97fd419cb5 (fix) add doc string for /spend/keys 2024-01-23 16:27:25 -08:00
Krrish Dholakia
a5e53271d3 fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss 
ue for spend logs
 2024-01-23 16:14:01 -08:00
Krrish Dholakia
344e232549 fix(utils.py): fix proxy streaming spend tracking 2024-01-23 15:59:03 -08:00
ishaan-jaff
9c85d05d24 (feat) add /spend/keys endpoint 2024-01-23 15:10:10 -08:00
Krrish Dholakia
88486a3123 fix(utils.py): fix streaming cost tracking 2024-01-23 14:39:45 -08:00
Krrish Dholakia
e6f05e858b feat(proxy/utils.py): enable background process to reset key budgets 2024-01-23 12:33:13 -08:00
ishaan-jaff
a045400516 (fix) select_data_generator 2024-01-23 12:13:34 -08:00
ishaan-jaff
18fceed1e0 (fix) select_data_generator - sagemaker 2024-01-23 12:08:58 -08:00
ishaan-jaff
1f229a46ad (fix) proxy - streaming sagemaker 2024-01-23 11:12:16 -08:00
Krish Dholakia
3eaae0e73c Merge pull request #1557 from BerriAI/litellm_emit_spend_logs 
feat(utils.py): emit response cost as part of logs
 2024-01-22 21:02:40 -08:00
Krrish Dholakia
579dfc3013 test: fix tests 2024-01-22 20:20:17 -08:00
Krrish Dholakia
db2b7bfd4e fix(openai.py): fix linting issue 2024-01-22 18:20:15 -08:00
Krrish Dholakia
2ea18785ca feat(utils.py): emit response cost as part of logs 2024-01-22 15:53:04 -08:00
Ishaan Jaff
742142f9bf Merge branch 'main' into litellm_budget_per_key 2024-01-22 15:49:57 -08:00
Krrish Dholakia
e423aeff85 fix: support streaming custom cost completion tracking 2024-01-22 15:15:34 -08:00
Ishaan Jaff
8ba29125be Merge pull request #1538 from BerriAI/litellm_use_custom_key_gen 
[Feat] Proxy Auth - Use custom_key_generate
 2024-01-22 14:21:19 -08:00
ishaan-jaff
b7f1ad5355 (fix) spend tracking per key - when no cache hit 2024-01-22 13:18:33 -08:00
ishaan-jaff
1ba8e703e9 (feat) working budgets per key 2024-01-22 12:13:19 -08:00
ishaan-jaff
b13e3a0b90 (feat) working create budgets per key 2024-01-22 11:58:20 -08:00
Krrish Dholakia
59483da18b fix: fix proxy logging 2024-01-20 18:22:45 -08:00
Krrish Dholakia
2acdcc6671 fix: support info level logging on pkg + proxy 2024-01-20 17:45:47 -08:00
Krrish Dholakia
a5afe5bf41 fix(caching.py): add logging module support for caching 2024-01-20 17:34:29 -08:00
ishaan-jaff
e3b605c703 v0 using custom_key_generate 2024-01-20 08:39:52 -08:00
Krrish Dholakia
d0265a4341 fix(proxy_server.py): run all endpoints through custom auth 2024-01-19 20:24:33 -08:00
Krrish Dholakia
27d2f2246e fix(proxy_server.py): fix key info to handle pydantic v1 2024-01-19 18:52:09 -08:00
Krrish Dholakia
beca1eaae7 test(tests/): add unit testing for proxy server endpoints 2024-01-19 14:54:29 -08:00
Krrish Dholakia
43d52a4657 docs(health.md): add /health/readiness and /health/liveliness to docs 2024-01-19 08:45:23 -08:00
Ishaan Jaff
fe6ac13654 Merge pull request #1509 from BerriAI/litellm_track_cost_user_id_chat_completions 
[Feat] Proxy - Track Cost Per User (Using `user` passed to requests)
 2024-01-18 20:44:02 -08:00
Krrish Dholakia
164a132751 Merge branch 'main' into litellm_tpm_rpm_rate_limits 2024-01-18 19:10:07 -08:00