Commit graph

6070 commits

Author SHA1 Message Date
Shaun Maher
4d0e369e7a Authored a Helm chart for LiteLLM. Added GitHub workflows/actions to build and push the helm chart to the ghcr.io OCI registry. 2024-01-25 11:53:59 +11:00
Krrish Dholakia
ba24037baf bump: version 1.18.13 → 1.19.0 2024-01-24 15:30:49 -08:00
Krrish Dholakia
bb7705b494 test(test_users.py): test budgets with resets 2024-01-24 15:30:30 -08:00
Krrish Dholakia
e471157d57 test(test_keys.py): add testing to make sure budget resets are working as expected 2024-01-24 15:13:11 -08:00
Krrish Dholakia
f9d159797a fix(proxy_server.py): handle view spend logs for api key none object 2024-01-24 14:57:21 -08:00
Krish Dholakia
3e7ed4082a
Merge pull request #1600 from BerriAI/litellm_global_budget
feat(proxy_server.py): support global budget and resets
2024-01-24 14:55:36 -08:00
Krish Dholakia
ed77f2d682
Merge pull request #1590 from BerriAI/litellm_spend_logs_by_key
feat(proxy_server.py): enable returning spend logs by api key
2024-01-24 14:45:25 -08:00
Krrish Dholakia
159e54d8be feat(proxy_server.py): support global budget and resets 2024-01-24 14:27:13 -08:00
Ishaan Jaff
4dfa3f5a52
Merge pull request #1597 from BerriAI/litellm_simplify_spend_logs
[Fix] SpendLogs stop logging messages, response in SpendLogs
2024-01-24 14:02:45 -08:00
ishaan-jaff
fdcb588511 (fix) stop logging messages, response in SpendLogs 2024-01-24 13:16:34 -08:00
ishaan-jaff
63f18e7163 (fix) use get_attr for valid_token 2024-01-24 13:01:37 -08:00
ishaan-jaff
25332b4a60 (fix) LiteLLM_VerificationToken - use NULL default for max_budget 2024-01-24 12:59:50 -08:00
Ishaan Jaff
0f6ece7a7b
Merge pull request #1588 from BerriAI/litellm_spend_per_user
[Feat] [WIP] View Spend Per User
2024-01-24 12:26:12 -08:00
Ishaan Jaff
f76620b1d1
Merge branch 'main' into litellm_spend_per_user 2024-01-24 12:24:15 -08:00
ishaan-jaff
3ca82fb458 (docs) spend per user 2024-01-24 12:17:23 -08:00
ishaan-jaff
89d8d4e209 (ui) spend per user 2024-01-24 12:10:35 -08:00
ishaan-jaff
d812ae7e9a (test) spend_user_fn, spend_key_fn 2024-01-24 12:09:16 -08:00
ishaan-jaff
3d56d8ee02 (ui) view spend per user 2024-01-24 11:39:05 -08:00
ishaan-jaff
2692afca75 (feat) /spend/users endpoint 2024-01-24 11:34:28 -08:00
ishaan-jaff
1872122bfb (test) streaming spend logs test - actually run this 2024-01-24 11:27:27 -08:00
Ishaan Jaff
c356dfa08f
Merge pull request #1591 from BerriAI/litellm_test_spend_logging
[Test] Proxy - writing spend logs table
2024-01-24 11:23:53 -08:00
Krrish Dholakia
f0ada5c950 test(test_spend_logs): new endpoint test for /spend/logs 2024-01-24 11:20:31 -08:00
ishaan-jaff
3e53742a4f (test) model in SpendLogs table 2024-01-24 11:10:13 -08:00
ishaan-jaff
a842e6520c (test) setting model in SpendTable logs 2024-01-24 11:09:20 -08:00
ishaan-jaff
5e8a6fd80e (test) writing spend logs table 2024-01-24 10:56:11 -08:00
Krrish Dholakia
dd05c6e6e3 feat(proxy_server.py): enable returning spend logs by api key
https://github.com/BerriAI/litellm/issues/1582
2024-01-24 10:48:23 -08:00
ishaan-jaff
d3848b6e6c (v0) 2024-01-24 10:13:57 -08:00
Krrish Dholakia
d9fd8f28d6 docs(users.md): add docs on resetting budget at the end of duration 2024-01-24 08:34:48 -08:00
ishaan-jaff
d645c4690e (fix) UI - requirements.txt 2024-01-24 08:17:05 -08:00
ishaan-jaff
40b155f6c4 bump: version 1.18.12 → 1.18.13 2024-01-23 20:10:59 -08:00
ishaan-jaff
2d26875eb0 (fix) together_ai use sync generator 2024-01-23 20:07:26 -08:00
ishaan-jaff
fcd66eac7d (fix) add app scheduler to poetry.lock 2024-01-23 20:03:28 -08:00
ishaan-jaff
19af0cd3ed (docs) admin ui 2024-01-23 19:41:40 -08:00
ishaan-jaff
889767c5aa bump: version 1.18.11 → 1.18.12 2024-01-23 19:33:44 -08:00
ishaan-jaff
dee025b7a3 (docs) misc/cookbook - OpenAI python timeout 2024-01-23 19:31:31 -08:00
ishaan-jaff
b0902f0a8c (ci/cd) add more logging to timeout test 2024-01-23 18:39:19 -08:00
Ishaan Jaff
d00548ee5d
Merge pull request #1576 from BerriAI/litellm_map_openai_auth_errors
[Feat] Make Proxy Auth Exceptions OpenAI compatible
2024-01-23 18:32:00 -08:00
Ishaan Jaff
a0cd4e78fc
Merge branch 'main' into litellm_map_openai_auth_errors 2024-01-23 18:31:48 -08:00
Krish Dholakia
61cc8762f1
Merge pull request #1570 from BerriAI/litellm_reset_key_budget
feat(proxy/utils.py): Support keys with budget duration (resets spend on duration end)
2024-01-23 18:10:42 -08:00
Krish Dholakia
9784d03d65
Merge branch 'main' into litellm_reset_key_budget 2024-01-23 18:10:32 -08:00
Krrish Dholakia
ef760cb21c build(requirements.txt): add apscheduler to requirements 2024-01-23 17:56:11 -08:00
Krrish Dholakia
d6844f43c8 test(test_keys.py): use correct model name for token counting 2024-01-23 17:46:14 -08:00
ishaan-jaff
b3ce0ac728 (test) proxy_custom_auth use new exceptions 2024-01-23 17:36:13 -08:00
ishaan-jaff
d2675a1ff3 (test) switch dynamodb test to use new exceptions 2024-01-23 17:34:18 -08:00
ishaan-jaff
feb367bbb9 (feat) all endpoints raise OpenAI compatible exceptions 2024-01-23 17:32:47 -08:00
ishaan-jaff
37dd1114f2 (test) update prisma test 2024-01-23 17:30:01 -08:00
Krrish Dholakia
7b5e3b9934 refactor(proxy/utils.py): fix linting issue 2024-01-23 17:22:22 -08:00
Krish Dholakia
4ca4913468
Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking
[WIP] fix(utils.py): fix proxy streaming spend tracking
2024-01-23 17:07:40 -08:00
Ishaan Jaff
fdb6a7409b
Merge pull request #1575 from BerriAI/litellm_ui_view_spend
[Feat] UI view spend per API Key
2024-01-23 17:02:19 -08:00
Krish Dholakia
5defa93a9d Updated config.yml 2024-01-23 16:59:56 -08:00