Commit graph

9378 commits

Author SHA1 Message Date
Krrish Dholakia
a1365f6035 test: cleanup 2024-04-01 07:29:56 -07:00
Krrish Dholakia
d4dd6d0cdc fix(proxy/utils.py): uncomment max parallel request limit check 2024-04-01 07:29:56 -07:00
Krrish Dholakia
aebb0e489c test: fix test 2024-04-01 07:29:56 -07:00
Krrish Dholakia
17cabf013c fix(caching.py): respect redis namespace for all redis get/set requests 2024-04-01 07:29:56 -07:00
Krrish Dholakia
583e334bd2 fix(utils.py): set redis_usage_cache to none by default 2024-04-01 07:29:56 -07:00
Krrish Dholakia
0c77f75ce9 fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams
allows tpm/rpm checks to work across instances

https://github.com/BerriAI/litellm/issues/2730
2024-04-01 07:29:56 -07:00
Krrish Dholakia
ea76c546ff docs(deploy.md): fix docs for litlelm-database docker run example 2024-04-01 07:29:56 -07:00
Ishaan Jaff
15b5cb1612 (fix) check size of data to predict 2024-04-01 07:29:56 -07:00
Ishaan Jaff
e62e83c42a (ui) dont let prediction block spend view 2024-04-01 07:29:56 -07:00
Ishaan Jaff
c365de122a check num retries in async wrapper 2024-03-30 19:33:40 -07:00
Ishaan Jaff
bd95626579 (fix) improve async perf 2024-03-30 19:07:04 -07:00
Ishaan Jaff
cdd6e79e6c Revert "bump: version 1.34.17 → 1.34.18"
This reverts commit 7e0e6bf092.
2024-03-30 18:41:29 -07:00
Ishaan Jaff
7e0e6bf092 bump: version 1.34.17 → 1.34.18 2024-03-30 14:42:11 -07:00
Ishaan Jaff
480774fd75
Merge pull request #2772 from BerriAI/ui_view_team_name_usage
[UI] view team name in usage
2024-03-30 14:40:37 -07:00
Ishaan Jaff
22a22197c7 (ui) new ui build 2024-03-30 14:38:19 -07:00
Ishaan Jaff
24ca4e310c (ui) show team based usage 2024-03-30 14:20:08 -07:00
Ishaan Jaff
23a18d4be3 (ui) show proxy spend 2024-03-30 14:02:43 -07:00
Ishaan Jaff
b76d31f9fe (ui) show top team spend 2024-03-30 14:01:05 -07:00
Ishaan Jaff
1bbdbcad7d (ui) fix models page 2024-03-30 14:00:22 -07:00
Ishaan Jaff
8daca76566 (ui) view spend by team name on usage 2024-03-30 13:25:32 -07:00
Ishaan Jaff
77b6cd01df (ui) new build 2024-03-30 12:17:07 -07:00
Ishaan Jaff
4a720f00ef
Merge pull request #2771 from BerriAI/litellm_edit_teams
[UI] Edit Teams
2024-03-30 12:15:58 -07:00
Ishaan Jaff
58cc11a312
Merge branch 'main' into litellm_edit_teams 2024-03-30 12:15:53 -07:00
Ishaan Jaff
46c9b57a29 (new) ui build 2024-03-30 12:14:43 -07:00
Ishaan Jaff
c16f2f14eb (ui) edit teams 2024-03-30 12:14:33 -07:00
Ishaan Jaff
84c5b56371 (ui) working edit team 2024-03-30 12:14:33 -07:00
Ishaan Jaff
f62b3f5d2c (ui) edit teams 2024-03-30 12:14:33 -07:00
Ishaan Jaff
4a6aa3ee61 (ui) edit teams 2024-03-30 12:14:33 -07:00
Ishaan Jaff
e6a0942780 (new) ui build 2024-03-30 12:10:25 -07:00
Ishaan Jaff
479ba9161c (ui) edit teams 2024-03-30 12:04:58 -07:00
Ishaan Jaff
fab682a957 (ui) working edit team 2024-03-30 11:51:07 -07:00
Krrish Dholakia
0342cd3b6b fix(proxy_server.py): support azure openai text completion calls 2024-03-30 11:30:06 -07:00
Krish Dholakia
2ca303ec0e
Merge pull request #2748 from BerriAI/litellm_anthropic_tool_calling_list_parsing_fix
fix(factory.py): parse list in xml tool calling response (anthropic)
2024-03-30 11:27:02 -07:00
Krrish Dholakia
ff9de34a5d bump: version 1.34.16 → 1.34.17 2024-03-30 09:04:57 -07:00
Krrish Dholakia
c0204310ee fix(main.py): fix translation to text_completions format for async text completion calls 2024-03-30 09:02:51 -07:00
Krrish Dholakia
89471ba4c5 build(model_prices_and_context_window.json): add proper bedrock mixtral model name 2024-03-30 08:37:06 -07:00
Krrish Dholakia
22d5603778 ci(config.yml): add lunary to circle ci 2024-03-29 22:09:21 -07:00
Krrish Dholakia
4826018756 docs(users.md): fix doc for end-user param 2024-03-29 21:54:07 -07:00
Krrish Dholakia
e74a15be19 bump: version 1.34.15 → 1.34.16 2024-03-29 21:48:31 -07:00
Krrish Dholakia
af2eabba91 fix(proxy_server.py): fix /key/update endpoint to update key duration
also adds a test for this to our ci/cd
2024-03-29 21:47:10 -07:00
Krrish Dholakia
68a1fa36cf fix(handle_jwt.py): fix linting issue 2024-03-29 21:35:36 -07:00
Krish Dholakia
dfd20cb155
Merge pull request #2244 from lunary-ai/main
[Feat] Update integration with Lunary
2024-03-29 21:32:01 -07:00
Vincelwt
1b84dfac91
Merge branch 'main' into main 2024-03-30 13:21:53 +09:00
Krrish Dholakia
97616ee267 bump: version 1.34.14 → 1.34.15 2024-03-29 21:16:01 -07:00
Krish Dholakia
6d9887969f
Merge pull request #2757 from BerriAI/litellm_fix_budget_alerts
fix(auth_checks.py): make global spend checks more accurate
2024-03-29 21:13:27 -07:00
Krish Dholakia
f44df7bed6
Merge pull request #2762 from jacobnguyenn/update-jwt-auth
fix: still verify kid on single pub key fetched
2024-03-29 21:08:22 -07:00
Krrish Dholakia
cbf35087c7 test(test_key_generate_prisma.py): fix test 2024-03-29 20:30:43 -07:00
Ishaan Jaff
f03d2efd43 (ui) edit teams 2024-03-29 20:20:04 -07:00
Krrish Dholakia
48ac36e70d docs(proxy_server.py): fix example on swagger for team member delete 2024-03-29 20:09:54 -07:00
phuongnd96
4bf4be3a0f
fix: still verify kid on single pub key fetched 2024-03-30 10:09:38 +07:00