Ishaan Jaff
|
73ef4780f7
|
(fix) support all-models alias on backend
|
2024-04-02 15:12:37 -07:00 |
|
Ishaan Jaff
|
3d32567f4c
|
fix show correct team based usage
|
2024-04-02 13:43:33 -07:00 |
|
Ishaan Jaff
|
327cf73d73
|
fix left join on litellm team table
|
2024-04-02 13:36:22 -07:00 |
|
Krish Dholakia
|
7233e5ab25
|
Merge pull request #2789 from BerriAI/litellm_set_ttl
fix(proxy_server.py): allow user to set in-memory + redis ttl
|
2024-04-02 08:53:34 -07:00 |
|
Ishaan Jaff
|
92984a1c6f
|
Merge pull request #2788 from BerriAI/litellm_support_-_models
[Feat] Allow using model = * on proxy config.yaml
|
2024-04-01 19:46:50 -07:00 |
|
Krish Dholakia
|
da85384649
|
Merge pull request #2787 from BerriAI/litellm_optional_team_jwt_claim
fix(proxy_server.py): don't require scope for team-based jwt access
|
2024-04-01 19:16:39 -07:00 |
|
Krrish Dholakia
|
c096ba566f
|
fix(proxy_server.py): fix cache param arg name
|
2024-04-01 19:14:39 -07:00 |
|
Krrish Dholakia
|
203e2776f8
|
fix(proxy_server.py): allow user to set in-memory + redis ttl
addresses - https://github.com/BerriAI/litellm/issues/2700
|
2024-04-01 19:13:23 -07:00 |
|
Ishaan Jaff
|
037b624c89
|
(fix) allow wildcard models
|
2024-04-01 19:07:05 -07:00 |
|
Krrish Dholakia
|
c52819d47c
|
fix(proxy_server.py): don't require scope for team-based jwt access
If team with the client_id exists then it should be allowed to make a request, if it doesn't then as we discussed it should return an error
|
2024-04-01 18:52:00 -07:00 |
|
Ishaan Jaff
|
b14b6083f5
|
Merge pull request #2785 from BerriAI/litellm_high_traffic_redis_caching_fixes
[Feat] Proxy - high traffic redis caching - when using `url`
|
2024-04-01 18:38:27 -07:00 |
|
Krrish Dholakia
|
6467dd4e11
|
fix(tpm_rpm_limiter.py): fix cache init logic
|
2024-04-01 18:01:38 -07:00 |
|
Ishaan Jaff
|
9accc544e9
|
add /cache/redis/info endpoint
|
2024-04-01 16:51:23 -07:00 |
|
Ishaan Jaff
|
d5d800e141
|
(fix) _update_end_user_cache
|
2024-04-01 11:18:00 -07:00 |
|
Krrish Dholakia
|
c9e6b05cfb
|
test(test_max_tpm_rpm_limiter.py): add unit testing for redis namespaces working for tpm/rpm limits
|
2024-04-01 10:39:03 -07:00 |
|
Krish Dholakia
|
1356f6cd32
|
Merge pull request #2775 from BerriAI/litellm_redis_user_api_key_cache_v3
fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams
|
2024-03-30 22:07:05 -07:00 |
|
Krrish Dholakia
|
f58fefd589
|
fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams
allows tpm/rpm checks to work across instances
https://github.com/BerriAI/litellm/issues/2730
|
2024-03-30 20:01:36 -07:00 |
|
Ishaan Jaff
|
23a18d4be3
|
(ui) show proxy spend
|
2024-03-30 14:02:43 -07:00 |
|
Ishaan Jaff
|
8daca76566
|
(ui) view spend by team name on usage
|
2024-03-30 13:25:32 -07:00 |
|
Krrish Dholakia
|
0342cd3b6b
|
fix(proxy_server.py): support azure openai text completion calls
|
2024-03-30 11:30:06 -07:00 |
|
Krrish Dholakia
|
af2eabba91
|
fix(proxy_server.py): fix /key/update endpoint to update key duration
also adds a test for this to our ci/cd
|
2024-03-29 21:47:10 -07:00 |
|
Krish Dholakia
|
6d9887969f
|
Merge pull request #2757 from BerriAI/litellm_fix_budget_alerts
fix(auth_checks.py): make global spend checks more accurate
|
2024-03-29 21:13:27 -07:00 |
|
Krrish Dholakia
|
48ac36e70d
|
docs(proxy_server.py): fix example on swagger for team member delete
|
2024-03-29 20:09:54 -07:00 |
|
Krrish Dholakia
|
3810b050c1
|
fix(proxy_server.py): increment cached global proxy spend object
|
2024-03-29 20:02:31 -07:00 |
|
Krrish Dholakia
|
5280fc809f
|
fix(proxy_server.py): enforce end user budgets with 'litellm.max_end_user_budget' param
|
2024-03-29 17:14:40 -07:00 |
|
Krrish Dholakia
|
786116783f
|
fix(proxy_server.py): fix max budget check to also fire slack alert
|
2024-03-29 16:24:40 -07:00 |
|
Krrish Dholakia
|
be6481bb36
|
fix(proxy_server.py): fix checks
|
2024-03-29 15:34:13 -07:00 |
|
Krrish Dholakia
|
d8c15a5677
|
fix(auth_checks.py): make global spend checks more accurate
|
2024-03-29 14:57:44 -07:00 |
|
Ishaan Jaff
|
7df2d7cb33
|
(fix) show correct spend on ui
|
2024-03-29 09:41:00 -07:00 |
|
Krrish Dholakia
|
618cb2441a
|
fix(proxy_server.py): handle pydantic json versioning issue
|
2024-03-28 23:23:50 -07:00 |
|
Krrish Dholakia
|
5e55df1eaf
|
fix(proxy_server.py): fix pydantic versioning issue
|
2024-03-28 22:42:26 -07:00 |
|
Krrish Dholakia
|
5a117490ec
|
fix(proxy_server.py): fix tpm/rpm limiting for jwt auth
fixes tpm/rpm limiting for jwt auth and implements unit tests for jwt auth
|
2024-03-28 21:19:34 -07:00 |
|
Krrish Dholakia
|
c15ba368e7
|
fix(proxy_server.py): enable spend tracking for team-based jwt auth
|
2024-03-28 20:16:22 -07:00 |
|
Krrish Dholakia
|
19e43c8d29
|
fix(proxy_server.py): return deleted team id's to confirm /team/delete worked
|
2024-03-28 16:09:33 -07:00 |
|
Krrish Dholakia
|
f80b500917
|
docs(proxy_server.py): add update team TPM/RPM limit to swagger docs
|
2024-03-28 16:02:51 -07:00 |
|
Krrish Dholakia
|
58bdbecbc6
|
fix(proxy_server.py): allow updating tpm/rpm limits via /team/update
|
2024-03-28 15:59:35 -07:00 |
|
Krrish Dholakia
|
569e660a67
|
docs(proxy_server.py): improve swagger docs for /team/new
|
2024-03-28 15:50:38 -07:00 |
|
Krrish Dholakia
|
a1d0e3f4ad
|
docs(proxy_server.py): improve swagger doc for /team/new
|
2024-03-28 15:39:48 -07:00 |
|
Krrish Dholakia
|
8c9623a6bc
|
fix(proxy_server.py): fix user_id_information none check
|
2024-03-28 15:18:52 -07:00 |
|
Ishaan Jaff
|
ddba16756d
|
Merge pull request #2735 from BerriAI/admin_ui_clearly_show_models
Admin UI clearly show models
|
2024-03-28 15:14:38 -07:00 |
|
Ishaan Jaff
|
fc79e8255c
|
(fix) actually view the spend report on the UI
|
2024-03-28 15:08:21 -07:00 |
|
Krish Dholakia
|
7d3244c012
|
Merge branch 'main' into litellm_auto_create_user_fix
|
2024-03-28 14:57:39 -07:00 |
|
Krish Dholakia
|
934a9ac2b4
|
Merge pull request #2722 from BerriAI/litellm_db_perf_improvement
feat(proxy/utils.py): enable updating db in a separate server
|
2024-03-28 14:56:14 -07:00 |
|
Ishaan Jaff
|
beb72f94e0
|
(feat) return team alias in keys
|
2024-03-28 10:16:07 -07:00 |
|
Ishaan Jaff
|
7f793246c2
|
(feat) return team alias when hitting user/info
|
2024-03-28 09:41:15 -07:00 |
|
Krrish Dholakia
|
082f1e4085
|
fix(proxy_server.py): allow user to pass in spend logs collector url
|
2024-03-28 09:14:30 -07:00 |
|
Ishaan Jaff
|
4a5ce43bd5
|
(fix) raise exception when master key not set + trying to use ui
|
2024-03-27 22:25:53 -07:00 |
|
Ishaan Jaff
|
37f189935a
|
(fix) show user their role when rejecting /team/new requests
|
2024-03-27 20:54:07 -07:00 |
|
Ishaan Jaff
|
4777921a31
|
Merge pull request #2723 from BerriAI/litellm_proxy_perf_imp
[FEAT] Improve Proxy Perf - access router model names in constant time
|
2024-03-27 20:48:31 -07:00 |
|
Krrish Dholakia
|
34790c7e12
|
fix(proxy_server.py): fix linting error
|
2024-03-27 19:54:25 -07:00 |
|