Krrish Dholakia
|
c15086073f
|
fix(proxy_server.py): allow /model/new feature flag to work via env
|
2024-04-08 14:57:19 -07:00 |
|
Krrish Dholakia
|
0dad78b53c
|
feat(proxy/utils.py): return api base for request hanging alerts
|
2024-04-06 15:58:53 -07:00 |
|
Krrish Dholakia
|
b09960b750
|
feat(prisma.schema): allow setting user_alias
|
2024-04-05 17:04:14 -07:00 |
|
Krrish Dholakia
|
3401c9c120
|
fix(proxy_server.py): remove original response from headers - causing nginx to fail
response headers > 4kb cause nginx to fail
|
2024-04-05 12:36:14 -07:00 |
|
Krish Dholakia
|
60f7168d0b
|
Merge branch 'main' into litellm_add_model_api_fix
|
2024-04-04 19:43:52 -07:00 |
|
Krrish Dholakia
|
16ef3afe7d
|
fix(proxy_server.py): skip to next model if invalid model (raise logger.error)
|
2024-04-04 19:22:17 -07:00 |
|
Krrish Dholakia
|
5bbc2f4985
|
fix(proxy_server.py): fix linting issue
|
2024-04-04 19:15:57 -07:00 |
|
Krrish Dholakia
|
ece37a4b7f
|
feat(ui): add models via ui
adds ability to add models via ui to the proxy. also fixes additional bugs around new /model/new endpoint
|
2024-04-04 18:56:20 -07:00 |
|
Ishaan Jaff
|
1c51e17205
|
ui show spend per tag
|
2024-04-04 16:57:45 -07:00 |
|
Ishaan Jaff
|
a613d5183a
|
Merge pull request #2840 from BerriAI/litellm_return_cache_key_responses
[FEAT] Proxy - Delete Cache Keys + return cache key in responses
|
2024-04-04 11:52:52 -07:00 |
|
Ishaan Jaff
|
f8fe8c787a
|
return cache key in streming responses
|
2024-04-04 11:00:00 -07:00 |
|
Ishaan Jaff
|
a515441ad1
|
feat - delete cache key
|
2024-04-04 10:56:47 -07:00 |
|
Krrish Dholakia
|
0716526c53
|
fix(proxy_server.py): fix linting error
|
2024-04-04 10:40:32 -07:00 |
|
Ishaan Jaff
|
d0977d61ff
|
v0 return cache key in responses
|
2024-04-04 10:11:18 -07:00 |
|
Krrish Dholakia
|
1216e1c3c3
|
test(test_models.py): fix delete model test
|
2024-04-04 08:46:08 -07:00 |
|
Krrish Dholakia
|
ec29f44c1f
|
fix: raise correct error
|
2024-04-03 22:37:51 -07:00 |
|
Krish Dholakia
|
b01e1c24df
|
Merge branch 'main' into litellm_model_add_api
|
2024-04-03 20:29:44 -07:00 |
|
Krrish Dholakia
|
129bb52e9d
|
fix(proxy_server.py): persist models added via /model/new to db
allows models to be used across instances
https://github.com/BerriAI/litellm/issues/2319 , https://github.com/BerriAI/litellm/issues/2329
|
2024-04-03 20:16:41 -07:00 |
|
Ishaan Jaff
|
13c1130d90
|
fix team update bug
|
2024-04-03 19:38:07 -07:00 |
|
Krrish Dholakia
|
f3fcfe3007
|
fix(proxy_server.py): return original model response via response headers - /v1/completions
to help devs with debugging
|
2024-04-03 13:05:43 -07:00 |
|
Krrish Dholakia
|
71b8a60d14
|
fix(proxy_server.py): support calling public endpoints when jwt_auth is enabled
|
2024-04-03 07:56:53 -07:00 |
|
Ishaan Jaff
|
a46179947e
|
fix safe use token id
|
2024-04-02 21:40:35 -07:00 |
|
Ishaan Jaff
|
734c4fba3b
|
v0 use token_in /key_generate
|
2024-04-02 21:31:24 -07:00 |
|
Ishaan Jaff
|
ec1ba2e216
|
proxy test all-tea-models
|
2024-04-02 20:50:47 -07:00 |
|
Krrish Dholakia
|
029ee15951
|
perf(proxy_server.py): batch write spend logs
reduces prisma client errors, by batch writing spend logs - max 1k logs at a time
|
2024-04-02 18:46:55 -07:00 |
|
Ishaan Jaff
|
6534f887cc
|
support all-proxy-models for teams
|
2024-04-02 16:04:09 -07:00 |
|
Ishaan Jaff
|
857a7c9135
|
support all-models-on-proxy
|
2024-04-02 15:52:54 -07:00 |
|
Ishaan Jaff
|
78edb29a29
|
(fix) support all-models alias on backend
|
2024-04-02 15:12:37 -07:00 |
|
Ishaan Jaff
|
60e449f03c
|
fix show correct team based usage
|
2024-04-02 13:43:33 -07:00 |
|
Ishaan Jaff
|
07821e213a
|
fix left join on litellm team table
|
2024-04-02 13:36:22 -07:00 |
|
Krish Dholakia
|
6a1e08125c
|
Merge pull request #2789 from BerriAI/litellm_set_ttl
fix(proxy_server.py): allow user to set in-memory + redis ttl
|
2024-04-02 08:53:34 -07:00 |
|
Ishaan Jaff
|
c2b9799e42
|
Merge pull request #2788 from BerriAI/litellm_support_-_models
[Feat] Allow using model = * on proxy config.yaml
|
2024-04-01 19:46:50 -07:00 |
|
Krish Dholakia
|
6d3bee777e
|
Merge pull request #2787 from BerriAI/litellm_optional_team_jwt_claim
fix(proxy_server.py): don't require scope for team-based jwt access
|
2024-04-01 19:16:39 -07:00 |
|
Krrish Dholakia
|
74a943bc62
|
fix(proxy_server.py): fix cache param arg name
|
2024-04-01 19:14:39 -07:00 |
|
Krrish Dholakia
|
aa5f88ec45
|
fix(proxy_server.py): allow user to set in-memory + redis ttl
addresses - https://github.com/BerriAI/litellm/issues/2700
|
2024-04-01 19:13:23 -07:00 |
|
Ishaan Jaff
|
716fcd3ec4
|
(fix) allow wildcard models
|
2024-04-01 19:07:05 -07:00 |
|
Krrish Dholakia
|
abf87fe448
|
fix(proxy_server.py): don't require scope for team-based jwt access
If team with the client_id exists then it should be allowed to make a request, if it doesn't then as we discussed it should return an error
|
2024-04-01 18:52:00 -07:00 |
|
Ishaan Jaff
|
96d7377824
|
Merge pull request #2785 from BerriAI/litellm_high_traffic_redis_caching_fixes
[Feat] Proxy - high traffic redis caching - when using `url`
|
2024-04-01 18:38:27 -07:00 |
|
Krrish Dholakia
|
e06d43dc90
|
fix(tpm_rpm_limiter.py): fix cache init logic
|
2024-04-01 18:01:38 -07:00 |
|
Ishaan Jaff
|
86ba03e08a
|
add /cache/redis/info endpoint
|
2024-04-01 16:51:23 -07:00 |
|
Ishaan Jaff
|
aff63e556c
|
(fix) _update_end_user_cache
|
2024-04-01 11:18:00 -07:00 |
|
Krrish Dholakia
|
f68658b2da
|
test(test_max_tpm_rpm_limiter.py): add unit testing for redis namespaces working for tpm/rpm limits
|
2024-04-01 10:39:03 -07:00 |
|
Krish Dholakia
|
f635d15c2b
|
Merge pull request #2775 from BerriAI/litellm_redis_user_api_key_cache_v3
fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams
|
2024-03-30 22:07:05 -07:00 |
|
Krrish Dholakia
|
555f0af027
|
fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams
allows tpm/rpm checks to work across instances
https://github.com/BerriAI/litellm/issues/2730
|
2024-03-30 20:01:36 -07:00 |
|
Ishaan Jaff
|
e1f3634855
|
(ui) show proxy spend
|
2024-03-30 14:02:43 -07:00 |
|
Ishaan Jaff
|
9e0e389109
|
(ui) view spend by team name on usage
|
2024-03-30 13:25:32 -07:00 |
|
Krrish Dholakia
|
67f6f8871d
|
fix(proxy_server.py): support azure openai text completion calls
|
2024-03-30 11:30:06 -07:00 |
|
Krrish Dholakia
|
cda0c49b20
|
fix(proxy_server.py): fix /key/update endpoint to update key duration
also adds a test for this to our ci/cd
|
2024-03-29 21:47:10 -07:00 |
|
Krish Dholakia
|
6394a001a2
|
Merge pull request #2757 from BerriAI/litellm_fix_budget_alerts
fix(auth_checks.py): make global spend checks more accurate
|
2024-03-29 21:13:27 -07:00 |
|
Krrish Dholakia
|
5ad1251b4b
|
docs(proxy_server.py): fix example on swagger for team member delete
|
2024-03-29 20:09:54 -07:00 |
|