phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-28 04:04:31 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
9598 commits 2497 branches 898 tags 558 MiB
Commit graph

1652 commits

Author SHA1 Message Date
Ishaan Jaff
c0ef9b1e84 ui - new build 2024-04-04 17:36:26 -07:00
Ishaan Jaff
1c51e17205 ui show spend per tag 2024-04-04 16:57:45 -07:00
Ishaan Jaff
a613d5183a Merge pull request #2840 from BerriAI/litellm_return_cache_key_responses 
[FEAT] Proxy - Delete Cache Keys + return cache key in responses
 2024-04-04 11:52:52 -07:00
Ishaan Jaff
f8fe8c787a return cache key in streming responses 2024-04-04 11:00:00 -07:00
Ishaan Jaff
a515441ad1 feat - delete cache key 2024-04-04 10:56:47 -07:00
Krrish Dholakia
0716526c53 fix(proxy_server.py): fix linting error 2024-04-04 10:40:32 -07:00
Ishaan Jaff
d0977d61ff v0 return cache key in responses 2024-04-04 10:11:18 -07:00
Krrish Dholakia
1216e1c3c3 test(test_models.py): fix delete model test 2024-04-04 08:46:08 -07:00
Krish Dholakia
a2dd945bd4 Merge pull request #2827 from BerriAI/litellm_model_add_api 
fix(proxy_server.py): persist models added via `/model/new` to db
 2024-04-03 23:30:39 -07:00
Krrish Dholakia
ec29f44c1f fix: raise correct error 2024-04-03 22:37:51 -07:00
Ishaan Jaff
fc7097beed (ui) new ui build 2024-04-03 21:01:25 -07:00
Krish Dholakia
b01e1c24df Merge branch 'main' into litellm_model_add_api 2024-04-03 20:29:44 -07:00
Krrish Dholakia
db9f674937 build(schema.prisma): add proxy model table to prisma schema 2024-04-03 20:17:38 -07:00
Krrish Dholakia
129bb52e9d fix(proxy_server.py): persist models added via /model/new to db 
allows models to be used across instances

https://github.com/BerriAI/litellm/issues/2319 , https://github.com/BerriAI/litellm/issues/2329
 2024-04-03 20:16:41 -07:00
Ishaan Jaff
984a08a500 ui - new build 2024-04-03 19:42:26 -07:00
Ishaan Jaff
13c1130d90 fix team update bug 2024-04-03 19:38:07 -07:00
Krrish Dholakia
5fe8aa27d1 feat(prometheus.py): track team based metrics on prometheus 2024-04-03 13:43:21 -07:00
Krrish Dholakia
f3fcfe3007 fix(proxy_server.py): return original model response via response headers - /v1/completions 
to help devs with debugging
 2024-04-03 13:05:43 -07:00
Krrish Dholakia
2d0c450079 fix(proxy_cli.py): revert db timeout change - user-controllable param 
db timeout is a user controllable param, not necessary to change defaults
 2024-04-03 09:37:57 -07:00
Krrish Dholakia
895073e68a fix(proxy_server.py): bump default db timeouts 2024-04-03 09:35:08 -07:00
Krrish Dholakia
96e0078b3a fix(_types.py): make /metrics public 2024-04-03 09:17:40 -07:00
Ishaan Jaff
8117fd6364 Merge pull request #2816 from BerriAI/litellm_ui_fix_viewing_spend 
UI Bug fix - Unable to generate keys / start UI
 2024-04-03 07:57:58 -07:00
Krrish Dholakia
71b8a60d14 fix(proxy_server.py): support calling public endpoints when jwt_auth is enabled 2024-04-03 07:56:53 -07:00
Ishaan Jaff
f990984bf0 new ui build 2024-04-03 07:56:29 -07:00
Ishaan Jaff
b47de20862 new ui build 2024-04-02 21:49:36 -07:00
Ishaan Jaff
a46179947e fix safe use token id 2024-04-02 21:40:35 -07:00
Ishaan Jaff
734c4fba3b v0 use token_in /key_generate 2024-04-02 21:31:24 -07:00
Ishaan Jaff
ec1ba2e216 proxy test all-tea-models 2024-04-02 20:50:47 -07:00
Krrish Dholakia
029ee15951 perf(proxy_server.py): batch write spend logs 
reduces prisma client errors, by batch writing spend logs - max 1k logs at a time
 2024-04-02 18:46:55 -07:00
Ishaan Jaff
6534f887cc support all-proxy-models for teams 2024-04-02 16:04:09 -07:00
Ishaan Jaff
857a7c9135 support all-models-on-proxy 2024-04-02 15:52:54 -07:00
Ishaan Jaff
78edb29a29 (fix) support all-models alias on backend 2024-04-02 15:12:37 -07:00
Ishaan Jaff
60e449f03c fix show correct team based usage 2024-04-02 13:43:33 -07:00
Ishaan Jaff
07821e213a fix left join on litellm team table 2024-04-02 13:36:22 -07:00
Ishaan Jaff
dc4741a58b Merge pull request #2795 from BerriAI/ui_edit_keys 
[UI] Edit Keys
 2024-04-02 12:59:01 -07:00
Ishaan Jaff
119af72183 new ui build 2024-04-02 12:58:31 -07:00
Krish Dholakia
6a1e08125c Merge pull request #2789 from BerriAI/litellm_set_ttl 
fix(proxy_server.py): allow user to set in-memory + redis ttl
 2024-04-02 08:53:34 -07:00
Ishaan Jaff
c2b9799e42 Merge pull request #2788 from BerriAI/litellm_support_-_models 
[Feat] Allow using model = * on proxy config.yaml
 2024-04-01 19:46:50 -07:00
Krish Dholakia
6d3bee777e Merge pull request #2787 from BerriAI/litellm_optional_team_jwt_claim 
fix(proxy_server.py): don't require scope for team-based jwt access
 2024-04-01 19:16:39 -07:00
Krrish Dholakia
74a943bc62 fix(proxy_server.py): fix cache param arg name 2024-04-01 19:14:39 -07:00
Krrish Dholakia
aa5f88ec45 fix(proxy_server.py): allow user to set in-memory + redis ttl 
addresses - https://github.com/BerriAI/litellm/issues/2700
 2024-04-01 19:13:23 -07:00
Ishaan Jaff
716fcd3ec4 (fix) allow wildcard models 2024-04-01 19:07:05 -07:00
Krrish Dholakia
abf87fe448 fix(proxy_server.py): don't require scope for team-based jwt access 
If team with the client_id exists then it should be allowed to make a request, if it doesn't then as we discussed it should return an error
 2024-04-01 18:52:00 -07:00
Ishaan Jaff
96d7377824 Merge pull request #2785 from BerriAI/litellm_high_traffic_redis_caching_fixes 
[Feat] Proxy - high traffic redis caching - when using `url`
 2024-04-01 18:38:27 -07:00
Krrish Dholakia
e06d43dc90 fix(tpm_rpm_limiter.py): fix cache init logic 2024-04-01 18:01:38 -07:00
Ishaan Jaff
86ba03e08a add /cache/redis/info endpoint 2024-04-01 16:51:23 -07:00
Krrish Dholakia
8d35e659ad fix(proxy/utils.py): support redis caching for alerting 2024-04-01 16:13:59 -07:00
Krrish Dholakia
91120df3f7 docs(openai.md): fix docs to include example of calling openai on proxy 2024-04-01 12:09:22 -07:00
Ishaan Jaff
aff63e556c (fix) _update_end_user_cache 2024-04-01 11:18:00 -07:00
Krrish Dholakia
f68658b2da test(test_max_tpm_rpm_limiter.py): add unit testing for redis namespaces working for tpm/rpm limits 2024-04-01 10:39:03 -07:00