Commit graph

1726 commits

Author SHA1 Message Date
Krrish Dholakia
8f1872eaf3 fix(proxy_server.py): allow for no models in model_list - all models passed in via /model/new 2024-04-08 16:17:52 -07:00
Ishaan Jaff
0d925a6c55
Merge pull request #2902 from BerriAI/litellm_ui_set_get_callbacks
UI view set callbacks
2024-04-08 16:08:14 -07:00
Ishaan Jaff
3ee345477e proxy - add callbacks 2024-04-08 15:59:04 -07:00
Krrish Dholakia
5d196225e1 build(ui): ui updates 2024-04-08 15:38:27 -07:00
Ishaan Jaff
de14e11d3e ui - return callbacks set on litellm 2024-04-08 15:25:11 -07:00
Krrish Dholakia
baed85c2c2 fix(proxy_server.py): add info statement 2024-04-08 15:12:56 -07:00
Krrish Dholakia
5e46432dfe docs(demo.md): fix iframe link 2024-04-08 15:11:19 -07:00
Ishaan Jaff
cb0350ef29 feat - write success callbacks to db 2024-04-08 15:03:18 -07:00
Krrish Dholakia
009f548079 fix(proxy_server.py): allow /model/new feature flag to work via env 2024-04-08 14:57:19 -07:00
Krrish Dholakia
48bfc45cb0 fix(utils.py): fix reordering of items for cached embeddings
ensures cached embedding item is returned in correct order
2024-04-08 12:18:24 -07:00
Ishaan Jaff
28e4706bfd test - re-order embedding responses 2024-04-08 12:02:40 -07:00
Krrish Dholakia
6110d32b1c feat(proxy/utils.py): return api base for request hanging alerts 2024-04-06 15:58:53 -07:00
Krish Dholakia
1790869739
Merge pull request #2870 from BerriAI/litellm_ui_fixes
feat(prisma.schema): UI improvements for tracking spend for users
2024-04-05 18:42:41 -07:00
Krrish Dholakia
cff2a8324e build(ui): fix pagination tab 2024-04-05 18:19:30 -07:00
Krrish Dholakia
e8675e6394 build(ui): on success model create message 2024-04-05 17:29:54 -07:00
Krrish Dholakia
5197c2294a build(ui): fix required field error on model create ui
don’t console log api key
2024-04-05 17:25:36 -07:00
Krrish Dholakia
11186d6ab4 build(schema.prisma): add user alias to prisma schema 2024-04-05 17:06:30 -07:00
Krrish Dholakia
5d1a813b66 feat(prisma.schema): allow setting user_alias 2024-04-05 17:04:14 -07:00
Krrish Dholakia
7949f4849e fix(proxy_server.py): remove original response from headers - causing nginx to fail
response headers > 4kb cause nginx to fail
2024-04-05 12:36:14 -07:00
Krrish Dholakia
695eb129ad fix(router.py): fix client init for streaming timeouts 2024-04-05 12:30:15 -07:00
Krish Dholakia
24e2535441
Merge branch 'main' into litellm_add_model_api_fix 2024-04-04 19:43:52 -07:00
Krrish Dholakia
1ee78c39e9 fix(proxy_server.py): skip to next model if invalid model (raise logger.error) 2024-04-04 19:22:17 -07:00
Krrish Dholakia
fbfcd57798 fix(proxy_server.py): fix linting issue 2024-04-04 19:15:57 -07:00
Krrish Dholakia
e3c2bdef4d feat(ui): add models via ui
adds ability to add models via ui to the proxy. also fixes additional bugs around new /model/new endpoint
2024-04-04 18:56:20 -07:00
Ishaan Jaff
0b748f2eb0 ui - new build 2024-04-04 17:36:26 -07:00
Ishaan Jaff
ac5507bd84 ui show spend per tag 2024-04-04 16:57:45 -07:00
Ishaan Jaff
1119cc49a8
Merge pull request #2840 from BerriAI/litellm_return_cache_key_responses
[FEAT] Proxy - Delete Cache Keys + return cache key in responses
2024-04-04 11:52:52 -07:00
Ishaan Jaff
7e1d5c81b4 return cache key in streming responses 2024-04-04 11:00:00 -07:00
Ishaan Jaff
c4cb0afa98 feat - delete cache key 2024-04-04 10:56:47 -07:00
Krrish Dholakia
592241b4eb fix(proxy_server.py): fix linting error 2024-04-04 10:40:32 -07:00
Ishaan Jaff
9dc4127576 v0 return cache key in responses 2024-04-04 10:11:18 -07:00
Krrish Dholakia
4b56f08cbe test(test_models.py): fix delete model test 2024-04-04 08:46:08 -07:00
Krish Dholakia
0c5b8a7667
Merge pull request #2827 from BerriAI/litellm_model_add_api
fix(proxy_server.py): persist models added via `/model/new` to db
2024-04-03 23:30:39 -07:00
Krrish Dholakia
346cd1876b fix: raise correct error 2024-04-03 22:37:51 -07:00
Ishaan Jaff
23336f62af (ui) new ui build 2024-04-03 21:01:25 -07:00
Krish Dholakia
6bc48d7e8d
Merge branch 'main' into litellm_model_add_api 2024-04-03 20:29:44 -07:00
Krrish Dholakia
5fb46cf32e build(schema.prisma): add proxy model table to prisma schema 2024-04-03 20:17:38 -07:00
Krrish Dholakia
f536fb13e6 fix(proxy_server.py): persist models added via /model/new to db
allows models to be used across instances

https://github.com/BerriAI/litellm/issues/2319 , https://github.com/BerriAI/litellm/issues/2329
2024-04-03 20:16:41 -07:00
Ishaan Jaff
8207956982 ui - new build 2024-04-03 19:42:26 -07:00
Ishaan Jaff
6edaaa92ab fix team update bug 2024-04-03 19:38:07 -07:00
Krrish Dholakia
fcaa452ccd feat(prometheus.py): track team based metrics on prometheus 2024-04-03 13:43:21 -07:00
Krrish Dholakia
15e0099948 fix(proxy_server.py): return original model response via response headers - /v1/completions
to help devs with debugging
2024-04-03 13:05:43 -07:00
Krrish Dholakia
6d32323e3d fix(proxy_cli.py): revert db timeout change - user-controllable param
db timeout is a user controllable param, not necessary to change defaults
2024-04-03 09:37:57 -07:00
Krrish Dholakia
f07500c5ea fix(proxy_server.py): bump default db timeouts 2024-04-03 09:35:08 -07:00
Krrish Dholakia
2559d46c9d fix(_types.py): make /metrics public 2024-04-03 09:17:40 -07:00
Ishaan Jaff
d7fda60889
Merge pull request #2816 from BerriAI/litellm_ui_fix_viewing_spend
UI Bug fix - Unable to generate keys / start UI
2024-04-03 07:57:58 -07:00
Krrish Dholakia
8f24202c83 fix(proxy_server.py): support calling public endpoints when jwt_auth is enabled 2024-04-03 07:56:53 -07:00
Ishaan Jaff
51d6e94cee new ui build 2024-04-03 07:56:29 -07:00
Ishaan Jaff
2d2f570847 new ui build 2024-04-02 21:49:36 -07:00
Ishaan Jaff
8a8233e428 fix safe use token id 2024-04-02 21:40:35 -07:00