Commit graph

1273 commits

Author SHA1 Message Date
Krrish Dholakia
a4e415b23c fix(router.py): initial commit for semaphores on router 2024-04-12 17:59:05 -07:00
Krrish Dholakia
f4c7f4f901 fix(proxy_server.py): support tracking org spend
currently works when org set for jwt auth
2024-04-11 23:01:21 -07:00
Krish Dholakia
d89644d46c
Merge pull request #2970 from BerriAI/litellm_keys
fix(handle_jwt.py): User cost tracking via JWT Auth
2024-04-11 21:44:15 -07:00
Krrish Dholakia
77097f8e7d test(test_jwt.py): add testing to make sure user api key auth returns the expected values 2024-04-11 20:18:55 -07:00
Krrish Dholakia
36ff593c02 feat(proxy_server.py): support cost tracking on user id via JWT-Auth
allows admin to track cost for LiteLLM_UserTable via JWT
2024-04-11 18:47:46 -07:00
Ishaan Jaff
beabec620e fix - delete updated keys from cache 2024-04-11 17:21:44 -07:00
Ishaan Jaff
68e0c93246 fix - better debugging for adding new models 2024-04-11 14:49:00 -07:00
Ishaan Jaff
fc832f2196 fix - issue when loading models through ui 2024-04-11 13:06:10 -07:00
Ishaan Jaff
7cb40d3b35 UI - add /fallback/login route 2024-04-11 11:20:41 -07:00
Ishaan Jaff
96cd038a73 security fix - disable demo accounts 2024-04-11 07:40:34 -07:00
Krish Dholakia
6749306239
Merge pull request #2945 from ushuz/hotfix
Fix image generation pre call hook call type
2024-04-10 21:53:00 -07:00
Krish Dholakia
83e7ed94ce
Merge pull request #2942 from BerriAI/litellm_fix_router_loading
Router Async Improvements
2024-04-10 20:16:53 -07:00
Ishaan Jaff
e90645bd5d fix - setting env vars on proxy 2024-04-10 17:50:28 -07:00
John HU
c9b05828ff Fix image generation pre call hook call type 2024-04-11 00:18:35 +00:00
Ishaan Jaff
c86213ac98 fix - error on setting env vars 2024-04-10 14:15:40 -07:00
Ishaan Jaff
f6fc21e917 fix- user not allowed to access key info 2024-04-10 14:01:03 -07:00
Ishaan Jaff
195840b761 fix - error user not allowed to access info 2024-04-10 13:34:22 -07:00
Krrish Dholakia
b2741933dc fix(proxy_cli.py): don't double load the router config
was causing callbacks to be instantiated twice - double couting usage in cache
2024-04-10 13:23:56 -07:00
Ishaan Jaff
25347b1f6f feat - set env vars on proxy 2024-04-10 11:44:27 -07:00
Krrish Dholakia
8857c9b978 test(test_key_generate_prisma.py): add better unit testing for spend logs on proxy server 2024-04-09 17:58:18 -07:00
Krrish Dholakia
28940c3b71 fix(proxy_server.py): fixes logging to spend logs db url 2024-04-09 17:38:48 -07:00
Krrish Dholakia
dbbf605653 fix(proxy_server.py): fix sso callback check to work for user email 2024-04-09 14:50:39 -07:00
Krrish Dholakia
df62f931e7 fix(proxy_server.py): allow 'upperbound_key_generate' params to be set via 'os.environ/' 2024-04-09 07:48:29 -07:00
Krrish Dholakia
1adabcaca2 fix(proxy_server.py): raise exception if max user value > max value set in config 2024-04-09 07:34:34 -07:00
Ishaan Jaff
6463c1ec93
Merge pull request #2912 from BerriAI/litellm_ui_qa
[UI] QA Improvements to adding callbacks, models
2024-04-09 07:34:05 -07:00
Ishaan Jaff
23ce5c2fad instantly add deployment on /model/new 2024-04-09 07:32:24 -07:00
Krrish Dholakia
0c2ae7a90e fix(proxy_server.py): allow jwt public key ttl to be passed as os.environ 2024-04-09 07:23:13 -07:00
Ishaan Jaff
bb22f0718b fix - ui qa 2024-04-09 07:19:27 -07:00
Krish Dholakia
763e92a03e
Merge pull request #2907 from BerriAI/litellm_map_user_to_org
fix(proxy_server.py): allow mapping a user to an org
2024-04-08 20:50:47 -07:00
Krrish Dholakia
6c1444bfaa fix(proxy_server.py): allow mapping a user to an org 2024-04-08 20:45:11 -07:00
Ishaan Jaff
f69e812c5f ui - new build 2024-04-08 20:43:28 -07:00
Ishaan Jaff
80694ba79b feat - add slack webhooks 2024-04-08 20:11:48 -07:00
Ishaan Jaff
d95f3d5a23 dynamically set litellm callbacks 2024-04-08 18:13:13 -07:00
Krrish Dholakia
633bd10365 build(ui): fix navbar 2024-04-08 17:51:17 -07:00
Krrish Dholakia
e38ff06d01 fix(proxy_server.py): add more detailed debugging 2024-04-08 17:37:55 -07:00
Ishaan Jaff
2a69650e8c
Merge pull request #2903 from BerriAI/litellm_set_new_callbacks_ui
ui - add langfuse modal
2024-04-08 17:37:38 -07:00
Ishaan Jaff
90656bd203 ui - set langfuse callbacks 2024-04-08 17:32:20 -07:00
Krrish Dholakia
8f1872eaf3 fix(proxy_server.py): allow for no models in model_list - all models passed in via /model/new 2024-04-08 16:17:52 -07:00
Ishaan Jaff
0d925a6c55
Merge pull request #2902 from BerriAI/litellm_ui_set_get_callbacks
UI view set callbacks
2024-04-08 16:08:14 -07:00
Ishaan Jaff
3ee345477e proxy - add callbacks 2024-04-08 15:59:04 -07:00
Ishaan Jaff
de14e11d3e ui - return callbacks set on litellm 2024-04-08 15:25:11 -07:00
Krrish Dholakia
baed85c2c2 fix(proxy_server.py): add info statement 2024-04-08 15:12:56 -07:00
Krrish Dholakia
5e46432dfe docs(demo.md): fix iframe link 2024-04-08 15:11:19 -07:00
Ishaan Jaff
cb0350ef29 feat - write success callbacks to db 2024-04-08 15:03:18 -07:00
Krrish Dholakia
009f548079 fix(proxy_server.py): allow /model/new feature flag to work via env 2024-04-08 14:57:19 -07:00
Krrish Dholakia
6110d32b1c feat(proxy/utils.py): return api base for request hanging alerts 2024-04-06 15:58:53 -07:00
Krrish Dholakia
5d1a813b66 feat(prisma.schema): allow setting user_alias 2024-04-05 17:04:14 -07:00
Krrish Dholakia
7949f4849e fix(proxy_server.py): remove original response from headers - causing nginx to fail
response headers > 4kb cause nginx to fail
2024-04-05 12:36:14 -07:00
Krish Dholakia
24e2535441
Merge branch 'main' into litellm_add_model_api_fix 2024-04-04 19:43:52 -07:00
Krrish Dholakia
1ee78c39e9 fix(proxy_server.py): skip to next model if invalid model (raise logger.error) 2024-04-04 19:22:17 -07:00