Commit graph

1279 commits

Author SHA1 Message Date
Ishaan Jaff
47c2e769e1 feat - test langfuse /health/service 2024-04-13 13:42:49 -07:00
Ishaan Jaff
8d7d0cf354 feat - load proxy models on proxy startup events 2024-04-13 13:28:58 -07:00
zJ
6423392a99 set model_id in db correctly on add 2024-04-13 19:23:14 +02:00
Krish Dholakia
f167f8d732 Merge pull request #2996 from BerriAI/litellm_semaphores
fix(router.py): initial commit for semaphores on router
2024-04-12 23:23:36 -07:00
Ishaan Jaff
be1e88bead fix - proxy /health checks 2024-04-12 20:30:15 -07:00
Ishaan Jaff
0e2bd57e94 fix - use copy.deepcopy on /model/info endpoints 2024-04-12 20:17:11 -07:00
Krrish Dholakia
87c621d726 fix(router.py): initial commit for semaphores on router 2024-04-12 17:59:05 -07:00
Krrish Dholakia
aa5da4346a fix(proxy_server.py): support tracking org spend
currently works when org set for jwt auth
2024-04-11 23:01:21 -07:00
Krish Dholakia
de9258e700 Merge pull request #2970 from BerriAI/litellm_keys
fix(handle_jwt.py): User cost tracking via JWT Auth
2024-04-11 21:44:15 -07:00
Krrish Dholakia
9d9426c291 test(test_jwt.py): add testing to make sure user api key auth returns the expected values 2024-04-11 20:18:55 -07:00
Krrish Dholakia
4b2d13322e feat(proxy_server.py): support cost tracking on user id via JWT-Auth
allows admin to track cost for LiteLLM_UserTable via JWT
2024-04-11 18:47:46 -07:00
Ishaan Jaff
bf92926bf9 fix - delete updated keys from cache 2024-04-11 17:21:44 -07:00
Ishaan Jaff
19f872e6ff fix - better debugging for adding new models 2024-04-11 14:49:00 -07:00
Ishaan Jaff
ec69c3434d fix - issue when loading models through ui 2024-04-11 13:06:10 -07:00
Ishaan Jaff
2607c43181 UI - add /fallback/login route 2024-04-11 11:20:41 -07:00
Ishaan Jaff
14a8dbeb80 security fix - disable demo accounts 2024-04-11 07:40:34 -07:00
Krish Dholakia
a1457df6a9 Merge pull request #2945 from ushuz/hotfix
Fix image generation pre call hook call type
2024-04-10 21:53:00 -07:00
Krish Dholakia
e48cc9f1e4 Merge pull request #2942 from BerriAI/litellm_fix_router_loading
Router Async Improvements
2024-04-10 20:16:53 -07:00
Ishaan Jaff
3991eba44e fix - setting env vars on proxy 2024-04-10 17:50:28 -07:00
John HU
afa323f783 Fix image generation pre call hook call type 2024-04-11 00:18:35 +00:00
Ishaan Jaff
f55b182ff3 fix - error on setting env vars 2024-04-10 14:15:40 -07:00
Ishaan Jaff
a26c5cd80d fix- user not allowed to access key info 2024-04-10 14:01:03 -07:00
Ishaan Jaff
ac3508d5de fix - error user not allowed to access info 2024-04-10 13:34:22 -07:00
Krrish Dholakia
06a0ca1e80 fix(proxy_cli.py): don't double load the router config
was causing callbacks to be instantiated twice - double couting usage in cache
2024-04-10 13:23:56 -07:00
Ishaan Jaff
1379bca85a feat - set env vars on proxy 2024-04-10 11:44:27 -07:00
Krrish Dholakia
ce9ea28e42 test(test_key_generate_prisma.py): add better unit testing for spend logs on proxy server 2024-04-09 17:58:18 -07:00
Krrish Dholakia
ab63058745 fix(proxy_server.py): fixes logging to spend logs db url 2024-04-09 17:38:48 -07:00
Krrish Dholakia
501bab9c53 fix(proxy_server.py): fix sso callback check to work for user email 2024-04-09 14:50:39 -07:00
Krrish Dholakia
d3ffb22773 fix(proxy_server.py): allow 'upperbound_key_generate' params to be set via 'os.environ/' 2024-04-09 07:48:29 -07:00
Krrish Dholakia
57b4536159 fix(proxy_server.py): raise exception if max user value > max value set in config 2024-04-09 07:34:34 -07:00
Ishaan Jaff
31e0563036 Merge pull request #2912 from BerriAI/litellm_ui_qa
[UI] QA Improvements to adding callbacks, models
2024-04-09 07:34:05 -07:00
Ishaan Jaff
37f565ccc4 instantly add deployment on /model/new 2024-04-09 07:32:24 -07:00
Krrish Dholakia
4521112aeb fix(proxy_server.py): allow jwt public key ttl to be passed as os.environ 2024-04-09 07:23:13 -07:00
Ishaan Jaff
203c22c50f fix - ui qa 2024-04-09 07:19:27 -07:00
Krish Dholakia
d81582a2c6 Merge pull request #2907 from BerriAI/litellm_map_user_to_org
fix(proxy_server.py): allow mapping a user to an org
2024-04-08 20:50:47 -07:00
Krrish Dholakia
da216c6915 fix(proxy_server.py): allow mapping a user to an org 2024-04-08 20:45:11 -07:00
Ishaan Jaff
dd7ee63631 ui - new build 2024-04-08 20:43:28 -07:00
Ishaan Jaff
a3a21a1e8d feat - add slack webhooks 2024-04-08 20:11:48 -07:00
Ishaan Jaff
a48e79a6f7 dynamically set litellm callbacks 2024-04-08 18:13:13 -07:00
Krrish Dholakia
e264c88462 build(ui): fix navbar 2024-04-08 17:51:17 -07:00
Krrish Dholakia
54959cd234 fix(proxy_server.py): add more detailed debugging 2024-04-08 17:37:55 -07:00
Ishaan Jaff
02407c684c Merge pull request #2903 from BerriAI/litellm_set_new_callbacks_ui
ui - add langfuse modal
2024-04-08 17:37:38 -07:00
Ishaan Jaff
0c5e3d18fb ui - set langfuse callbacks 2024-04-08 17:32:20 -07:00
Krrish Dholakia
4ef4fb80f8 fix(proxy_server.py): allow for no models in model_list - all models passed in via /model/new 2024-04-08 16:17:52 -07:00
Ishaan Jaff
491cabbe94 Merge pull request #2902 from BerriAI/litellm_ui_set_get_callbacks
UI view set callbacks
2024-04-08 16:08:14 -07:00
Ishaan Jaff
6b4c6b3d58 proxy - add callbacks 2024-04-08 15:59:04 -07:00
Ishaan Jaff
4f64f338e2 ui - return callbacks set on litellm 2024-04-08 15:25:11 -07:00
Krrish Dholakia
20991b31a2 fix(proxy_server.py): add info statement 2024-04-08 15:12:56 -07:00
Krrish Dholakia
187d53b305 docs(demo.md): fix iframe link 2024-04-08 15:11:19 -07:00
Ishaan Jaff
b1a07cb023 feat - write success callbacks to db 2024-04-08 15:03:18 -07:00