Krrish Dholakia
|
813fb19620
|
fix: support async redis caching
|
2024-01-12 21:46:41 +05:30 |
|
Krrish Dholakia
|
3028d0f622
|
feat(proxy_cli.py): move print statements to show actually deployed port
|
2024-01-10 22:09:58 +05:30 |
|
ishaan-jaff
|
5e53ed8178
|
(fix) import gunicorn
|
2024-01-10 17:47:34 +05:30 |
|
ishaan-jaff
|
829e750566
|
(fix) prisma setup
|
2024-01-09 14:56:43 +05:30 |
|
ishaan-jaff
|
588b2483c6
|
(debug) always do prisma_setup after intiialize
|
2024-01-09 14:26:30 +05:30 |
|
ishaan-jaff
|
ee52fee331
|
raise exception when prisma init fails
|
2024-01-09 13:36:02 +05:30 |
|
Krrish Dholakia
|
7f9808be56
|
fix(proxy_server.py): don't reconnect prisma if already connected
|
2024-01-09 11:38:42 +05:30 |
|
Krish Dholakia
|
28a5e17e73
|
Merge pull request #1367 from BerriAI/litellm_proxy_startup
fix(proxy_server.py): add support for passing in config file via worker_config directly + testing
|
2024-01-08 19:46:48 +05:30 |
|
Krrish Dholakia
|
e99fe07ae0
|
fix(proxy_server.py): improve /health/readiness endpoint to give more details on connected services
|
2024-01-08 17:45:00 +05:30 |
|
Krrish Dholakia
|
10f05ad9a4
|
fix(proxy_server.py): add support for passing in config file via worker_config directly + testing
|
2024-01-08 16:47:15 +05:30 |
|
ishaan-jaff
|
c9324e9df9
|
(docs) control proxy debug using env vars
|
2024-01-08 16:15:33 +05:30 |
|
ishaan-jaff
|
4192d93f8a
|
(fix) proxy - show detailed_debug logs
|
2024-01-08 15:34:24 +05:30 |
|
ishaan-jaff
|
729637e2ad
|
(feat) allow users to opt into detailed debug on proxy
|
2024-01-08 12:53:41 +05:30 |
|
ishaan-jaff
|
5477b01490
|
(feat) use '-debug' with proxy logger
|
2024-01-08 10:35:49 +05:30 |
|
ishaan-jaff
|
0a5f8d564b
|
v0 proxy logger
|
2024-01-08 08:25:04 +05:30 |
|
Krrish Dholakia
|
b89dac5b78
|
build(Dockerfile): fixes the build time setup
|
2024-01-06 16:41:37 +05:30 |
|
ishaan-jaff
|
db37f925ef
|
(fix) proxy + cache - os.environ/ vars
|
2024-01-06 16:15:53 +05:30 |
|
Krish Dholakia
|
8cfae7bb1a
|
Merge pull request #1342 from BerriAI/litellm_dockerfile_updates
build(Dockerfile): moves prisma logic to dockerfile
|
2024-01-06 16:03:25 +05:30 |
|
ishaan-jaff
|
d6d5a42115
|
(feat) cache+proxy - set os.environ/ on proxy config
|
2024-01-06 15:54:16 +05:30 |
|
Krrish Dholakia
|
40187ed52a
|
build(Dockerfile): moves prisma logic to dockerfile
|
2024-01-06 14:59:10 +05:30 |
|
ishaan-jaff
|
4a195f09f6
|
(fix) undo changes that led were trying to control prisma connections
|
2024-01-06 14:32:40 +05:30 |
|
Krrish Dholakia
|
f526340a5e
|
docs: fix pip install litellm[proxy] instruction
|
2024-01-06 13:49:15 +05:30 |
|
ishaan-jaff
|
973f418178
|
Revert "build(Dockerfile): move prisma build to dockerfile"
This reverts commit 2741835605.
|
2024-01-06 09:51:44 +05:30 |
|
ishaan-jaff
|
b518c5edd9
|
(ci/cd) add print_verbose for /key/generate
|
2024-01-05 22:38:46 +05:30 |
|
Krrish Dholakia
|
04dfde3fe5
|
build(Dockerfile): move prisma build to dockerfile
Seems to solve - https://github.com/BerriAI/litellm/issues/1321
|
2024-01-05 19:03:41 +05:30 |
|
ishaan-jaff
|
90042ad8ee
|
(fix) reading cache params on proxy
|
2024-01-05 13:36:48 +05:30 |
|
Krrish Dholakia
|
f3163d287c
|
fix(proxy_server.py): fix prisma client connection error
|
2024-01-04 18:28:18 +05:30 |
|
Krrish Dholakia
|
ee3f33ca00
|
fix(proxy_server.py): enable sending test connections when slack alerting added to proxy via ui
|
2024-01-04 17:00:07 +05:30 |
|
Krrish Dholakia
|
1fb856d3f4
|
fix(proxy_server.py): update proxy with full model list
|
2024-01-04 15:56:16 +05:30 |
|
Krrish Dholakia
|
5aecbced99
|
feat(proxy_server.py): abstract config update/writing and support persisting config in db
allows user to opt into writing to db (SAVE_CONFIG_TO_DB) and removes any api keys before sending to db
https://github.com/BerriAI/litellm/issues/1322
|
2024-01-04 14:44:59 +05:30 |
|
ishaan-jaff
|
7a11f5dbba
|
(docs) use s3 Cache on litellm proxy
|
2024-01-03 17:56:44 +05:30 |
|
Krrish Dholakia
|
e898f3e49c
|
fix(proxy/utils.py): don't keep connecting to db if connection already established
|
2024-01-03 17:43:44 +05:30 |
|
Krrish Dholakia
|
36c903399d
|
feat(proxy_server.py): allow admins to update config via /config/update endpoint
|
2024-01-03 17:18:33 +05:30 |
|
Krrish Dholakia
|
84c511ade2
|
fix(proxy_server.py): fix master key reset, to preserve key from env
|
2024-01-03 16:10:10 +05:30 |
|
Krrish Dholakia
|
350ff5c870
|
fix(proxy_server.py): reject bad /model/new POST requests
|
2024-01-03 15:54:58 +05:30 |
|
Krrish Dholakia
|
687feee520
|
fix(proxy_server.py): handle base case for /model/info
|
2024-01-03 15:33:29 +05:30 |
|
Krrish Dholakia
|
c998de0cde
|
fix(proxy_server.py): add support for setting master key via .env
|
2024-01-03 15:10:25 +05:30 |
|
Krrish Dholakia
|
1e3e130479
|
refactor(proxy_server.py): more debug statements
|
2024-01-03 13:59:41 +05:30 |
|
Krrish Dholakia
|
c7688a56ed
|
fix(proxy_server.py): add alerting for responses taking too long
https://github.com/BerriAI/litellm/issues/1298
|
2024-01-03 11:18:21 +05:30 |
|
Krrish Dholakia
|
901b343519
|
fix(proxy_server.py): support smtp email auth
previously was a hard resend package dependency. removed in favor of allowing any smtp server connection (including resend)
|
2024-01-02 22:22:19 +05:30 |
|
Ased Mammad
|
a0611430dd
|
fix(proxy_server.py) Check when '_hidden_params' is None
|
2024-01-02 19:04:51 +03:30 |
|
Krrish Dholakia
|
5f5a6eb7bc
|
feat(proxy_server.py): add slack alerting to proxy server
add alerting for calls hanging, failing and db read/writes failing
https://github.com/BerriAI/litellm/issues/1298
|
2024-01-02 17:45:18 +05:30 |
|
ishaan-jaff
|
7d9ff31a95
|
(feat) proxy swagger - make admin link clickable
|
2024-01-02 17:04:32 +05:30 |
|
ishaan-jaff
|
e1c121737c
|
(feat) use - user router for aembedding
|
2024-01-02 12:27:08 +05:30 |
|
ishaan-jaff
|
dc5984c41d
|
(feat) proxy - use user_config for /chat/compeltions
|
2024-01-02 12:10:34 +05:30 |
|
Krrish Dholakia
|
4c4e8d0290
|
build(user.py): fix page param read issue
|
2024-01-01 17:25:52 +05:30 |
|
Krrish Dholakia
|
81bb382f98
|
fix(proxy_server.py): enabling user auth via ui
https://github.com/BerriAI/litellm/issues/1231
|
2024-01-01 17:14:24 +05:30 |
|
Krrish Dholakia
|
dcfcf99d63
|
fix(proxy_server.py): check if user email in user db
|
2024-01-01 14:19:59 +05:30 |
|
ishaan-jaff
|
e599c1655f
|
(feat) proxy - only use print_verbose
|
2024-01-01 13:52:11 +05:30 |
|
Krrish Dholakia
|
b9e6379977
|
feat(proxy_server.py): introduces new /user/auth endpoint for handling user email auth
decouples streamlit ui from proxy server. this then requires the proxy to handle user auth separately.
|
2024-01-01 13:44:47 +05:30 |
|