Commit graph

616 commits

Author SHA1 Message Date
Krrish Dholakia
35f9666dc2 feat(proxy_server.py): adds working dynamo db support for key gen 2024-01-09 18:23:34 +05:30
ishaan-jaff
ebb5490d3c (fix) prisma setup 2024-01-09 14:56:43 +05:30
ishaan-jaff
98d8dc3331 (debug) always do prisma_setup after intiialize 2024-01-09 14:26:30 +05:30
ishaan-jaff
599318b40e raise exception when prisma init fails 2024-01-09 13:36:02 +05:30
Krrish Dholakia
cd350ab8d8 fix(proxy_server.py): don't reconnect prisma if already connected 2024-01-09 11:38:42 +05:30
Krish Dholakia
e949a2ada3
Merge pull request #1367 from BerriAI/litellm_proxy_startup
fix(proxy_server.py): add support for passing in config file via worker_config directly + testing
2024-01-08 19:46:48 +05:30
Krrish Dholakia
2bcfe28ee9 fix(proxy_server.py): improve /health/readiness endpoint to give more details on connected services 2024-01-08 17:45:00 +05:30
Krrish Dholakia
8f8f961941 fix(proxy_server.py): add support for passing in config file via worker_config directly + testing 2024-01-08 16:47:15 +05:30
ishaan-jaff
fa74831d79 (docs) control proxy debug using env vars 2024-01-08 16:15:33 +05:30
ishaan-jaff
5d7646b30a (fix) proxy - show detailed_debug logs 2024-01-08 15:34:24 +05:30
ishaan-jaff
6786e4f343 (feat) allow users to opt into detailed debug on proxy 2024-01-08 12:53:41 +05:30
ishaan-jaff
f63f9d02cc (feat) use '-debug' with proxy logger 2024-01-08 10:35:49 +05:30
ishaan-jaff
119ff2fe05 (docs) show fallbacks on proxy_config 2024-01-08 08:54:10 +05:30
ishaan-jaff
7742950c57 v0 proxy logger 2024-01-08 08:25:04 +05:30
Krrish Dholakia
a7245dba07 build(Dockerfile): fixes the build time setup 2024-01-06 16:41:37 +05:30
ishaan-jaff
c222c0bfb8 (fix) proxy + cache - os.environ/ vars 2024-01-06 16:15:53 +05:30
Krish Dholakia
8d32f08858
Merge pull request #1342 from BerriAI/litellm_dockerfile_updates
build(Dockerfile): moves prisma logic to dockerfile
2024-01-06 16:03:25 +05:30
ishaan-jaff
c2b061acb2 (feat) cache+proxy - set os.environ/ on proxy config 2024-01-06 15:54:16 +05:30
Krrish Dholakia
7434f1a300 build(Dockerfile): moves prisma logic to dockerfile 2024-01-06 14:59:10 +05:30
ishaan-jaff
6011c5c8c2 (fix) undo changes that led were trying to control prisma connections 2024-01-06 14:32:40 +05:30
Krrish Dholakia
b51d98c6e3 docs: fix pip install litellm[proxy] instruction 2024-01-06 13:49:15 +05:30
Krrish Dholakia
bf56179da8 fix(proxy/utils.py): increase http connection pool for prisma 2024-01-06 13:45:30 +05:30
ishaan-jaff
250672eddc (ci/cd) temp fix - check if model_dump_json exists 2024-01-06 12:23:39 +05:30
ishaan-jaff
65ac4c1acb (ci/cd) run again 2024-01-06 11:57:31 +05:30
ishaan-jaff
357c6c56bd Revert "build(Dockerfile): move prisma build to dockerfile"
This reverts commit 2741835605.
2024-01-06 09:51:44 +05:30
ishaan-jaff
40aaac69cc (ci/cd) add print_verbose for /key/generate 2024-01-05 22:38:46 +05:30
ishaan-jaff
d9fd38ae16 (fix) revert 469ae0a 2024-01-05 22:06:39 +05:30
ishaan-jaff
41f5cb7f04 (fix) prisma set DATABASE_URL in env 2024-01-05 20:57:27 +05:30
ishaan-jaff
898c072103 (fix) proxy - self.connect() for get_data() 2024-01-05 20:48:16 +05:30
Krrish Dholakia
2741835605 build(Dockerfile): move prisma build to dockerfile
Seems to solve - https://github.com/BerriAI/litellm/issues/1321
2024-01-05 19:03:41 +05:30
ishaan-jaff
90973d92bf (fix) re-connect prisma if not connected 2024-01-05 17:58:23 +05:30
ishaan-jaff
d2578f0cd2 (ci/cd) proxy print_verbose on failing insert_data 2024-01-05 17:28:27 +05:30
ishaan-jaff
aeee8fd3da (fix) reading cache params on proxy 2024-01-05 13:36:48 +05:30
Krrish Dholakia
74f6f6489a fix(proxy_server.py): fix prisma client connection error 2024-01-04 18:28:18 +05:30
Krrish Dholakia
6b708347f3 fix(proxy_server.py): enable sending test connections when slack alerting added to proxy via ui 2024-01-04 17:00:07 +05:30
Krrish Dholakia
263d20cdd0 fix(proxy_server.py): update proxy with full model list 2024-01-04 15:56:16 +05:30
Krrish Dholakia
99d9a825de feat(proxy_server.py): abstract config update/writing and support persisting config in db
allows user to opt into writing to db (SAVE_CONFIG_TO_DB) and removes any api keys before sending to db

 https://github.com/BerriAI/litellm/issues/1322
2024-01-04 14:44:59 +05:30
ishaan-jaff
8e10a1eb81 (docs) config with cloudflare exampel 2024-01-04 10:25:35 +05:30
ishaan-jaff
30c6d164d2 (docs) use s3 Cache on litellm proxy 2024-01-03 17:56:44 +05:30
Krrish Dholakia
469ae0a378 fix(proxy/utils.py): don't keep connecting to db if connection already established 2024-01-03 17:43:44 +05:30
Krrish Dholakia
f2210787cd feat(proxy_server.py): allow admins to update config via /config/update endpoint 2024-01-03 17:18:33 +05:30
ishaan-jaff
4680a26e2e (test) proxy - load test 2024-01-03 16:16:18 +05:30
Krrish Dholakia
d45101b652 fix(proxy_server.py): fix master key reset, to preserve key from env 2024-01-03 16:10:10 +05:30
Krrish Dholakia
40c974999e fix(proxy_server.py): reject bad /model/new POST requests 2024-01-03 15:54:58 +05:30
Krrish Dholakia
b51371952b fix(proxy_server.py): handle base case for /model/info 2024-01-03 15:33:29 +05:30
Krrish Dholakia
14e501845f fix(proxy_server.py): add support for setting master key via .env 2024-01-03 15:10:25 +05:30
Krrish Dholakia
ef8f1acfa4 refactor(proxy_server.py): more debug statements 2024-01-03 13:59:41 +05:30
Krrish Dholakia
cd98d256b5 fix(proxy_server.py): add alerting for responses taking too long
https://github.com/BerriAI/litellm/issues/1298
2024-01-03 11:18:21 +05:30
Krrish Dholakia
0d13c51615 fix(proxy/utils.py): fix self.alerting null case
https://github.com/BerriAI/litellm/issues/1298#issuecomment-1874798056
2024-01-03 10:12:21 +05:30
Krrish Dholakia
070520d237 fix(proxy_server.py): support smtp email auth
previously was a hard resend package dependency. removed in favor of allowing any smtp server connection (including resend)
2024-01-02 22:22:19 +05:30