Commit graph

407 commits

Author SHA1 Message Date
Krrish Dholakia
7a80df83b2 fix(proxy_server.py): handle empty insert_data response 2024-01-17 17:28:23 -08:00
Krrish Dholakia
5242200243 feat(proxy_server.py): support model access groups 2024-01-17 15:45:31 -08:00
ishaan-jaff
1af44af91f (v0) fix 2024-01-16 20:44:00 -08:00
ishaan-jaff
0011f9efa1 (ci/cd) undo change from PR 1464 2024-01-16 19:53:43 -08:00
ishaan-jaff
57af57d4e9 (fix) when budget, spend is None comparison 2024-01-16 17:35:39 -08:00
ishaan-jaff
ed93164e92 (ci/cd) fixes 2024-01-16 16:03:42 -08:00
ishaan-jaff
772547d625 (fix) proxy check expires time 2024-01-16 15:38:58 -08:00
ishaan-jaff
e8da289599 (fix) reject Auth if user crosses budget 2024-01-16 14:58:00 -08:00
ishaan-jaff
9bb5061815 (fix) check if budget crossed for api_key 2024-01-16 14:20:19 -08:00
ishaan-jaff
e1c4d3f41d (fix) improve unauthorized error message 2024-01-16 14:04:26 -08:00
ishaan-jaff
8f047df13f (fix) proxy - improve invalid models exception msg 2024-01-16 14:01:01 -08:00
ishaan-jaff
b09c982008 (feat) proxy - auth - raise Value Error when master key is None 2024-01-16 13:27:50 -08:00
ishaan-jaff
ae99784aee (fix) proxy:sagemaker, bedrock fix - num_retries=0 2024-01-15 21:18:49 -08:00
ishaan-jaff
ed2287e966 (fix) proxy + dynamo - add some debugging 2024-01-15 12:03:10 -08:00
ishaan-jaff
ebf7168af8 (feat) proxy use ProxyException clas 2024-01-15 10:45:39 -08:00
ishaan-jaff
04db5b7bbf (feat) proxy - introduce OpenAIException class 2024-01-15 09:52:23 -08:00
ishaan-jaff
c6c5bb959e (fix) run prisma_setup on startup event 2024-01-13 12:06:23 -08:00
Krrish Dholakia
61cbac6b4f fix(proxy_cli.py): only run prisma db push if prisma in environment 2024-01-13 19:44:12 +05:30
Krrish Dholakia
ae74c52a33 Merge branch 'litellm_dynamo_db_keys' 2024-01-13 18:38:43 +05:30
Krrish Dholakia
45b860d433 fix(proxy_server.py): have /user/info return user info + related user keys 2024-01-12 22:52:13 +05:30
Krrish Dholakia
ff0daf3daf fix(dynamo_db.py): don't auto-create tables, allow database_type == 'dynamodb' 2024-01-12 11:33:40 +05:30
Krrish Dholakia
135e4b6ac4 fix(dynamo_db.py): add cost tracking support for key + user 2024-01-11 23:56:41 +05:30
Krrish Dholakia
3028d0f622 feat(proxy_cli.py): move print statements to show actually deployed port 2024-01-10 22:09:58 +05:30
ishaan-jaff
5e53ed8178 (fix) import gunicorn 2024-01-10 17:47:34 +05:30
Krrish Dholakia
53f0169c39 fix: fix linting errors 2024-01-09 22:16:16 +05:30
Krrish Dholakia
00c258c165 feat(proxy_server.py): adds working dynamo db support for key gen 2024-01-09 18:23:34 +05:30
ishaan-jaff
829e750566 (fix) prisma setup 2024-01-09 14:56:43 +05:30
ishaan-jaff
588b2483c6 (debug) always do prisma_setup after intiialize 2024-01-09 14:26:30 +05:30
ishaan-jaff
ee52fee331 raise exception when prisma init fails 2024-01-09 13:36:02 +05:30
Krrish Dholakia
7f9808be56 fix(proxy_server.py): don't reconnect prisma if already connected 2024-01-09 11:38:42 +05:30
Krish Dholakia
28a5e17e73 Merge pull request #1367 from BerriAI/litellm_proxy_startup
fix(proxy_server.py): add support for passing in config file via worker_config directly + testing
2024-01-08 19:46:48 +05:30
Krrish Dholakia
e99fe07ae0 fix(proxy_server.py): improve /health/readiness endpoint to give more details on connected services 2024-01-08 17:45:00 +05:30
Krrish Dholakia
10f05ad9a4 fix(proxy_server.py): add support for passing in config file via worker_config directly + testing 2024-01-08 16:47:15 +05:30
ishaan-jaff
c9324e9df9 (docs) control proxy debug using env vars 2024-01-08 16:15:33 +05:30
ishaan-jaff
4192d93f8a (fix) proxy - show detailed_debug logs 2024-01-08 15:34:24 +05:30
ishaan-jaff
729637e2ad (feat) allow users to opt into detailed debug on proxy 2024-01-08 12:53:41 +05:30
ishaan-jaff
5477b01490 (feat) use '-debug' with proxy logger 2024-01-08 10:35:49 +05:30
ishaan-jaff
0a5f8d564b v0 proxy logger 2024-01-08 08:25:04 +05:30
Krrish Dholakia
b89dac5b78 build(Dockerfile): fixes the build time setup 2024-01-06 16:41:37 +05:30
ishaan-jaff
db37f925ef (fix) proxy + cache - os.environ/ vars 2024-01-06 16:15:53 +05:30
Krish Dholakia
8cfae7bb1a Merge pull request #1342 from BerriAI/litellm_dockerfile_updates
build(Dockerfile): moves prisma logic to dockerfile
2024-01-06 16:03:25 +05:30
ishaan-jaff
d6d5a42115 (feat) cache+proxy - set os.environ/ on proxy config 2024-01-06 15:54:16 +05:30
Krrish Dholakia
40187ed52a build(Dockerfile): moves prisma logic to dockerfile 2024-01-06 14:59:10 +05:30
ishaan-jaff
4a195f09f6 (fix) undo changes that led were trying to control prisma connections 2024-01-06 14:32:40 +05:30
Krrish Dholakia
f526340a5e docs: fix pip install litellm[proxy] instruction 2024-01-06 13:49:15 +05:30
ishaan-jaff
973f418178 Revert "build(Dockerfile): move prisma build to dockerfile"
This reverts commit 2741835605.
2024-01-06 09:51:44 +05:30
ishaan-jaff
b518c5edd9 (ci/cd) add print_verbose for /key/generate 2024-01-05 22:38:46 +05:30
Krrish Dholakia
04dfde3fe5 build(Dockerfile): move prisma build to dockerfile
Seems to solve - https://github.com/BerriAI/litellm/issues/1321
2024-01-05 19:03:41 +05:30
ishaan-jaff
90042ad8ee (fix) reading cache params on proxy 2024-01-05 13:36:48 +05:30
Krrish Dholakia
f3163d287c fix(proxy_server.py): fix prisma client connection error 2024-01-04 18:28:18 +05:30