Krrish Dholakia
|
98b83fa780
|
feat(proxy_server.py): support model access groups
|
2024-01-17 15:45:31 -08:00 |
|
ishaan-jaff
|
87ff4ca55c
|
(fix) proxy check expires time
|
2024-01-16 15:38:58 -08:00 |
|
ishaan-jaff
|
58a0b4c03b
|
Revert "Revert "(fix) proxy only import dynamo_db when it's being used""
This reverts commit 8cce2f28ca.
|
2024-01-15 16:57:36 -08:00 |
|
ishaan-jaff
|
8cce2f28ca
|
Revert "(fix) proxy only import dynamo_db when it's being used"
This reverts commit 8d3ca785ae.
|
2024-01-15 14:20:29 -08:00 |
|
ishaan-jaff
|
8d3ca785ae
|
(fix) proxy only import dynamo_db when it's being used
|
2024-01-13 11:43:50 -08:00 |
|
Krrish Dholakia
|
3d7c169a58
|
fix(proxy_cli.py): only run prisma db push if prisma in environment
|
2024-01-13 19:44:12 +05:30 |
|
Krrish Dholakia
|
8a7a745549
|
Merge branch 'litellm_dynamo_db_keys'
|
2024-01-13 18:38:43 +05:30 |
|
Krrish Dholakia
|
cd639a7f4b
|
fix(proxy_server.py): have /user/info return user info + related user keys
|
2024-01-12 22:52:13 +05:30 |
|
Krrish Dholakia
|
f94a37a836
|
fix(dynamo_db.py): add cost tracking support for key + user
|
2024-01-11 23:56:41 +05:30 |
|
Krrish Dholakia
|
b06d7f0cb6
|
build(config.yml): reintroduce mounting config.yaml
|
2024-01-10 18:03:57 +05:30 |
|
Krrish Dholakia
|
ba7026639d
|
fix: fix linting errors
|
2024-01-09 22:16:16 +05:30 |
|
Krrish Dholakia
|
35f9666dc2
|
feat(proxy_server.py): adds working dynamo db support for key gen
|
2024-01-09 18:23:34 +05:30 |
|
Krrish Dholakia
|
cd350ab8d8
|
fix(proxy_server.py): don't reconnect prisma if already connected
|
2024-01-09 11:38:42 +05:30 |
|
Krrish Dholakia
|
a7245dba07
|
build(Dockerfile): fixes the build time setup
|
2024-01-06 16:41:37 +05:30 |
|
Krrish Dholakia
|
bf56179da8
|
fix(proxy/utils.py): increase http connection pool for prisma
|
2024-01-06 13:45:30 +05:30 |
|
ishaan-jaff
|
250672eddc
|
(ci/cd) temp fix - check if model_dump_json exists
|
2024-01-06 12:23:39 +05:30 |
|
ishaan-jaff
|
65ac4c1acb
|
(ci/cd) run again
|
2024-01-06 11:57:31 +05:30 |
|
ishaan-jaff
|
357c6c56bd
|
Revert "build(Dockerfile): move prisma build to dockerfile"
This reverts commit 2741835605.
|
2024-01-06 09:51:44 +05:30 |
|
ishaan-jaff
|
40aaac69cc
|
(ci/cd) add print_verbose for /key/generate
|
2024-01-05 22:38:46 +05:30 |
|
ishaan-jaff
|
d9fd38ae16
|
(fix) revert 469ae0a
|
2024-01-05 22:06:39 +05:30 |
|
ishaan-jaff
|
41f5cb7f04
|
(fix) prisma set DATABASE_URL in env
|
2024-01-05 20:57:27 +05:30 |
|
ishaan-jaff
|
898c072103
|
(fix) proxy - self.connect() for get_data()
|
2024-01-05 20:48:16 +05:30 |
|
Krrish Dholakia
|
2741835605
|
build(Dockerfile): move prisma build to dockerfile
Seems to solve - https://github.com/BerriAI/litellm/issues/1321
|
2024-01-05 19:03:41 +05:30 |
|
ishaan-jaff
|
90973d92bf
|
(fix) re-connect prisma if not connected
|
2024-01-05 17:58:23 +05:30 |
|
ishaan-jaff
|
d2578f0cd2
|
(ci/cd) proxy print_verbose on failing insert_data
|
2024-01-05 17:28:27 +05:30 |
|
Krrish Dholakia
|
74f6f6489a
|
fix(proxy_server.py): fix prisma client connection error
|
2024-01-04 18:28:18 +05:30 |
|
Krrish Dholakia
|
99d9a825de
|
feat(proxy_server.py): abstract config update/writing and support persisting config in db
allows user to opt into writing to db (SAVE_CONFIG_TO_DB) and removes any api keys before sending to db
https://github.com/BerriAI/litellm/issues/1322
|
2024-01-04 14:44:59 +05:30 |
|
Krrish Dholakia
|
469ae0a378
|
fix(proxy/utils.py): don't keep connecting to db if connection already established
|
2024-01-03 17:43:44 +05:30 |
|
Krrish Dholakia
|
14e501845f
|
fix(proxy_server.py): add support for setting master key via .env
|
2024-01-03 15:10:25 +05:30 |
|
Krrish Dholakia
|
cd98d256b5
|
fix(proxy_server.py): add alerting for responses taking too long
https://github.com/BerriAI/litellm/issues/1298
|
2024-01-03 11:18:21 +05:30 |
|
Krrish Dholakia
|
0d13c51615
|
fix(proxy/utils.py): fix self.alerting null case
https://github.com/BerriAI/litellm/issues/1298#issuecomment-1874798056
|
2024-01-03 10:12:21 +05:30 |
|
Krrish Dholakia
|
070520d237
|
fix(proxy_server.py): support smtp email auth
previously was a hard resend package dependency. removed in favor of allowing any smtp server connection (including resend)
|
2024-01-02 22:22:19 +05:30 |
|
Krrish Dholakia
|
940569703e
|
feat(proxy_server.py): add slack alerting to proxy server
add alerting for calls hanging, failing and db read/writes failing
https://github.com/BerriAI/litellm/issues/1298
|
2024-01-02 17:45:18 +05:30 |
|
Krrish Dholakia
|
ca40a88987
|
fix(proxy_server.py): check if user email in user db
|
2024-01-01 14:19:59 +05:30 |
|
Krrish Dholakia
|
4905929de3
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
|
Krrish Dholakia
|
b3a98d8400
|
fix(proxy_server.py): accept keys with none duration
|
2023-12-25 13:46:24 +05:30 |
|
Krrish Dholakia
|
9f79f75635
|
fix(proxy/utils.py): return different exceptions if key is invalid vs. expired
https://github.com/BerriAI/litellm/issues/1230
|
2023-12-25 10:29:44 +05:30 |
|
Krrish Dholakia
|
89ee9fe400
|
fix(proxy_server.py): manage budget at user-level not key-level
https://github.com/BerriAI/litellm/issues/1220
|
2023-12-22 15:10:38 +05:30 |
|
Krrish Dholakia
|
1a32228da5
|
feat(proxy_server.py): support max budget on proxy
|
2023-12-21 16:07:20 +05:30 |
|
Krrish Dholakia
|
81078c4004
|
fix(proxy/utils.py): jsonify object before db writes
|
2023-12-21 13:03:14 +05:30 |
|
Krrish Dholakia
|
3291de9e11
|
fix(proxy_server.py): setup depedencies on server startup
|
2023-12-16 11:56:11 -08:00 |
|
Krrish Dholakia
|
effdddc1c8
|
fix(custom_logger.py): enable pre_call hooks to modify incoming data to proxy
|
2023-12-13 16:20:37 -08:00 |
|
Krrish Dholakia
|
7b8851cce5
|
fix(ollama.py): fix async completion calls for ollama
|
2023-12-13 13:10:25 -08:00 |
|
Krrish Dholakia
|
3e7604420e
|
fix(proxy/utils.py): fix db writes on retry
|
2023-12-11 21:14:12 -08:00 |
|
Krrish Dholakia
|
ea89a8a938
|
test(test_custom_callback_unit.py): adding unit tests for custom callbacks + fixing related bugs
|
2023-12-11 11:44:09 -08:00 |
|
Krrish Dholakia
|
6ef0e8485e
|
fix(proxy_server.py): support for streaming
|
2023-12-09 16:23:04 -08:00 |
|
Krrish Dholakia
|
5fa2b6e5ad
|
fix(proxy_server.py): enable pre+post-call hooks and max parallel request limits
|
2023-12-08 17:11:30 -08:00 |
|
Krrish Dholakia
|
bab958561e
|
fix(proxy/utils.py): correctly raise exceptions on db call fail
|
2023-12-08 13:35:42 -08:00 |
|
Krrish Dholakia
|
9f0b83248a
|
fix(proxy/utils.py): add backoff/retry logic to db read/writes
|
2023-12-08 13:34:31 -08:00 |
|
Krrish Dholakia
|
f06c3e0f08
|
fix(proxy_server.py): initializing sentry in proxy logging before db init
|
2023-12-08 11:58:16 -08:00 |
|