ishaan-jaff
|
40aaac69cc
|
(ci/cd) add print_verbose for /key/generate
|
2024-01-05 22:38:46 +05:30 |
|
Krrish Dholakia
|
2741835605
|
build(Dockerfile): move prisma build to dockerfile
Seems to solve - https://github.com/BerriAI/litellm/issues/1321
|
2024-01-05 19:03:41 +05:30 |
|
ishaan-jaff
|
aeee8fd3da
|
(fix) reading cache params on proxy
|
2024-01-05 13:36:48 +05:30 |
|
Krrish Dholakia
|
74f6f6489a
|
fix(proxy_server.py): fix prisma client connection error
|
2024-01-04 18:28:18 +05:30 |
|
Krrish Dholakia
|
6b708347f3
|
fix(proxy_server.py): enable sending test connections when slack alerting added to proxy via ui
|
2024-01-04 17:00:07 +05:30 |
|
Krrish Dholakia
|
263d20cdd0
|
fix(proxy_server.py): update proxy with full model list
|
2024-01-04 15:56:16 +05:30 |
|
Krrish Dholakia
|
99d9a825de
|
feat(proxy_server.py): abstract config update/writing and support persisting config in db
allows user to opt into writing to db (SAVE_CONFIG_TO_DB) and removes any api keys before sending to db
https://github.com/BerriAI/litellm/issues/1322
|
2024-01-04 14:44:59 +05:30 |
|
ishaan-jaff
|
30c6d164d2
|
(docs) use s3 Cache on litellm proxy
|
2024-01-03 17:56:44 +05:30 |
|
Krrish Dholakia
|
469ae0a378
|
fix(proxy/utils.py): don't keep connecting to db if connection already established
|
2024-01-03 17:43:44 +05:30 |
|
Krrish Dholakia
|
f2210787cd
|
feat(proxy_server.py): allow admins to update config via /config/update endpoint
|
2024-01-03 17:18:33 +05:30 |
|
Krrish Dholakia
|
d45101b652
|
fix(proxy_server.py): fix master key reset, to preserve key from env
|
2024-01-03 16:10:10 +05:30 |
|
Krrish Dholakia
|
40c974999e
|
fix(proxy_server.py): reject bad /model/new POST requests
|
2024-01-03 15:54:58 +05:30 |
|
Krrish Dholakia
|
b51371952b
|
fix(proxy_server.py): handle base case for /model/info
|
2024-01-03 15:33:29 +05:30 |
|
Krrish Dholakia
|
14e501845f
|
fix(proxy_server.py): add support for setting master key via .env
|
2024-01-03 15:10:25 +05:30 |
|
Krrish Dholakia
|
ef8f1acfa4
|
refactor(proxy_server.py): more debug statements
|
2024-01-03 13:59:41 +05:30 |
|
Krrish Dholakia
|
cd98d256b5
|
fix(proxy_server.py): add alerting for responses taking too long
https://github.com/BerriAI/litellm/issues/1298
|
2024-01-03 11:18:21 +05:30 |
|
Krrish Dholakia
|
070520d237
|
fix(proxy_server.py): support smtp email auth
previously was a hard resend package dependency. removed in favor of allowing any smtp server connection (including resend)
|
2024-01-02 22:22:19 +05:30 |
|
Ased Mammad
|
c39c8f70eb
|
fix(proxy_server.py) Check when '_hidden_params' is None
|
2024-01-02 19:04:51 +03:30 |
|
Krrish Dholakia
|
940569703e
|
feat(proxy_server.py): add slack alerting to proxy server
add alerting for calls hanging, failing and db read/writes failing
https://github.com/BerriAI/litellm/issues/1298
|
2024-01-02 17:45:18 +05:30 |
|
ishaan-jaff
|
c27b1fc5f8
|
(feat) proxy swagger - make admin link clickable
|
2024-01-02 17:04:32 +05:30 |
|
ishaan-jaff
|
6d2b9fd470
|
(feat) use - user router for aembedding
|
2024-01-02 12:27:08 +05:30 |
|
ishaan-jaff
|
ddc31c4810
|
(feat) proxy - use user_config for /chat/compeltions
|
2024-01-02 12:10:34 +05:30 |
|
Krrish Dholakia
|
e1e3721917
|
build(user.py): fix page param read issue
|
2024-01-01 17:25:52 +05:30 |
|
Krrish Dholakia
|
a41e56a730
|
fix(proxy_server.py): enabling user auth via ui
https://github.com/BerriAI/litellm/issues/1231
|
2024-01-01 17:14:24 +05:30 |
|
Krrish Dholakia
|
ca40a88987
|
fix(proxy_server.py): check if user email in user db
|
2024-01-01 14:19:59 +05:30 |
|
ishaan-jaff
|
7623c1a846
|
(feat) proxy - only use print_verbose
|
2024-01-01 13:52:11 +05:30 |
|
Krrish Dholakia
|
24e7dc359d
|
feat(proxy_server.py): introduces new /user/auth endpoint for handling user email auth
decouples streamlit ui from proxy server. this then requires the proxy to handle user auth separately.
|
2024-01-01 13:44:47 +05:30 |
|
ishaan-jaff
|
52db2a6040
|
(feat) proxy - remove streamlit ui on startup
|
2024-01-01 12:54:23 +05:30 |
|
ishaan-jaff
|
dacd86030b
|
(fix) proxy - remove extra print statemet
|
2024-01-01 10:52:09 +05:30 |
|
ishaan-jaff
|
16fb83e007
|
(fix) proxy - remove errant print statement
|
2024-01-01 10:48:12 +05:30 |
|
Krrish Dholakia
|
8ff3bbcfee
|
fix(proxy_server.py): router model group alias routing
check model alias group routing before specific deployment routing, to deal with an alias being the same as a deployment name (e.g. gpt-3.5-turbo)
n
|
2023-12-30 17:55:24 +05:30 |
|
Krrish Dholakia
|
38f55249e1
|
fix(router.py): support retry and fallbacks for atext_completion
|
2023-12-30 11:19:32 +05:30 |
|
Krrish Dholakia
|
cbcf406fd0
|
feat(admin_ui.py): support creating keys on admin ui
|
2023-12-28 16:59:11 +05:30 |
|
Krrish Dholakia
|
71a8b95710
|
refactor(proxy_server.py): make print statements into print_verbose
|
2023-12-28 15:08:23 +05:30 |
|
Krrish Dholakia
|
e5a287379a
|
refactor(proxy_server.py): move admin ui to be locally hosted within proxy
|
2023-12-28 15:06:32 +05:30 |
|
ishaan-jaff
|
3919710823
|
(docs) proxy - swagger docs, add tags for model/info
|
2023-12-28 13:13:04 +05:30 |
|
Krrish Dholakia
|
bf4c4426e5
|
fix(proxy_server.py): return [DONE] end of stream chunk
|
2023-12-28 11:30:49 +05:30 |
|
Krrish Dholakia
|
3b1685e7c6
|
feat(health_check.py): more detailed health check calls
|
2023-12-28 09:12:57 +05:30 |
|
ishaan-jaff
|
07ea2e26f4
|
(fix) proxy - remove bloat - deprecated log_input_output
|
2023-12-27 17:36:53 +05:30 |
|
ishaan-jaff
|
74ea0832ca
|
(feat) proxy remove appdirs as a dep
|
2023-12-27 17:33:47 +05:30 |
|
ishaan-jaff
|
af15e49948
|
(feat) proxy - remove subprocess install
|
2023-12-27 17:28:03 +05:30 |
|
Krrish Dholakia
|
9ba520cc8b
|
fix(google_kms.py): support enums for key management system
|
2023-12-27 13:19:33 +05:30 |
|
Krrish Dholakia
|
235526625d
|
feat(proxy_server.py): support maxage cache control
|
2023-12-26 17:50:27 +05:30 |
|
Krrish Dholakia
|
2070a785a4
|
feat(utils.py): support google kms for secret management
https://github.com/BerriAI/litellm/issues/1235
|
2023-12-26 15:39:40 +05:30 |
|
Krrish Dholakia
|
871f207124
|
docs(user_keys.md): docs on passing user keys to litellm proxy
|
2023-12-26 13:55:28 +05:30 |
|
Krrish Dholakia
|
4905929de3
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
|
Krrish Dholakia
|
9f79f75635
|
fix(proxy/utils.py): return different exceptions if key is invalid vs. expired
https://github.com/BerriAI/litellm/issues/1230
|
2023-12-25 10:29:44 +05:30 |
|
Krrish Dholakia
|
343a06fd84
|
fix(proxy_server.py): raise streaming exceptions
|
2023-12-25 07:18:09 +05:30 |
|
Krish Dholakia
|
8afdc12918
|
Merge pull request #1211 from sihyeonn/fix/sh-success-callback
fix: success_callback logic for cost_tracking
|
2023-12-23 11:41:30 +05:30 |
|
Krrish Dholakia
|
89ee9fe400
|
fix(proxy_server.py): manage budget at user-level not key-level
https://github.com/BerriAI/litellm/issues/1220
|
2023-12-22 15:10:38 +05:30 |
|