phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 10:44:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
5162 commits 2480 branches 894 tags 534 MiB
Commit graph

348 commits

Author SHA1 Message Date
Krrish Dholakia
14e501845f fix(proxy_server.py): add support for setting master key via .env 2024-01-03 15:10:25 +05:30
Krrish Dholakia
ef8f1acfa4 refactor(proxy_server.py): more debug statements 2024-01-03 13:59:41 +05:30
Krrish Dholakia
cd98d256b5 fix(proxy_server.py): add alerting for responses taking too long 
https://github.com/BerriAI/litellm/issues/1298
 2024-01-03 11:18:21 +05:30
Krrish Dholakia
070520d237 fix(proxy_server.py): support smtp email auth 
previously was a hard resend package dependency. removed in favor of allowing any smtp server connection (including resend)
 2024-01-02 22:22:19 +05:30
Ased Mammad
c39c8f70eb
fix(proxy_server.py) Check when '_hidden_params' is None 2024-01-02 19:04:51 +03:30
Krrish Dholakia
940569703e feat(proxy_server.py): add slack alerting to proxy server 
add alerting for calls hanging, failing and db read/writes failing

https://github.com/BerriAI/litellm/issues/1298
 2024-01-02 17:45:18 +05:30
ishaan-jaff
c27b1fc5f8 (feat) proxy swagger - make admin link clickable 2024-01-02 17:04:32 +05:30
ishaan-jaff
6d2b9fd470 (feat) use - user router for aembedding 2024-01-02 12:27:08 +05:30
ishaan-jaff
ddc31c4810 (feat) proxy - use user_config for /chat/compeltions 2024-01-02 12:10:34 +05:30
Krrish Dholakia
e1e3721917 build(user.py): fix page param read issue 2024-01-01 17:25:52 +05:30
Krrish Dholakia
a41e56a730 fix(proxy_server.py): enabling user auth via ui 
https://github.com/BerriAI/litellm/issues/1231
 2024-01-01 17:14:24 +05:30
Krrish Dholakia
ca40a88987 fix(proxy_server.py): check if user email in user db 2024-01-01 14:19:59 +05:30
ishaan-jaff
7623c1a846 (feat) proxy - only use print_verbose 2024-01-01 13:52:11 +05:30
Krrish Dholakia
24e7dc359d feat(proxy_server.py): introduces new /user/auth endpoint for handling user email auth 
decouples streamlit ui from proxy server. this then requires the proxy to handle user auth separately.
 2024-01-01 13:44:47 +05:30
ishaan-jaff
52db2a6040 (feat) proxy - remove streamlit ui on startup 2024-01-01 12:54:23 +05:30
ishaan-jaff
dacd86030b (fix) proxy - remove extra print statemet 2024-01-01 10:52:09 +05:30
ishaan-jaff
16fb83e007 (fix) proxy - remove errant print statement 2024-01-01 10:48:12 +05:30
Krrish Dholakia
8ff3bbcfee fix(proxy_server.py): router model group alias routing 
check model alias group routing before specific deployment routing, to deal with an alias being the same as a deployment name (e.g. gpt-3.5-turbo)

n
 2023-12-30 17:55:24 +05:30
Krrish Dholakia
38f55249e1 fix(router.py): support retry and fallbacks for atext_completion 2023-12-30 11:19:32 +05:30
Krrish Dholakia
cbcf406fd0 feat(admin_ui.py): support creating keys on admin ui 2023-12-28 16:59:11 +05:30
Krrish Dholakia
71a8b95710 refactor(proxy_server.py): make print statements into print_verbose 2023-12-28 15:08:23 +05:30
Krrish Dholakia
e5a287379a refactor(proxy_server.py): move admin ui to be locally hosted within proxy 2023-12-28 15:06:32 +05:30
ishaan-jaff
3919710823 (docs) proxy - swagger docs, add tags for model/info 2023-12-28 13:13:04 +05:30
Krrish Dholakia
bf4c4426e5 fix(proxy_server.py): return [DONE] end of stream chunk 2023-12-28 11:30:49 +05:30
Krrish Dholakia
3b1685e7c6 feat(health_check.py): more detailed health check calls 2023-12-28 09:12:57 +05:30
ishaan-jaff
07ea2e26f4 (fix) proxy - remove bloat - deprecated log_input_output 2023-12-27 17:36:53 +05:30
ishaan-jaff
74ea0832ca (feat) proxy remove appdirs as a dep 2023-12-27 17:33:47 +05:30
ishaan-jaff
af15e49948 (feat) proxy - remove subprocess install 2023-12-27 17:28:03 +05:30
Krrish Dholakia
9ba520cc8b fix(google_kms.py): support enums for key management system 2023-12-27 13:19:33 +05:30
Krrish Dholakia
235526625d feat(proxy_server.py): support maxage cache control 2023-12-26 17:50:27 +05:30
Krrish Dholakia
2070a785a4 feat(utils.py): support google kms for secret management 
https://github.com/BerriAI/litellm/issues/1235
 2023-12-26 15:39:40 +05:30
Krrish Dholakia
871f207124 docs(user_keys.md): docs on passing user keys to litellm proxy 2023-12-26 13:55:28 +05:30
Krrish Dholakia
4905929de3 refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
9f79f75635 fix(proxy/utils.py): return different exceptions if key is invalid vs. expired 
https://github.com/BerriAI/litellm/issues/1230
 2023-12-25 10:29:44 +05:30
Krrish Dholakia
343a06fd84 fix(proxy_server.py): raise streaming exceptions 2023-12-25 07:18:09 +05:30
Krish Dholakia
8afdc12918
Merge pull request #1211 from sihyeonn/fix/sh-success-callback 
fix: success_callback logic for cost_tracking
 2023-12-23 11:41:30 +05:30
Krrish Dholakia
89ee9fe400 fix(proxy_server.py): manage budget at user-level not key-level 
https://github.com/BerriAI/litellm/issues/1220
 2023-12-22 15:10:38 +05:30
Krrish Dholakia
979575a2a6 fix(proxy_server.py): handle misformatted json body in chat completion request 2023-12-22 12:30:36 +05:30
Krrish Dholakia
1a32228da5 feat(proxy_server.py): support max budget on proxy 2023-12-21 16:07:20 +05:30
Krrish Dholakia
14115d0d60 feat(proxy_server.py): add new images/generation endpoint 2023-12-21 15:39:09 +05:30
Krrish Dholakia
81078c4004 fix(proxy/utils.py): jsonify object before db writes 2023-12-21 13:03:14 +05:30
Sihyeon Jang
4f41c3c513 fix: success_callback logic for cost_tracking 
Signed-off-by: Sihyeon Jang <uneedsihyeon@gmail.com>
 2023-12-21 16:09:59 +09:00
ishaan-jaff
683a1ee979 (feat) proxy key/generate pass metadata in requests 2023-12-20 13:42:49 +05:30
ishaan-jaff
229b56fc35 (docs) swagger - add embedding tag 2023-12-20 09:04:56 +05:30
ishaan-jaff
aa78415894 (docs) swager - add embeddings tag 2023-12-20 06:29:36 +05:30
ishaan-jaff
9548334e2f (docs) swagger docs add description 2023-12-20 06:27:26 +05:30
ishaan-jaff
8b26e64b5d (fix) proxy: add link t swagger docs on startup 2023-12-20 06:02:05 +05:30
ishaan-jaff
ce1b0b89ba (fix) proxy - health checks support cli model 2023-12-19 12:55:20 +05:30
Krrish Dholakia
3923c389fd build(Dockerfile): fixing build requirements 2023-12-16 17:52:30 -08:00
Krrish Dholakia
3291de9e11 fix(proxy_server.py): setup depedencies on server startup 2023-12-16 11:56:11 -08:00