phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
6070 commits 1603 branches 645 tags 320 MiB
Commit graph

475 commits

Author SHA1 Message Date
Krrish Dholakia
bf4c4426e5 fix(proxy_server.py): return [DONE] end of stream chunk 2023-12-28 11:30:49 +05:30
Krrish Dholakia
3b1685e7c6 feat(health_check.py): more detailed health check calls 2023-12-28 09:12:57 +05:30
ishaan-jaff
07ea2e26f4 (fix) proxy - remove bloat - deprecated log_input_output 2023-12-27 17:36:53 +05:30
ishaan-jaff
74ea0832ca (feat) proxy remove appdirs as a dep 2023-12-27 17:33:47 +05:30
ishaan-jaff
af15e49948 (feat) proxy - remove subprocess install 2023-12-27 17:28:03 +05:30
Krrish Dholakia
9ba520cc8b fix(google_kms.py): support enums for key management system 2023-12-27 13:19:33 +05:30
Krrish Dholakia
235526625d feat(proxy_server.py): support maxage cache control 2023-12-26 17:50:27 +05:30
Krrish Dholakia
2070a785a4 feat(utils.py): support google kms for secret management 
https://github.com/BerriAI/litellm/issues/1235
 2023-12-26 15:39:40 +05:30
Krrish Dholakia
871f207124 docs(user_keys.md): docs on passing user keys to litellm proxy 2023-12-26 13:55:28 +05:30
Krrish Dholakia
4905929de3 refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
9f79f75635 fix(proxy/utils.py): return different exceptions if key is invalid vs. expired 
https://github.com/BerriAI/litellm/issues/1230
 2023-12-25 10:29:44 +05:30
Krrish Dholakia
343a06fd84 fix(proxy_server.py): raise streaming exceptions 2023-12-25 07:18:09 +05:30
Krish Dholakia
8afdc12918
Merge pull request #1211 from sihyeonn/fix/sh-success-callback 
fix: success_callback logic for cost_tracking
 2023-12-23 11:41:30 +05:30
Krrish Dholakia
89ee9fe400 fix(proxy_server.py): manage budget at user-level not key-level 
https://github.com/BerriAI/litellm/issues/1220
 2023-12-22 15:10:38 +05:30
Krrish Dholakia
979575a2a6 fix(proxy_server.py): handle misformatted json body in chat completion request 2023-12-22 12:30:36 +05:30
Krrish Dholakia
1a32228da5 feat(proxy_server.py): support max budget on proxy 2023-12-21 16:07:20 +05:30
Krrish Dholakia
14115d0d60 feat(proxy_server.py): add new images/generation endpoint 2023-12-21 15:39:09 +05:30
Krrish Dholakia
81078c4004 fix(proxy/utils.py): jsonify object before db writes 2023-12-21 13:03:14 +05:30
Sihyeon Jang
4f41c3c513 fix: success_callback logic for cost_tracking 
Signed-off-by: Sihyeon Jang <uneedsihyeon@gmail.com>
 2023-12-21 16:09:59 +09:00
ishaan-jaff
683a1ee979 (feat) proxy key/generate pass metadata in requests 2023-12-20 13:42:49 +05:30
ishaan-jaff
229b56fc35 (docs) swagger - add embedding tag 2023-12-20 09:04:56 +05:30
ishaan-jaff
aa78415894 (docs) swager - add embeddings tag 2023-12-20 06:29:36 +05:30
ishaan-jaff
9548334e2f (docs) swagger docs add description 2023-12-20 06:27:26 +05:30
ishaan-jaff
8b26e64b5d (fix) proxy: add link t swagger docs on startup 2023-12-20 06:02:05 +05:30
ishaan-jaff
ce1b0b89ba (fix) proxy - health checks support cli model 2023-12-19 12:55:20 +05:30
Krrish Dholakia
3923c389fd build(Dockerfile): fixing build requirements 2023-12-16 17:52:30 -08:00
Krrish Dholakia
3291de9e11 fix(proxy_server.py): setup depedencies on server startup 2023-12-16 11:56:11 -08:00
ishaan-jaff
6b7d0eada4 (feat) proxy - set cache configs on proxy 2023-12-16 14:44:39 +05:30
ishaan-jaff
37bf94dcdf (fix) proxy remove errant print 2023-12-16 12:26:02 +05:30
Krrish Dholakia
4791dda66f feat(proxy_server.py): enable infinite retries on rate limited requests 2023-12-15 20:03:41 -08:00
ishaan-jaff
0b4f1dee42 (feat) proxy: embeddings-add OpenAI exception mapping 2023-12-15 14:02:24 +05:30
Krrish Dholakia
adaf341f54 fix(proxy_server.py): allow post-call rules to be passed in as a file 2023-12-14 18:21:09 -08:00
Krrish Dholakia
2a4c1a1803 fix(proxy_server.py): don't pass in user param if not sent 2023-12-14 14:17:33 -08:00
Krrish Dholakia
1608dd7e0b fix(main.py): support async streaming for text completions endpoint 2023-12-14 13:56:32 -08:00
Krrish Dholakia
db8d793618 fix(proxy_server.py): handle scenario where no json body is passed in - e.g. GET request 
https://github.com/BerriAI/litellm/issues/1062
 2023-12-14 09:57:35 -08:00
ishaan-jaff
d1cf41888b (feat) proxy add docstring for /test 2023-12-14 16:51:16 +05:30
ishaan-jaff
80fc8050eb (feat) proxy - model group alias 2023-12-14 13:24:10 +05:30
Krrish Dholakia
effdddc1c8 fix(custom_logger.py): enable pre_call hooks to modify incoming data to proxy 2023-12-13 16:20:37 -08:00
Krrish Dholakia
7b8851cce5 fix(ollama.py): fix async completion calls for ollama 2023-12-13 13:10:25 -08:00
Krrish Dholakia
693292a64c feat(proxy_server.py): add new /key/update endpoint 2023-12-12 17:18:51 -08:00
Krrish Dholakia
a266ad0319 refactor(proxy_server.py): code cleanup 2023-12-12 15:49:41 -08:00
Krrish Dholakia
8b07a6c046 fix(main.py): pass user_id + encoding_format for logging + to openai/azure 2023-12-12 15:46:44 -08:00
Krrish Dholakia
bdf29ca71f fix(sagemaker.py): debug streaming 2023-12-12 15:45:07 -08:00
ishaan-jaff
f8c7528bff (fix) proxy : cleanup router 2023-12-11 22:12:22 -08:00
Krrish Dholakia
3e7604420e fix(proxy/utils.py): fix db writes on retry 2023-12-11 21:14:12 -08:00
Krrish Dholakia
ea89a8a938 test(test_custom_callback_unit.py): adding unit tests for custom callbacks + fixing related bugs 2023-12-11 11:44:09 -08:00
ishaan-jaff
71eee5087d (test) assert metadata in callbacks 2023-12-11 09:47:38 -08:00
Krrish Dholakia
22f04e3b33 fix(proxy_server.py): fix /model/new adding new model issue 2023-12-09 22:44:11 -08:00
ishaan-jaff
127f25703a (fix) proxy /model/info 2023-12-09 22:35:09 -08:00
Krrish Dholakia
07b4c72a98 fix(proxy_server.py): fix key gen error 2023-12-09 22:04:59 -08:00