phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
4319 commits 1603 branches 645 tags 320 MiB
Commit graph

4319 commits

This branch
This branch
All branches
Author SHA1 Message Date
ishaan-jaff
39ea2e0909 (ci/cd) add langfuse 2023-12-08 17:49:43 -08:00
Krish Dholakia
f2bba58a24 Updated config.yml 2023-12-08 17:49:42 -08:00
ishaan-jaff
5efe336968 (fix) linting 2023-12-08 17:26:14 -08:00
ishaan-jaff
8c628b64e0 (test) proxy - custom logger 2023-12-08 17:25:05 -08:00
ishaan-jaff
88c1d6649f (fix) asyc callback + stream-stop dbl cnt chunk 2023-12-08 17:25:05 -08:00
ishaan-jaff
e237361891 (test) async logger + streaming 2023-12-08 17:25:05 -08:00
ishaan-jaff
b50faed5ab (test) callback - strict test - async callback resp 2023-12-08 17:25:05 -08:00
ishaan-jaff
34428a8e67 (docs) fix 2023-12-08 17:25:05 -08:00
ishaan-jaff
4e8e3ff33a (fix) async custom logger - trigger when stream completed 2023-12-08 17:25:05 -08:00
Krrish Dholakia
5fa2b6e5ad fix(proxy_server.py): enable pre+post-call hooks and max parallel request limits 2023-12-08 17:11:30 -08:00
ishaan-jaff
977bfaaab9 (docs) proxy - get model_info,server_request 2023-12-08 14:57:29 -08:00
ishaan-jaff
76d0c50523 (ci/cd) comment beta test 2023-12-08 14:27:53 -08:00
ishaan-jaff
73984504e9 (test) proxy: access model_info and request_obj 2023-12-08 14:26:18 -08:00
ishaan-jaff
14d57ec7de (feat) proxy: log model_info + proxy_server request 2023-12-08 14:26:18 -08:00
ishaan-jaff
93b1df1c79 (feat) embedding - pass model_info, proxy_server request 2023-12-08 14:26:18 -08:00
ishaan-jaff
9805269bd7 (feat) proxy: pass model_info as kwargs 2023-12-08 14:26:18 -08:00
ishaan-jaff
be94a8c478 (feat) pass model_info, proxy_server_request to callback 2023-12-08 14:26:18 -08:00
ishaan-jaff
72cca2e5a7 (feat) pass model_info, proxy_server_request callback 2023-12-08 14:26:18 -08:00
Krrish Dholakia
bab958561e fix(proxy/utils.py): correctly raise exceptions on db call fail 2023-12-08 13:35:42 -08:00
Krrish Dholakia
9f0b83248a fix(proxy/utils.py): add backoff/retry logic to db read/writes 2023-12-08 13:34:31 -08:00
ishaan-jaff
b8e9e1edc9 (fix) test caching 2023-12-08 13:15:00 -08:00
Krrish Dholakia
f06c3e0f08 fix(proxy_server.py): initializing sentry in proxy logging before db init 2023-12-08 11:58:16 -08:00
ishaan-jaff
fa8ba9dd4e (test) cache + streaming 2023-12-08 11:50:37 -08:00
ishaan-jaff
6e8ad10991 (feat) caching - streaming caching support 2023-12-08 11:50:37 -08:00
ishaan-jaff
9b0afbe2cb (fix) bug - caching: gen cache key in order 2023-12-08 11:50:37 -08:00
Krrish Dholakia
5a9b58b2bb bump: version 1.12.0 → 1.12.1 2023-12-08 11:41:14 -08:00
Krrish Dholakia
7aec95ed7c feat(proxy_server.py): add sentry logging for db read/writes 2023-12-08 11:40:19 -08:00
Krrish Dholakia
4e6a8d09d0 fix(proxy/utils.py): tracking db failed writes 2023-12-08 10:40:02 -08:00
Krrish Dholakia
1b35736797 fix(utils.py): fix cost calculation to handle tool input 2023-12-08 09:53:46 -08:00
Krrish Dholakia
9494c2cd9e fix(requirements.txt): add ollama async_generator in requirements.txt 2023-12-08 09:20:04 -08:00
Krrish Dholakia
2ede903f0b docs: fix imports 2023-12-08 07:39:13 -08:00
Krrish Dholakia
d548836903 docs: add proxy req/s 2023-12-08 07:33:33 -08:00
Krrish Dholakia
0406e01c6d docs(deploy.md): add proxy perf to docs 2023-12-08 07:32:23 -08:00
Krrish Dholakia
2f1c5aa0c7 fix: setting cache responses on proxy 2023-12-07 20:39:40 -08:00
Krrish Dholakia
f5afc429b3 fix(proxy_server.py): add call hooks pre+post completion and embedding calls 2023-12-07 20:35:32 -08:00
Krrish Dholakia
dfba305508 test: test_router.py 
fix router testing

n
 2023-12-07 20:10:36 -08:00
Krrish Dholakia
a350b80d28 bump: version 1.11.1 → 1.12.0 2023-12-07 19:40:23 -08:00
Krrish Dholakia
9cf3051ea2 feat(proxy_server.py): enable background health checks 2023-12-07 19:40:06 -08:00
ishaan-jaff
b8b15435b7 (test) undo fd04b48 2023-12-07 18:38:51 -08:00
ishaan-jaff
f99e3a3818 (fix) undo commit fd04b48 2023-12-07 18:37:06 -08:00
ishaan-jaff
3f4fe668a8 (ci/cd) vertex ai test 2023-12-07 18:20:58 -08:00
ishaan-jaff
fd04b48764 (feat) async callbacks with litellm.completion() 2023-12-07 18:09:57 -08:00
ishaan-jaff
762f28e4d7 (fix) make print_verbose non blocking 2023-12-07 17:31:32 -08:00
ishaan-jaff
2da50087b0 (fix) logging - better prints for async logger 2023-12-07 17:31:32 -08:00
Krrish Dholakia
4c0e95aec9 test: fix proxy custom logger test 2023-12-07 15:19:11 -08:00
Krrish Dholakia
91ce50338a fix(_redis.py): check if string before checking os.environ 2023-12-07 15:08:11 -08:00
Krrish Dholakia
b92f1af301 test: cleaning up local testing 2023-12-07 14:20:14 -08:00
Krrish Dholakia
3846ec6124 fix(utils.py): fix get_llm_provider to handle the ':' in anthropic/bedrock calls 2023-12-07 14:19:11 -08:00
Krrish Dholakia
2b04dc310a test: skip local proxy test in circle ci 2023-12-07 13:56:23 -08:00
ishaan-jaff
f236dae79d (test) async logger + proxy 2023-12-07 13:54:27 -08:00