phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
20886 commits 2490 branches 894 tags 548 MiB
Commit graph

1953 commits

Author SHA1 Message Date
ishaan-jaff
84f77bfaf8 (docs) swagger docs add description 2023-12-20 06:27:26 +05:30
ishaan-jaff
343e192914 (fix) proxy: add link t swagger docs on startup 2023-12-20 06:02:05 +05:30
ishaan-jaff
8cdcdda4c1 (fix) proxy - health checks support cli model 2023-12-19 12:55:20 +05:30
Krrish Dholakia
c87cdbd156 build(Dockerfile): fixing build requirements 2023-12-16 17:52:30 -08:00
Krrish Dholakia
68c53256ab fix(proxy_server.py): setup depedencies on server startup 2023-12-16 11:56:11 -08:00
ishaan-jaff
975ab97c44 (feat) proxy - set cache configs on proxy 2023-12-16 14:44:39 +05:30
ishaan-jaff
d7630d5b0c (fix) proxy remove errant print 2023-12-16 12:26:02 +05:30
Krrish Dholakia
1da7d35218 feat(proxy_server.py): enable infinite retries on rate limited requests 2023-12-15 20:03:41 -08:00
ishaan-jaff
e3cb7ba6ba (feat) proxy: embeddings-add OpenAI exception mapping 2023-12-15 14:02:24 +05:30
Krrish Dholakia
8a6a6171e8 fix(proxy_server.py): allow post-call rules to be passed in as a file 2023-12-14 18:21:09 -08:00
Krrish Dholakia
c2b92fe8b8 fix(proxy_server.py): don't pass in user param if not sent 2023-12-14 14:17:33 -08:00
Krrish Dholakia
bb5b883316 fix(main.py): support async streaming for text completions endpoint 2023-12-14 13:56:32 -08:00
Krrish Dholakia
8ca8496140 fix(proxy_server.py): handle scenario where no json body is passed in - e.g. GET request 
https://github.com/BerriAI/litellm/issues/1062
 2023-12-14 09:57:35 -08:00
ishaan-jaff
467ea282f2 (feat) proxy add docstring for /test 2023-12-14 16:51:16 +05:30
ishaan-jaff
a8b4f9d631 (feat) proxy - model group alias 2023-12-14 13:24:10 +05:30
Krrish Dholakia
3fbeca134f fix(custom_logger.py): enable pre_call hooks to modify incoming data to proxy 2023-12-13 16:20:37 -08:00
Krrish Dholakia
2231601d5a fix(ollama.py): fix async completion calls for ollama 2023-12-13 13:10:25 -08:00
Krrish Dholakia
8bb826975d feat(proxy_server.py): add new /key/update endpoint 2023-12-12 17:18:51 -08:00
Krrish Dholakia
5b8907772d refactor(proxy_server.py): code cleanup 2023-12-12 15:49:41 -08:00
Krrish Dholakia
e396fcb55c fix(main.py): pass user_id + encoding_format for logging + to openai/azure 2023-12-12 15:46:44 -08:00
Krrish Dholakia
d059d1b101 fix(sagemaker.py): debug streaming 2023-12-12 15:45:07 -08:00
ishaan-jaff
d5bb71fb48 (fix) proxy : cleanup router 2023-12-11 22:12:22 -08:00
Krrish Dholakia
66e0c06476 fix(proxy/utils.py): fix db writes on retry 2023-12-11 21:14:12 -08:00
Krrish Dholakia
47d0884c0c test(test_custom_callback_unit.py): adding unit tests for custom callbacks + fixing related bugs 2023-12-11 11:44:09 -08:00
ishaan-jaff
4216617688 (test) assert metadata in callbacks 2023-12-11 09:47:38 -08:00
Krrish Dholakia
a5fddf55dd fix(proxy_server.py): fix /model/new adding new model issue 2023-12-09 22:44:11 -08:00
ishaan-jaff
587649d37f (fix) proxy /model/info 2023-12-09 22:35:09 -08:00
Krrish Dholakia
0fbe0f017a fix(proxy_server.py): fix key gen error 2023-12-09 22:04:59 -08:00
Krrish Dholakia
01394a7bbd fix: minor bug fixes 2023-12-09 21:24:52 -08:00
Krrish Dholakia
8eb7dc6393 fix(proxy_server.py): support for streaming 2023-12-09 16:23:04 -08:00
ishaan-jaff
827cc66c15 (feat) proxy - cache allow bool 2023-12-09 15:55:38 -08:00
ishaan-jaff
9951c6d569 (fix) proxy - show logging when Cache created 2023-12-09 15:21:04 -08:00
Krrish Dholakia
043d0c0c89 fix(proxy_server.py): fix linting errors 2023-12-09 12:17:33 -08:00
Krrish Dholakia
2048ef445d fix(proxy_server.py): fix pydantic version errors 2023-12-09 12:09:49 -08:00
Krrish Dholakia
a8f5b4b69c fix(proxy_server.py): add custom json helper func to work across multiple pydantic versions 2023-12-09 11:13:03 -08:00
Krrish Dholakia
612be8c844 fix(proxy_server.py): add logging around /key/generate 2023-12-09 10:26:12 -08:00
ishaan-jaff
f97ebdb4bd (docs) proxy - OTEL + traceloop 2023-12-08 18:39:52 -08:00
ishaan-jaff
1e3d909408 (fix) linting 2023-12-08 17:26:14 -08:00
Krrish Dholakia
9c6584a376 fix(proxy_server.py): enable pre+post-call hooks and max parallel request limits 2023-12-08 17:11:30 -08:00
ishaan-jaff
de6880dc09 (feat) pass model_info, proxy_server_request to callback 2023-12-08 14:26:18 -08:00
Krrish Dholakia
8460924f1d fix(proxy_server.py): initializing sentry in proxy logging before db init 2023-12-08 11:58:16 -08:00
Krrish Dholakia
4ff969bf6d feat(proxy_server.py): add sentry logging for db read/writes 2023-12-08 11:40:19 -08:00
Krrish Dholakia
7c962637f5 fix(utils.py): fix cost calculation to handle tool input 2023-12-08 09:53:46 -08:00
Krrish Dholakia
8d5c3ea36c fix(requirements.txt): add ollama async_generator in requirements.txt 2023-12-08 09:20:04 -08:00
Krrish Dholakia
30204497e0 fix: setting cache responses on proxy 2023-12-07 20:39:40 -08:00
Krrish Dholakia
665939bc48 fix(proxy_server.py): add call hooks pre+post completion and embedding calls 2023-12-07 20:35:32 -08:00
Krrish Dholakia
c739b29eb0 feat(proxy_server.py): enable background health checks 2023-12-07 19:40:06 -08:00
ishaan-jaff
f744445db4 (fix) make print_verbose non blocking 2023-12-07 17:31:32 -08:00
Krrish Dholakia
69c34493ce fix(router.py): fix default caching response value 2023-12-07 13:44:31 -08:00
ishaan-jaff
c6d19046f2 (test) proxy - async custom logger 2023-12-07 13:19:17 -08:00