phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 19:54:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
4334 commits 2497 branches 898 tags 550 MiB
Commit graph

654 commits

Author SHA1 Message Date
Krrish Dholakia
94de89c812 fix(utils.py): return last streaming chunk 2023-11-29 12:11:08 -08:00
Krrish Dholakia
622eaf4a21 fix(utils.py): fix parallel tool calling when streaming 2023-11-29 10:56:21 -08:00
Krrish Dholakia
923c681fb8 fix(utils.py): bedrock/cohere optional params 2023-11-29 08:08:48 -08:00
Krrish Dholakia
825c3f5d23 fix(utils.py): fix bedrock/cohere supported params 2023-11-28 17:42:50 -08:00
Krrish Dholakia
60d6b6bc37 fix(router.py): fix exponential backoff to use retry-after if present in headers 2023-11-28 17:25:03 -08:00
Krrish Dholakia
3c0decee47 fix(utils.py): bug fix return only non-null responses 2023-11-28 09:43:42 -08:00
Krrish Dholakia
5450fb26f4 fix(utils.py): azure tool calling streaming 2023-11-27 19:07:38 -08:00
Krrish Dholakia
01a71cd0dc fix(stream_chunk_builder): adding support for tool calling in completion counting 2023-11-27 18:39:47 -08:00
ishaan-jaff
81e6059c94 (feat) raise APIConnectionError error for Azure +OpenAI 2023-11-27 18:08:47 -08:00
Krrish Dholakia
e564f643f5 fix(router.py): speed improvements to the router 2023-11-27 17:35:26 -08:00
ishaan-jaff
f6975e07d0 (feat) completion: sagemaker debugging - show boto3 request sent 2023-11-27 09:04:50 -08:00
Krrish Dholakia
2680f84cfc fix(router.py): fix fallbacks 2023-11-25 19:34:20 -08:00
Krrish Dholakia
2b9c5bf706 fix(router.py): check if fallbacks is none 2023-11-25 14:58:07 -08:00
Krrish Dholakia
b1b2d0c2b7 fix(utils.py): fix bedrock + cohere calls 2023-11-25 14:45:42 -08:00
Krrish Dholakia
e6a28881a2 fix(utils.py): fix embedding response object conversion 2023-11-25 14:25:06 -08:00
Krrish Dholakia
42f11888a2 fix(utils.py): fix linting errors 2023-11-25 14:19:14 -08:00
Krrish Dholakia
b2b080f610 fix(utils.py): fix linting erros 2023-11-25 14:14:46 -08:00
Krrish Dholakia
f45523bb99 fix(utils.py): fix linting issues 2023-11-25 14:11:40 -08:00
Krrish Dholakia
0a0324f215 fix(utils.py): fix linting issues 2023-11-25 13:48:50 -08:00
Krrish Dholakia
0b2c1496d2 fix: fix nlp cloud streaming 2023-11-25 13:45:23 -08:00
Krrish Dholakia
20ca1b32eb bump: version 1.7.0 → 1.7.1 2023-11-25 12:34:28 -08:00
Krrish Dholakia
c22b71bb04 fix(utils.py): fix embedding response output parsing 2023-11-25 12:06:57 -08:00
Krrish Dholakia
ff6975a98d fix(main.py): logit bias mapping for batch_completions 2023-11-24 16:05:51 -08:00
ishaan-jaff
c170917719 (fix) completion: OpenAI/Azure filter out None params 2023-11-24 14:01:21 -08:00
Krrish Dholakia
5a9a3aa89c fix(main.py): fix streaming_chunk_builder to return usage 2023-11-24 11:27:04 -08:00
ishaan-jaff
b520ace9dd (feat) cost tracking for azure llms 2023-11-23 21:41:38 -08:00
Krrish Dholakia
1b26a0931e fix(utils.py): make failure logging sync 2023-11-23 20:19:27 -08:00
ishaan-jaff
4f536885e9 (fix) cost calculator for FT: gpt-3.5 2023-11-23 18:28:21 -08:00
Krrish Dholakia
c89c41b3dc fix(utils.py): vertex ai api error exception mapping 2023-11-23 17:50:50 -08:00
Krrish Dholakia
90385ef6a5 fix(utils.py): remove eos token for zephyr models 2023-11-23 17:47:39 -08:00
Krrish Dholakia
78d13ea6eb fix(vertex_ai.py): fix exception mapping for vertex ai 2023-11-23 17:35:33 -08:00
ishaan-jaff
cde8996798 (fix) debugging: viewing raw POST request 2023-11-23 16:28:19 -08:00
ishaan-jaff
193ef781ae (fix) debugging: POST request 2023-11-23 16:08:59 -08:00
ishaan-jaff
288e3e962a (feat) cost: azure gpt + testing 2023-11-23 14:20:48 -08:00
ishaan-jaff
78e3d886a4 (feat) cost tracking ft:gpt-3.5-turbo 2023-11-23 13:58:59 -08:00
ishaan-jaff
3b9359ea7c (test) cost calc on azure 2023-11-23 13:50:09 -08:00
Krrish Dholakia
e4f40f4535 fix(utils.py): support reading api keys dynamically from the os environment 2023-11-23 13:41:56 -08:00
Krrish Dholakia
a2207d462e feat(router.py): add server cooldown logic 2023-11-22 15:59:48 -08:00
ishaan-jaff
c1ab1120bd (feat) clean out junk params from litellm embedding 2023-11-22 13:50:45 -08:00
Krrish Dholakia
bd87e30058 test(test_caching.py): cleaning up tests 2023-11-22 13:43:48 -08:00
Krrish Dholakia
9bb2c7ee0f fix(utils.py): add param mapping for perplexity, anyscale, deepinfra 
n

n
 2023-11-22 10:04:27 -08:00
Krrish Dholakia
efc2bfe295 fix(utils.py): add response ms for async calls 2023-11-21 19:59:00 -08:00
Krrish Dholakia
c0e3b2ece9 fix(utils.py): fix pre call rules 2023-11-21 07:10:04 -08:00
Krrish Dholakia
8e1dcc540f fix(main.py): revert model alias map change 2023-11-20 21:07:52 -08:00
Krrish Dholakia
bdd9a933ad fix(utils.py): fix rules calling 2023-11-20 21:06:36 -08:00
Krrish Dholakia
d83c2b9ee8 fix(main.py): fix model alias map logic 2023-11-20 20:49:10 -08:00
Krrish Dholakia
35e5a757b0 fix(openai.py-+-azure.py): fix linting issues 2023-11-20 19:29:23 -08:00
Krrish Dholakia
c7e2cbd995 fix(utils.py): adding support for rules + mythomax/alpaca prompt template 2023-11-20 18:58:15 -08:00
ishaan-jaff
2f1180418b (fix) linting error 2023-11-20 18:32:43 -08:00
ishaan-jaff
372b4654c3 (fix) pydantic errors openai usage 2023-11-20 18:28:19 -08:00