phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
3940 commits 2497 branches 897 tags 550 MiB
Commit graph

619 commits

Author SHA1 Message Date
Krrish Dholakia
284fb64f4d feat: support for azure key vault 2023-12-01 19:36:06 -08:00
Krrish Dholakia
1c3aa0e723 fix(utils.py): expand openai_token_counter selection 2023-11-30 18:51:51 -08:00
Krrish Dholakia
a4308fadce fix(router.py): back-off if no models available 2023-11-30 18:42:29 -08:00
Krrish Dholakia
36a3f06320 (fix) support counting tokens for tool calls 2023-11-30 18:24:21 -08:00
Krrish Dholakia
af56d8a759 fix(utils.py): fix azure completion cost calculation 2023-11-30 09:19:35 -08:00
Krrish Dholakia
68e0eca6b8 fix(utils.py): include system fingerprint in streaming response object 2023-11-30 08:45:52 -08:00
Krrish Dholakia
4d232cc19e fix(utils.py): fix register model cost map 2023-11-29 21:12:29 -08:00
Krrish Dholakia
0341b0cd07 feat(main.py): allow updating model cost via completion() 2023-11-29 20:14:39 -08:00
ishaan-jaff
ca03f83597 (feat) async embeddings: OpenAI 2023-11-29 19:35:08 -08:00
ishaan-jaff
b4173db700 (chore) util: remove_model_id 2023-11-29 17:30:33 -08:00
Krrish Dholakia
83719a67b2 fix(utils.py): raise stop iteration exception on bedrock stream close 2023-11-29 16:43:11 -08:00
Krrish Dholakia
2a5592abe7 fix(bedrock.py): support ai21 / bedrock streaming 2023-11-29 16:35:06 -08:00
ishaan-jaff
8527d98a8f (fix) OpenAI embedding 2023-11-29 16:09:31 -08:00
Krrish Dholakia
ddb2e954ac fix(utils.py): stop sequence filtering for amazon titan models 2023-11-29 16:04:14 -08:00
Krrish Dholakia
18afb51d72 bump: version 1.7.13 → 1.7.14 2023-11-29 15:19:18 -08:00
Krrish Dholakia
94de89c812 fix(utils.py): return last streaming chunk 2023-11-29 12:11:08 -08:00
Krrish Dholakia
622eaf4a21 fix(utils.py): fix parallel tool calling when streaming 2023-11-29 10:56:21 -08:00
Krrish Dholakia
923c681fb8 fix(utils.py): bedrock/cohere optional params 2023-11-29 08:08:48 -08:00
Krrish Dholakia
825c3f5d23 fix(utils.py): fix bedrock/cohere supported params 2023-11-28 17:42:50 -08:00
Krrish Dholakia
60d6b6bc37 fix(router.py): fix exponential backoff to use retry-after if present in headers 2023-11-28 17:25:03 -08:00
Krrish Dholakia
3c0decee47 fix(utils.py): bug fix return only non-null responses 2023-11-28 09:43:42 -08:00
Krrish Dholakia
5450fb26f4 fix(utils.py): azure tool calling streaming 2023-11-27 19:07:38 -08:00
Krrish Dholakia
01a71cd0dc fix(stream_chunk_builder): adding support for tool calling in completion counting 2023-11-27 18:39:47 -08:00
ishaan-jaff
81e6059c94 (feat) raise APIConnectionError error for Azure +OpenAI 2023-11-27 18:08:47 -08:00
Krrish Dholakia
e564f643f5 fix(router.py): speed improvements to the router 2023-11-27 17:35:26 -08:00
ishaan-jaff
f6975e07d0 (feat) completion: sagemaker debugging - show boto3 request sent 2023-11-27 09:04:50 -08:00
Krrish Dholakia
2680f84cfc fix(router.py): fix fallbacks 2023-11-25 19:34:20 -08:00
Krrish Dholakia
2b9c5bf706 fix(router.py): check if fallbacks is none 2023-11-25 14:58:07 -08:00
Krrish Dholakia
b1b2d0c2b7 fix(utils.py): fix bedrock + cohere calls 2023-11-25 14:45:42 -08:00
Krrish Dholakia
e6a28881a2 fix(utils.py): fix embedding response object conversion 2023-11-25 14:25:06 -08:00
Krrish Dholakia
42f11888a2 fix(utils.py): fix linting errors 2023-11-25 14:19:14 -08:00
Krrish Dholakia
b2b080f610 fix(utils.py): fix linting erros 2023-11-25 14:14:46 -08:00
Krrish Dholakia
f45523bb99 fix(utils.py): fix linting issues 2023-11-25 14:11:40 -08:00
Krrish Dholakia
0a0324f215 fix(utils.py): fix linting issues 2023-11-25 13:48:50 -08:00
Krrish Dholakia
0b2c1496d2 fix: fix nlp cloud streaming 2023-11-25 13:45:23 -08:00
Krrish Dholakia
20ca1b32eb bump: version 1.7.0 → 1.7.1 2023-11-25 12:34:28 -08:00
Krrish Dholakia
c22b71bb04 fix(utils.py): fix embedding response output parsing 2023-11-25 12:06:57 -08:00
Krrish Dholakia
ff6975a98d fix(main.py): logit bias mapping for batch_completions 2023-11-24 16:05:51 -08:00
ishaan-jaff
c170917719 (fix) completion: OpenAI/Azure filter out None params 2023-11-24 14:01:21 -08:00
Krrish Dholakia
5a9a3aa89c fix(main.py): fix streaming_chunk_builder to return usage 2023-11-24 11:27:04 -08:00
ishaan-jaff
b520ace9dd (feat) cost tracking for azure llms 2023-11-23 21:41:38 -08:00
Krrish Dholakia
1b26a0931e fix(utils.py): make failure logging sync 2023-11-23 20:19:27 -08:00
ishaan-jaff
4f536885e9 (fix) cost calculator for FT: gpt-3.5 2023-11-23 18:28:21 -08:00
Krrish Dholakia
c89c41b3dc fix(utils.py): vertex ai api error exception mapping 2023-11-23 17:50:50 -08:00
Krrish Dholakia
90385ef6a5 fix(utils.py): remove eos token for zephyr models 2023-11-23 17:47:39 -08:00
Krrish Dholakia
78d13ea6eb fix(vertex_ai.py): fix exception mapping for vertex ai 2023-11-23 17:35:33 -08:00
ishaan-jaff
cde8996798 (fix) debugging: viewing raw POST request 2023-11-23 16:28:19 -08:00
ishaan-jaff
193ef781ae (fix) debugging: POST request 2023-11-23 16:08:59 -08:00
ishaan-jaff
288e3e962a (feat) cost: azure gpt + testing 2023-11-23 14:20:48 -08:00
ishaan-jaff
78e3d886a4 (feat) cost tracking ft:gpt-3.5-turbo 2023-11-23 13:58:59 -08:00