Commit graph

350 commits

Author SHA1 Message Date
Krrish Dholakia
e678009695 fix(vertex_ai.py): add exception mapping for acompletion calls 2023-12-13 16:35:50 -08:00
Krrish Dholakia
75bcb37cb2 fix(factory.py): fix tgai rendering template 2023-12-13 12:27:31 -08:00
Krrish Dholakia
82d28a8825 fix(factory.py): safely fail prompt template get requests for together ai 2023-12-12 17:28:22 -08:00
Krrish Dholakia
dfdb17ae36 test: refactor testing 2023-12-12 16:21:41 -08:00
Krrish Dholakia
1e970841a4 fix(utils.py): more logging 2023-12-12 15:46:27 -08:00
Krrish Dholakia
bdf29ca71f fix(sagemaker.py): debug streaming 2023-12-12 15:45:07 -08:00
ishaan-jaff
eefb2bbf09 (ci/cd) run again 2023-12-12 12:22:14 -08:00
ishaan-jaff
01d5875426 (test) reset callbacks in completion() 2023-12-11 23:35:52 -08:00
ishaan-jaff
c89ed8f4c8 (ci/cd) test 2023-12-11 23:22:40 -08:00
ishaan-jaff
eb8514ddf6 (test) run ci/cd again 2023-12-11 23:17:23 -08:00
ishaan-jaff
f69653c126 (ci/cd) azure test 2023-12-11 22:22:52 -08:00
Krrish Dholakia
112881cbb2 test(test_completion.py): assert completion cost > 0.0 2023-12-11 07:59:06 -08:00
Krrish Dholakia
9433c3c11b test: trigger ci/cd build 2023-12-09 11:03:19 -08:00
ishaan-jaff
d9b115b8fb (ci/cd) run again 2023-12-08 19:26:55 -08:00
ishaan-jaff
db51a95a42 (test) init success_callback = [] for ci/cd 2023-12-08 19:16:12 -08:00
ishaan-jaff
4cdada62c5 (ci/cd) run another test 2023-12-08 19:04:45 -08:00
ishaan-jaff
1ca50c5fa2 (ci/cd) run again 2023-12-08 18:11:01 -08:00
ishaan-jaff
ccee0cefe4 (ci/cd) run tests 2023-12-08 17:50:14 -08:00
ishaan-jaff
e823e8d99e (test) add vertex ai to ci/cd 2023-12-07 10:20:21 -08:00
Krrish Dholakia
ac7d0a1632 fix(together_ai.py): improve together ai custom prompt templating 2023-12-06 19:34:49 -08:00
Krrish Dholakia
0295509b3b fix(factory.py): fix claude 2.1 prompt template to handle system, assistant, user prompt 2023-12-06 18:02:06 -08:00
Krrish Dholakia
51492125b5 test: skip flaky test 2023-12-06 16:50:02 -08:00
Krrish Dholakia
648d41c96f fix(sagemaker.py): prompt templating fixes 2023-12-05 17:47:44 -08:00
Krrish Dholakia
ff949490de docs(input.md): add hf_model_name to docs 2023-12-05 16:56:18 -08:00
Krrish Dholakia
54d8a9df3f fix(sagemaker.py): enable passing hf model name for prompt template 2023-12-05 16:31:59 -08:00
Krrish Dholakia
b4c78c7b9e fix(utils.py): support sagemaker llama2 custom endpoints 2023-12-05 16:05:15 -08:00
ishaan-jaff
b7281825d3 (test) add streaming sagemaker test 2023-12-04 15:20:06 -08:00
ishaan-jaff
41365b6e47 (test) palm/stream 2023-12-04 15:07:07 -08:00
ishaan-jaff
93f5c266da (test) test completion: if 'user' passed to API 2023-12-04 09:50:36 -08:00
Krrish Dholakia
ac4429c35f test(test_completion.py): commenting out flaky test 2023-12-01 15:06:54 -08:00
Krrish Dholakia
82553e8aac fix(azure.py): fix linting errors 2023-11-30 13:32:29 -08:00
Krrish Dholakia
4f07c8565a feat(main.py): add support for azure-openai via cloudflare ai gateway 2023-11-30 13:19:49 -08:00
Krrish Dholakia
1f5a1122fc fix(replicate.py): fix custom prompt formatting 2023-11-29 19:44:09 -08:00
ishaan-jaff
f4a7760ea1 (feat+test) use passed OpenAI client 2023-11-28 16:09:10 -08:00
ishaan-jaff
01c38d37fa (test) pass client to Azure completion 2023-11-28 15:57:11 -08:00
ishaan-jaff
1a0b683a8e (test) using client: compleition 2023-11-28 15:44:56 -08:00
ishaan-jaff
37f3b1edd1 (ci/cd) run again 2023-11-27 11:12:11 -08:00
ishaan-jaff
a4754f9098 (test) competion 2023-11-27 10:13:46 -08:00
ishaan-jaff
26938f697e (feat) completion:debugging - show raw POST request 2023-11-27 10:13:37 -08:00
ishaan-jaff
90687d51f1 (test) sagemaker add chat models 2023-11-27 10:11:56 -08:00
Krrish Dholakia
95579fda7d fix(utils.py): fix bedrock + cohere calls 2023-11-25 14:45:42 -08:00
ishaan-jaff
565d51a4b4 (test) metadata test in litellm.completion 2023-11-25 11:10:06 -08:00
Krrish Dholakia
e732fb8b97 fix(main.py): logit bias mapping for batch_completions 2023-11-24 16:05:51 -08:00
ishaan-jaff
41c6388185 (test) completion with many params 2023-11-24 14:01:21 -08:00
Krrish Dholakia
94dc3f66f3 fix(utils.py): remove eos token for zephyr models 2023-11-23 17:47:39 -08:00
ishaan-jaff
3ee141e1e2 (test) cleanup 2023-11-23 17:09:36 -08:00
Krrish Dholakia
abe2a009f9 test(test_completion.py): fix azure read from env variable test 2023-11-23 16:58:07 -08:00
ishaan-jaff
f7a5b31b96 (test) azure test passing key as completion param 2023-11-23 16:51:52 -08:00
ishaan-jaff
da7c07574f (test) cost calc on azure 2023-11-23 13:50:09 -08:00
Krrish Dholakia
4f183dc6a0 fix(utils.py): support reading api keys dynamically from the os environment 2023-11-23 13:41:56 -08:00