Commit graph

27 commits

Author SHA1 Message Date
Krrish Dholakia
6d1a5089e3 refactor: fix linting errors 2023-12-06 11:46:15 -08:00
Krrish Dholakia
45e9c3eb31 feat(sagemaker.py): support huggingface embedding models 2023-12-06 11:41:38 -08:00
Krrish Dholakia
2e5dc00968 fix(sagemaker.py): prompt templating fixes 2023-12-05 17:47:44 -08:00
Krrish Dholakia
c01b15af17 docs(input.md): add hf_model_name to docs 2023-12-05 16:56:18 -08:00
Krrish Dholakia
fc07598b21 fix(sagemaker.py): bring back llama2 templating for sagemaker 2023-12-05 16:42:19 -08:00
Krrish Dholakia
f9b74e54a3 fix(sagemaker.py): enable passing hf model name for prompt template 2023-12-05 16:31:59 -08:00
Krrish Dholakia
20dab6f636 fix(sagemaker.py): fix meta llama model name for sagemaker custom deployment 2023-12-05 16:23:03 -08:00
Krrish Dholakia
976e1f9f66 fix(sagemaker.py): accept all amazon neuron llama2 models 2023-12-05 16:19:28 -08:00
Krrish Dholakia
c4a3e1e564 fix(sagemaker.py): add support for amazon neuron llama models 2023-12-05 16:18:20 -08:00
Krrish Dholakia
7e42c64cc5 fix(utils.py): support sagemaker llama2 custom endpoints 2023-12-05 16:05:15 -08:00
ishaan-jaff
f61a74f886 (linting) fix 2023-11-27 10:27:51 -08:00
ishaan-jaff
4bd13bc006 (feat) completion:sagemaker - support chat models 2023-11-27 10:11:10 -08:00
ishaan-jaff
bb4116f2ab (feat) completion:sagemaker - better debugging 2023-11-27 09:08:20 -08:00
ishaan-jaff
7bc28f3b1c (fix) pydantic errors with response.time 2023-11-20 18:28:19 -08:00
Krrish Dholakia
4b74ddcb17 refactor: fixing linting issues 2023-11-11 18:52:28 -08:00
Krrish Dholakia
5efa3860da refactor(huggingface,-anthropic,-replicate,-sagemaker): making huggingface, anthropic, replicate, sagemaker compatible openai v1 sdk 2023-11-11 17:38:15 -08:00
ishaan-jaff
194b6263c7 (feat) add model_response.usage.completion_tokens for bedrock, palm, petals, sagemaker 2023-10-27 09:51:50 -07:00
Krrish Dholakia
cc0e4f4f9f fix: fix value error if model returns empty completion 2023-10-10 10:11:40 -07:00
ishaan-jaff
a294438802 (feat) sagemaker auth in completion 2023-10-07 15:27:58 -07:00
Krrish Dholakia
69cdf5347a style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00
Krrish Dholakia
8c48af11c2 fixes to get optional params 2023-10-02 14:44:11 -07:00
ishaan-jaff
fb1c0545be bump version with bedrock 2023-09-14 14:54:36 -07:00
ishaan-jaff
41e064880f fix sagemaker test 2023-09-14 14:49:46 -07:00
ishaan-jaff
f156733ed3 allow users to set AWS_REGION_NAME 2023-09-04 11:57:22 -07:00
ishaan-jaff
44f44ad5a3 add optional params for llama-2 2023-09-04 11:41:20 -07:00
ishaan-jaff
746001e32a working sagemaker support 2023-09-04 11:30:34 -07:00
ishaan-jaff
022c632ce4 v0 add sagemaker 2023-09-04 11:02:20 -07:00