From 79e93ee7aa36df42592fa88193a94198efec94cb Mon Sep 17 00:00:00 2001 From: ishaan-jaff Date: Fri, 17 Nov 2023 10:04:33 -0800 Subject: [PATCH] (docs) proxy - aws sagemaker jumpstart --- docs/my-website/docs/simple_proxy.md | 21 +++++++++++++++++---- 1 file changed, 17 insertions(+), 4 deletions(-) diff --git a/docs/my-website/docs/simple_proxy.md b/docs/my-website/docs/simple_proxy.md index 8040af874..aea529c1e 100644 --- a/docs/my-website/docs/simple_proxy.md +++ b/docs/my-website/docs/simple_proxy.md @@ -75,12 +75,12 @@ print(response) ### Supported LLMs - + ```shell -$ export AWS_ACCESS_KEY_ID="" -$ export AWS_REGION_NAME="" # e.g. us-west-2 -$ export AWS_SECRET_ACCESS_KEY="" +$ export AWS_ACCESS_KEY_ID= +$ export AWS_REGION_NAME= +$ export AWS_SECRET_ACCESS_KEY= ``` ```shell @@ -124,6 +124,19 @@ $ litellm --model huggingface/ --api_base https://k58ory32yinf1 $ litellm --model huggingface/ --api_base http://0.0.0.0:8001 ``` + + + +```shell +export AWS_ACCESS_KEY_ID= +export AWS_REGION_NAME= +export AWS_SECRET_ACCESS_KEY= +``` + +```shell +$ litellm --model sagemaker/jumpstart-dft-meta-textgeneration-llama-2-7b +``` +