phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

(docs) proxy - aws sagemaker jumpstart

Browse source
This commit is contained in:
ishaan-jaff 2023-11-17 10:04:33 -08:00
parent 107edc631c
commit 79e93ee7aa
1 changed files with 17 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

21
docs/my-website/docs/simple_proxy.md
View file

@ -75,12 +75,12 @@ print(response)
### Supported LLMs
<Tabs>
<TabItem value="bedrock" label="Bedrock">
<TabItem value="bedrock" label="AWS Bedrock">
```shell
$ export AWS_ACCESS_KEY_ID=""
$ export AWS_REGION_NAME="" # e.g. us-west-2
$ export AWS_SECRET_ACCESS_KEY=""
$ export AWS_ACCESS_KEY_ID=
$ export AWS_REGION_NAME=
$ export AWS_SECRET_ACCESS_KEY=
```
```shell
@ -124,6 +124,19 @@ $ litellm --model huggingface/<your model name> --api_base https://k58ory32yinf1
$ litellm --model huggingface/<your model name> --api_base http://0.0.0.0:8001
```
</TabItem>
<TabItem value="aws-sagemaker" label="AWS Sagemaker">
```shell
export AWS_ACCESS_KEY_ID=
export AWS_REGION_NAME=
export AWS_SECRET_ACCESS_KEY=
```
```shell
$ litellm --model sagemaker/jumpstart-dft-meta-textgeneration-llama-2-7b
```
</TabItem>
<TabItem value="anthropic" label="Anthropic">