From 42c363073bb46160dd77403e0fa45f4dd2a12bfe Mon Sep 17 00:00:00 2001 From: ishaan-jaff Date: Sat, 7 Oct 2023 15:49:28 -0700 Subject: [PATCH] (docs) pass aws_access_key_id etc to completion --- docs/my-website/docs/providers/aws_sagemaker.md | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/docs/my-website/docs/providers/aws_sagemaker.md b/docs/my-website/docs/providers/aws_sagemaker.md index 2230b9f29..d2822c1fe 100644 --- a/docs/my-website/docs/providers/aws_sagemaker.md +++ b/docs/my-website/docs/providers/aws_sagemaker.md @@ -27,6 +27,21 @@ response = completion( ) ``` +### Passing credentials as parameters - Completion() +Pass AWS credentials as parameters to litellm.completion +```python +import os +from litellm import completion + +response = completion( + model="sagemaker/jumpstart-dft-meta-textgeneration-llama-2-7b", + messages=[{ "content": "Hello, how are you?","role": "user"}], + aws_access_key_id="", + aws_secret_access_key="", + aws_region_name="", +) +``` + ### Usage - Streaming Sagemaker currently does not support streaming - LiteLLM fakes streaming by returning chunks of the response string