forked from phoenix/litellm-mirror
bedrock docs
This commit is contained in:
parent
0c96b61fce
commit
ba3a5cee2e
1 changed files with 2 additions and 2 deletions
|
@ -31,5 +31,5 @@ Here's an example of using a bedrock model with LiteLLM
|
||||||
|
|
||||||
| Model Name | Function Call | Required OS Variables |
|
| Model Name | Function Call | Required OS Variables |
|
||||||
|------------------|--------------------------------------------|------------------------------------|
|
|------------------|--------------------------------------------|------------------------------------|
|
||||||
| Llama2 7B | `completion(model='sagemaker/jumpstart-dft-meta-textgeneration-llama-2-7b, messages=messages)` | `os.environ['AWS_ACCESS_KEY_ID']`, `os.environ['AWS_SECRET_ACCESS_KEY']`, `os.environ['AWS_REGION_NAME']` |
|
| Titan Text Large | `completion(model='bedrock/amazon.titan-tg1-large', messages=messages)` | `os.environ['AWS_ACCESS_KEY_ID']`, `os.environ['AWS_SECRET_ACCESS_KEY']`, `os.environ['AWS_REGION_NAME']` |
|
||||||
| Custom LLM Endpoint | `completion(model='sagemaker/your-endpoint, messages=messages)` | `os.environ['AWS_ACCESS_KEY_ID']`, `os.environ['AWS_SECRET_ACCESS_KEY']`, `os.environ['AWS_REGION_NAME']` |
|
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue