Make bedrock "just" work

This commit is contained in:
Ashwin Bharambe 2024-12-18 06:22:14 -08:00
parent d6fcdefec7
commit c39a3777b5
3 changed files with 75 additions and 325 deletions

View file

@ -35,6 +35,8 @@ The following models are available by default:
- `meta-llama/Llama-3.1-8B-Instruct (meta.llama3-1-8b-instruct-v1:0)`
- `meta-llama/Llama-3.1-70B-Instruct (meta.llama3-1-70b-instruct-v1:0)`
- `meta-llama/Llama-3.1-405B-Instruct-FP8 (meta.llama3-1-405b-instruct-v1:0)`
- `meta-llama/Llama-3.2-3B-Instruct (meta.llama3-2-3b-instruct-v1:0)`
- `meta-llama/Llama-3.2-1B-Instruct (meta.llama3-2-1b-instruct-v1:0)`
### Prerequisite: API Keys