phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-04 04:04:14 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/docs/source/providers/inference/remote_bedrock.md
Sumanth Kamenani 0b00c68d59
fix: use lambda pattern for bedrock config env vars (#3307) 
# What does this PR do?

Improved bedrock provider config to read from environment variables like
AWS_ACCESS_KEY_ID. Updated all
fields to use default_factory with lambda patterns like the nvidia
provider does.

  Now the environment variables work as documented.

  Closes #3305

  ## Test Plan

  Ran the new bedrock config tests:
  ```bash
python -m pytest tests/unit/providers/inference/bedrock/test_config.py
-v

Verified existing provider tests still work:
  python -m pytest tests/unit/providers/test_configs.py -v
2025-09-05 10:45:11 +02:00

1.8 KiB
Raw Blame History

remote::bedrock

Description

AWS Bedrock inference provider for accessing various AI models through AWS's managed service.

Configuration

Field Type Required Default Description
aws_access_key_id str | None No The AWS access key to use. Default use environment variable: AWS_ACCESS_KEY_ID
aws_secret_access_key str | None No The AWS secret access key to use. Default use environment variable: AWS_SECRET_ACCESS_KEY
aws_session_token str | None No The AWS session token to use. Default use environment variable: AWS_SESSION_TOKEN
region_name str | None No The default AWS Region to use, for example, us-west-1 or us-west-2.Default use environment variable: AWS_DEFAULT_REGION
profile_name str | None No The profile name that contains credentials to use.Default use environment variable: AWS_PROFILE
total_max_attempts int | None No An integer representing the maximum number of attempts that will be made for a single request, including the initial attempt. Default use environment variable: AWS_MAX_ATTEMPTS
retry_mode str | None No A string representing the type of retries Boto3 will perform.Default use environment variable: AWS_RETRY_MODE
connect_timeout float | None No 60.0 The time in seconds till a timeout exception is thrown when attempting to make a connection. The default is 60 seconds.
read_timeout float | None No 60.0 The time in seconds till a timeout exception is thrown when attempting to read from a connection.The default is 60 seconds.
session_ttl int | None No 3600 The time in seconds till a session expires. The default is 3600 seconds (1 hour).

Sample Configuration

{}