remote::s3

Description

AWS S3-based file storage provider for scalable cloud file management with metadata persistence.

Configuration

Field

Type

Required

Default

Description

bucket_name

<class 'str'>

No

S3 bucket name to store files

region

<class 'str'>

No

us-east-1

AWS region where the bucket is located

aws_access_key_id

str | None

No

AWS access key ID (optional if using IAM roles)

aws_secret_access_key

str | None

No

AWS secret access key (optional if using IAM roles)

endpoint_url

str | None

No

Custom S3 endpoint URL (for MinIO, LocalStack, etc.)

auto_create_bucket

<class 'bool'>

No

False

Automatically create the S3 bucket if it doesn’t exist

metadata_store

utils.sqlstore.sqlstore.SqliteSqlStoreConfig | utils.sqlstore.sqlstore.PostgresSqlStoreConfig

No

sqlite

SQL store configuration for file metadata

Sample Configuration

bucket_name: ${env.S3_BUCKET_NAME}
region: ${env.AWS_REGION:=us-east-1}
aws_access_key_id: ${env.AWS_ACCESS_KEY_ID:=}
aws_secret_access_key: ${env.AWS_SECRET_ACCESS_KEY:=}
endpoint_url: ${env.S3_ENDPOINT_URL:=}
auto_create_bucket: ${env.S3_AUTO_CREATE_BUCKET:=false}
metadata_store:
  type: sqlite
  db_path: ${env.SQLITE_STORE_DIR:=~/.llama/dummy}/s3_files_metadata.db