s3_list_bucket: List S3 bucket content into data.table

In fcocquemas/hfty.helpers: Helper functions (paths, input/output, cloud...)

List S3 bucket content into data.table

Description

List S3 bucket content into data.table

Usage

s3_list_bucket(
  prefix,
  conf = list(),
  pattern = "",
  max = Inf,
  quiet = FALSE,
  ...
)

Arguments

prefix	string prefix of S3 files to select. Needs to include the URL scheme and bucket name (s3://bucket_name/)
conf	list with 'key', 'secret', 'region', and 'base_url' parameters. If missing, will look for AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY and AWS_DEFAULT_REGION in environment variables.
pattern	string regexp to filter results
max	integer max number of records to return, pre-filtering. Default to Inf
quiet	logical turn off output messages, default to FALSE
...	additional arguments passed to aws.s3::get_bucket

Examples

## Not run: 
s3_list_bucket("s3://hfty-test-bucket/")
s3_list_bucket("s3://hfty-test-bucket/", pattern = "\\.txt$")

## End(Not run)

fcocquemas/hfty.helpers documentation built on Feb. 13, 2023, 7:25 a.m.