S3GetUnload: Read s3 files generated from Unload SQL command

In rvladimiro/dafR: Data Analysis Framework in R

Description

This function reads into a data table the files generated from an unload command. The files that are read in, are the ones that share the prefix passed on the argument The prefix should contain the absolute path to the s3 folder holding the files alternatively we can pass the function a character vector listing all the files to be read

The yaml file must contain s3 bucket name, user and password.

Arguments

filePrefix	Either a character vector with length 1, with the prefix shared by the objects to be read, or a character vector listing the full path of each obejct to be read
dbID	The name of the yaml group containing the database credentials
s3ID	The name of the yaml group containing the s3 bucket credentials
yamlConfig	The path to the yaml file
acceleration	Use s3 bucket acceleration
parallel	Use parallel package for simultaneous connections to s3

Value

The function will return a data.table object with the content of the files that were read from the s3 bucket

Author(s)

João Monteiro

rvladimiro/dafR documentation built on June 26, 2019, 4:37 a.m.