write_df_to_table_in_s3: Write an in-memory data frame to a csv file stored in S3

In moj-analytical-services/Rs3tools: Helper tools to access Amazon S3, compatible with s3tools

Write an in-memory data frame to a csv file stored in S3

Description

This function is similar to write_df_to_csv_in_s3 but uses write.table to write the data frame to a csv as opposed to write.csv. This allows the following additional arguments to be passed to write.table: append, col.names, sep, dec, qmethod.

Usage

write_df_to_table_in_s3(
  df,
  s3_path,
  overwrite = FALSE,
  multipart = TRUE,
  sep = ",",
  ...
)

Arguments

df	A data frame you want to upload to S3.
s3_path	A character string containing the full path to where the file should be stored in S3, including any directory names and the bucket name.
overwrite	A logical indicating whether to overwrite the file if it already exists.
multipart	A logical indicating whether to use multipart uploads. See http://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html. If df is less than 100 MB when written to csv, this is ignored.
sep	A string used to separate values within each row of df.
...	Additional arguments passed to write.table.

Value

Returns nothing

Examples

write_df_to_table_in_s3(df, "alpha-everyone/delete/my_csv.csv")

moj-analytical-services/Rs3tools documentation built on Aug. 9, 2024, 1:27 a.m.