data2gcs: Store data as collection of zipped json files on cloud...

Description Usage Arguments See Also

Description

Split a dataset into many small json files and upload to a bucket. All files generated in as part of the function call will contain the same generated UUID value

Usage

1
2
data2gcs(my_data, my_file_name, my_bucket, my_foldername, my_metadata,
  chunk_size = 1e+05)

Arguments

my_data

Dataset to upload to gcs. It must pass a validation test

my_file_name

Main name for each json file

my_foldername

Folder to use in the bucket

my_metadata

List of metadata to be associated with the uploaded files

chunk_size

Number of rows per json file, ideally <5mb per file

bucket

Bucket to store the files in

See Also

https://github.com/cloudyr/googleCloudStorageR


iainmwallace/DataDepository documentation built on May 31, 2019, 3:54 a.m.