erm.hdfsWrite: hdfsWrite function

Description Usage Arguments Examples

Description

Writes the output from the supplied string or function directly to an hdfs file System must have an environment variable defined for the location of the HADOOP command named HADOOP_CMD

Usage

1
erm.hdfsWrite(output, hdfsFilename, append = FALSE)

Arguments

output

Any string or a function that outputs text directly to the console. This text will be redirected to the hdfs file

hdfsFilename

Full path to the hdfs file to write the contents

append

Default is FALSE and will delete the file before writing the contents. TRUE will append to the existing file

Examples

1
2
erm.hdfsWrite(fwrite(mydatatable), "/user/tcederquist/mysample.csv")
erm.hdfsWrite(fwrite(mydatatable[100:200,]), "/user/tcederquist/mysample.csv", append=TRUE)

tcederquist/ermhdfs documentation built on May 30, 2019, 8:19 a.m.