R based HDFS functions for directing the output of any standard print based functions into and out of an HDFS file. These functions do not need extra memory for caching, staging, or otherwise converting values. These functions are simple, fast, and memory efficient.
Pre-requisites Environment variable * HADOOP_CMD = location of the hadoop command line executable such as when running 'hadoop fs -ls /anHdfsFolder' Installation * library(devtools) * install_github('tcederquist/ermhdfs') * Run * library(ermhdfs)
Example
erm.hdfsWrite(fwrite(mydatatable), "/user/tcederquist/mysample.csv")
Creates a string that can be used by any pipe friendly function to stream the contents of the html file.
Example
dat.df3<-fread(erm.hdfsReadP("/user/tcederquist/tim_pop_comm_14_5"),sep=",", header=TRUE, showProgress=F)
Delete removes the specified file from the supplied HDFS folder
Example
erm.hdfsDelete('/user/tcederquist/mysample.csv')
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.