drsstl: Apply sstl routine to spatial-temporal dataset

In XiaosuTong/drsstl: Spatial Seasonal Trend Loess analysis routine using divide and recombined

Description

sstl routine is applied to a spatial-temporal dataset either in memory or on HDFS.

Usage

drsstl(data, output = NULL, stat_info = NULL,
  model_control = spacetime.control(), cluster_control = NULL)

Arguments

data	The input path of raw text file on HDFS or a data.frame object in memory
output	The output path of fitting results on HDFS. If data is a data.frame object, the output should be set as default NULL. Since the drsstl function will return the fitting results in memory.
stat_info	The RData on HDFS which contains all station metadata. Make sure copy the RData of station_info to HDFS first using rhput.
model_control	Should be a list object generated from spacetime.control function. The list including all necessary smoothing parameters of nonparametric fitting.
cluster_control	Should be a list object generated from mapreduce.control function. The list including all necessary Rhipe parameters and also user tunable MapReduce parameters. It is only necessary for data on HDFS situation. If data is data.frame in memory, this parameter should be kept as default NULL.

Author(s)

Xiaosu Tong

Examples

## Not run: 
    head(tmax_all)
    mcontrol <- spacetime.control(
      vari="tmax", n=576, n.p=12, stat_n=7738,
      s.window=13, t.window = 241, degree=2, span=0.015, Edeg=2
    )
    ccontrol <- mapreduce.control(
      libLoc= NULL, reduceTask=169, io_sort=128, slow_starts = 0.5,
      map_jvm = "-Xmx200m", reduce_jvm = "-Xmx200m",
      map_memory = 1024, reduce_memory = 1024,
      reduce_input_buffer_percent=0.4, reduce_parallelcopies=10,
      reduce_merge_inmem=0, task_io_sort_factor=100,
      spill_percent=0.9, reduce_shuffle_input_buffer_percent = 0.8,
      reduce_shuffle_merge_percent = 0.4
    )

    #If the data is on HDFS
    drsstl(
      data = "/tmp/tmax.txt", output = "/tmp/output",
      stat_info = "/tmp/station_info.RData", model_control = mcontrol,
      cluster_control=ccontrol
    )

    #If the data is tmax_all which is in memory
    drsstl(tmax_all, model_control=mcontrol, cluster_control=ccontrol)

## End(Not run)

XiaosuTong/drsstl documentation built on May 9, 2019, 11:06 p.m.