mantaJob.setup: Constructor for R format Manta Job including 'name', and UNIX...

Description Usage Arguments Details See Also Examples

View source: R/mantaJob.setup.R

Description

Function to construct R structure for mantaJob.launch. Specify a name for the Manta job and tasks to execute via one or more calls to mantaMap and/or mantaReduce which define and parameterize each task.

Usage

1

Arguments

name

character, optional.

...

One or more mantaMap mantaReduce functions with arguments listed in order of task execution.

Details

mantaJob.setup combines multiple tasks into a job pipeline structure for mantaJob.launch. See mantaMap and mantaReduce for parameter details. Their exec parameter must be a valid generic UNIX command line, not an R function.

See Also

Other mantaJobs: mantaJob.cancel; mantaJob.done; mantaJob.errors.stderr; mantaJob.errors; mantaJob.failures; mantaJob.inputs; mantaJob.launch; mantaJob.outputs.cat; mantaJob.outputs; mantaJob.status; mantaJobs.running; mantaJobs.tail; mantaJobs; mantaMap; mantaReduce

Examples

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
## Not run: 
##  Map/Reduce Unix Word Count Job description
job <- mantaJob.setup("Word Count",
  mantaMap("wc"),
  mantaReduce("awk '\{ l += $1; w += $2; c += $3 \} END \{ print l, w, c \}'"))
## Launch the Job with some text files as input:
inputs <- mantaLs.paths("~~/stor/shakespeare", grepfor = "[.]txt")
mantaJob.launch(inputs, job)
## Check output
mantaJob.outputs()
## Check errors
mantaJob.errors()

## End(Not run)

joyent/mantaRSDK documentation built on May 19, 2019, 10:43 p.m.