collect: Collect from Spark

In clarkfitzg/rddlist: An R list as a Spark RDD (resilient distributed dataset)

Description

Collects and unserializes the entire rdd from Spark back into local R.

Usage

collect(rdd)

Arguments

rdd

rddlist

Value

list The contents of rddlist in a local R list

Examples

x <- list(1:10, letters, rnorm(10))
xrdd <- rddlist(sc, x)
x2 <- collect(xrdd)
identical(x, x2)

clarkfitzg/rddlist documentation built on May 13, 2019, 7:35 p.m.