sparkRSessionCreateIfNotPresent: Connect to a Spark session

Description Usage Arguments Details See Also Examples

View source: R/spark-structured-streaming-utilities.R

Description

Connect to a Spark session

Usage

1

Arguments

...

Arguments to sparkR.session

Details

Loads the SparkR package and intializes a Spark session from R

See Also

Other Spark utilities: castKafkaStreamAsString, convertKafkaValueFromJson

Examples

1
2
3
4
5
6
7
8
## Not run: 
sparkHome <- "/Users/naren/softwares/spark-2.3.1-bin-hadoop2.7/"
sparkMaster <- "local[1]"
sparkPackages <- c("org.apache.spark:spark-sql-kafka-0-10_2.11:2.3.1")
sparkRSessionCreateIfNotPresent(master = sparkMaster,
 sparkPackages = sparkPackages)

## End(Not run)

analysisPipelines documentation built on July 1, 2020, 7:09 p.m.