validate_sc: Validate and/or establish a spark connection

In tobyjohnson/gtx: Genetics ToolboX

Description

validate_sc() - Validate spark connection This will validate a spark connection. If it does not exists, it will try to safely establish the the connection and return it. Note, if validate_sc has to create the Spark connection it will use the default settings.

Usage

validate_sc(sc = getOption("gtx.sc", NULL), spark_version = "2.2.0",
  app_name = "sparklyr", sc_config = spark_config())

Arguments

sc	Spark connection to validate. Defaults to checking options(gtx.sc).

Value

Spark connection

Author(s)

Karsten Sieber [e-mail]

Examples

sc <- validate_sc(sc)
sc <- validate_sc()

tobyjohnson/gtx documentation built on Aug. 30, 2019, 8:07 p.m.