spark_connect_service_start: Starts and stops Spark Connect locally

In pysparklyr: Provides a 'PySpark' Back-End for the 'sparklyr' Package

Starts and stops Spark Connect locally

Description

Starts and stops Spark Connect locally

Usage

spark_connect_service_start(
  version = "3.5",
  scala_version = "2.12",
  include_args = TRUE,
  ...
)

spark_connect_service_stop(version = "3.5", ...)

Arguments

version	Spark version to use (3.4 or above)
scala_version	Acceptable Scala version of packages to be loaded
include_args	Flag that indicates whether to add the additional arguments to the command that starts the service. At this time, only the 'packages' argument is submitted.
...	Optional arguments; currently unused

Value

It returns messages to the console with the status of starting, and stopping the local Spark Connect service.

pysparklyr documentation built on April 3, 2025, 10:30 p.m.