spark_python_task: Spark Python Task

View source: R/data-structures.R

spark_python_taskR Documentation

Spark Python Task

Description

Spark Python Task

Usage

spark_python_task(python_file, parameters = list())

Arguments

python_file

The URI of the Python file to be executed. DBFS and S3 paths are supported.

parameters

List. Command line parameters passed to the Python file. Use Task parameter variables to set parameters containing information about job runs.

See Also

Other Task Objects: email_notifications(), libraries(), new_cluster(), notebook_task(), pipeline_task(), python_wheel_task(), spark_jar_task(), spark_submit_task()


brickster documentation built on April 12, 2025, 1:21 a.m.