EMRStepConfig: EMRStepConfig class

In DyfanJones/sagemaker-r-workflow: sagemaker pipeline and workflows

EMRStepConfig class

Description

Config for a Hadoop Jar step

Public fields

jar

A path to a JAR file run during the step.

args

A list of command line arguments

main_class

The name of the main class in the specified Java file.

properties

A list of key-value pairs that are set when the step runs.

Methods

Public methods

• EMRStepConfig$new()

• EMRStepConfig$to_request()

• EMRStepConfig$format()

• EMRStepConfig$clone()

---

Method new()

Create a definition for input data used by an EMR cluster(job flow) step. See AWS documentation on the “StepConfig“ API for more details on the parameters.

Usage

EMRStepConfig$new(jar, args = NULL, main_class = NULL, properties = NULL)

Arguments

jar

(str): A path to a JAR file run during the step.

args

(List[str]): A list of command line arguments passed to the JAR file's main function when executed.

main_class

(str): The name of the main class in the specified Java file.

properties

(List(dict)): A list of key-value pairs that are set when the step runs.

---

Method to_request()

Convert EMRStepConfig object to request list.

Usage

EMRStepConfig$to_request()

---

Method format()

format class

Usage

EMRStepConfig$format()

---

Method clone()

The objects of this class are cloneable with this method.

Usage

EMRStepConfig$clone(deep = FALSE)

Arguments

deep

Whether to make a deep clone.

DyfanJones/sagemaker-r-workflow documentation built on April 3, 2022, 11:28 p.m.