EMRStep: EMRStep class

In DyfanJones/sagemaker-r-workflow: sagemaker pipeline and workflows

EMRStep class

Description

EMR step for workflow.

Super classes

sagemaker.workflow::Entity -> sagemaker.workflow::Step -> EMRStep

Active bindings

arguments

The arguments dict that is used to call 'AddJobFlowSteps'. NOTE: The AddFlowJobSteps request is not quite the args list that workflow needs. The Name attribute in AddJobFlowSteps cannot be passed; it will be set during runtime. In addition to that, we will also need to include emr job inputs and output config.

properties

A Properties object representing the EMR DescribeStepResponse model

Methods

Public methods

• EMRStep$new()

• EMRStep$to_request()

• EMRStep$clone()

Inherited methods

• sagemaker.workflow::Step$add_depends_on()

• sagemaker.workflow::Step$format()

---

Method new()

Constructs a EMRStep.

Usage

EMRStep$new(
  name,
  display_name,
  description,
  cluster_id,
  step_config,
  depends_on = NULL,
  cache_config = NULL
)

Arguments

name

(str): The name of the EMR step.

display_name

(str): The display name of the EMR step.

description

(str): The description of the EMR step.

cluster_id

(str): The ID of the running EMR cluster.

step_config

(EMRStepConfig): One StepConfig to be executed by the job flow.

depends_on

(List[str]): A list of step names this 'sagemaker.workflow.steps.EMRStep' depends on

cache_config

(CacheConfig): A 'sagemaker.workflow.steps.CacheConfig' instance.

---

Method to_request()

Updates the dictionary with cache configuration.

Usage

EMRStep$to_request()

---

Method clone()

The objects of this class are cloneable with this method.

Usage

EMRStep$clone(deep = FALSE)

Arguments

deep

Whether to make a deep clone.

DyfanJones/sagemaker-r-workflow documentation built on April 3, 2022, 11:28 p.m.