generate_data_ingestion_flow_from_athena_dataset_definition: generate data ingestion flow from athena dataset definition

In DyfanJones/sagemaker-r-workflow: sagemaker pipeline and workflows

generate data ingestion flow from athena dataset definition

Description

Generate the data ingestion only flow from athena input

Usage

generate_data_ingestion_flow_from_athena_dataset_definition(
  input_name,
  athena_dataset_definition,
  operator_version = "0.1",
  schema = NULL
)

Arguments

input_name	(str): the name of the input to flow source node
athena_dataset_definition	(AthenaDatasetDefinition): athena input to flow source node
operator_version	(str): the version of the operator
schema	(list): the schema for the data to be ingested

Value

dict (typing.Dict): A flow only conduct data ingestion with 1-1 mapping output_name (str): The output name used to configure 'sagemaker.processing.FeatureStoreOutput'

DyfanJones/sagemaker-r-workflow documentation built on April 3, 2022, 11:28 p.m.