nlp_recursive_pipeline: Spark NLP RecursivePipeline

In r-spark/sparknlp: R Interface to John Snow Labs Spark NLP

Spark NLP RecursivePipeline

Description

Recursive pipelines are SparkNLP specific pipelines that allow a Spark ML Pipeline to know about itself on every Pipeline Stage task, allowing annotators to utilize this same pipeline against external resources to process them in the same way the user decides. Only some of our annotators take advantage of this. RecursivePipeline behaves exactly the same than normal Spark ML pipelines, so they can be used with the same intention. See https://nlp.johnsnowlabs.com/docs/en/concepts#recursivepipeline

Usage

nlp_recursive_pipeline(x, ..., uid = random_string("recursive_pipeline_"))

Arguments

x	Either a spark_connection or ml_pipeline_stage objects
...	ml_pipeline_stage objects
uid	uid for the pipeline

Value

When x is a spark_connection, ml_pipeline() returns an empty pipeline object. When x is a ml_pipeline_stage, ml_pipeline() returns an ml_pipeline with the stages set to x and any transformers or estimators given in ....

r-spark/sparknlp documentation built on Oct. 15, 2022, 10:50 a.m.