nlp_sentence_entity_resolver_pretrained: Load a pretrained Spark NLP T5 Transformer model

In r-spark/sparknlp: R Interface to John Snow Labs Spark NLP

Load a pretrained Spark NLP T5 Transformer model

Description

Create a pretrained Spark NLP T5TransformerModel model

Usage

nlp_sentence_entity_resolver_pretrained(
  sc,
  input_cols,
  output_col,
  case_sensitive = NULL,
  confidence_function = NULL,
  distance_function = NULL,
  miss_as_empty = NULL,
  neighbors = NULL,
  threshold = NULL,
  name = NULL,
  lang = NULL,
  remote_loc = NULL
)

Arguments

sc	A Spark connection
input_cols	Input columns. String array.
output_col	Output column. String.
case_sensitive	whether to treat the entities as case sensitive
confidence_function	what function to use to calculate confidence: INVERSE or SOFTMAX
distance_function	what distance function to use for KNN: 'EUCLIDEAN' or 'COSINE'
miss_as_empty	whether or not to return an empty annotation on unmatched chunks
neighbors	number of neighbours to consider in the KNN query to calculate WMD
threshold	threshold value for the aggregated distance
name	the name of the model to load. If NULL will use the default value
lang	the language of the model to be loaded. If NULL will use the default value
remote_loc	the remote location of the model. If NULL will use the default value

Value

The Spark NLP model with the pretrained model loaded

r-spark/sparknlp documentation built on Oct. 15, 2022, 10:50 a.m.