nlp_bert_sentence_embeddings_pretrained: Load a pretrained Spark NLP BertSentenceEmbeddings model

View source: R/bert_sentence_embeddings.R

nlp_bert_sentence_embeddings_pretrainedR Documentation

Load a pretrained Spark NLP BertSentenceEmbeddings model

Description

Create a pretrained Spark NLP BertSentenceEmbeddings model. See https://nlp.johnsnowlabs.com/docs/en/annotators#bertsentenceembeddings

Usage

nlp_bert_sentence_embeddings_pretrained(
  sc,
  input_cols,
  output_col,
  case_sensitive = NULL,
  batch_size = NULL,
  dimension = NULL,
  max_sentence_length = NULL,
  name = NULL,
  lang = NULL,
  remote_loc = NULL
)

Arguments

sc

A Spark connection

input_cols

Input columns. String array.

output_col

Output column. String.

case_sensitive

whether to lowercase tokens or not

batch_size

batch size

dimension

defines the output layer of BERT when calculating embeddings

max_sentence_length

max sentence length to process

name

the name of the model to load. If NULL will use the default value

lang

the language of the model to be loaded. If NULL will use the default value

remote_loc

the remote location of the model. If NULL will use the default value

Value

The Spark NLP model with the pretrained model loaded


r-spark/sparknlp documentation built on Oct. 15, 2022, 10:50 a.m.