nlp_bert_embeddings_pretrained: Load a pretrained Spark NLP BertEmbeddings model

View source: R/bert-embeddings.R

nlp_bert_embeddings_pretrainedR Documentation

Load a pretrained Spark NLP BertEmbeddings model

Description

Create a pretrained Spark NLP BertEmbeddings model

Usage

nlp_bert_embeddings_pretrained(
  sc,
  input_cols,
  output_col,
  case_sensitive = NULL,
  batch_size = NULL,
  dimension = NULL,
  lazy_annotator = NULL,
  max_sentence_length = NULL,
  storage_ref = NULL,
  name = NULL,
  lang = NULL,
  remote_loc = NULL
)

Arguments

sc

A Spark connection

input_cols

Input columns. String array.

output_col

Output column. String.

case_sensitive

whether to treat the tokens as case insensitive when looking up their embedding

batch_size

batch size

dimension

the embedding dimension

lazy_annotator

use as a lazy annotator or not

max_sentence_length

set the maximum sentence length

storage_ref

storage reference name

name

the name of the model to load. If NULL will use the default value

lang

the language of the model to be loaded. If NULL will use the default value

remote_loc

the remote location of the model. If NULL will use the default value

Value

The Spark NLP model with the pretrained model loaded


r-spark/sparknlp documentation built on Oct. 15, 2022, 10:50 a.m.