dot-new_wordpiece_vocabulary: Constructor for Class wordpiece_vocabulary

.new_wordpiece_vocabularyR Documentation

Constructor for Class wordpiece_vocabulary

Description

Constructor for Class wordpiece_vocabulary

Usage

.new_wordpiece_vocabulary(vocab, is_cased)

Arguments

vocab

Character vector of tokens.

is_cased

Logical; whether the vocabulary is cased.

Value

The vocabulary with is_cased attached as an attribute, and the class wordpiece_vocabulary applied.


jonathanbratt/wordpiece documentation built on March 30, 2022, 11:40 a.m.