dot-new_wordpiece_vocabulary: Constructor for Class wordpiece_vocabulary
In wordpiece: R Implementation of Wordpiece Tokenization
.new_wordpiece_vocabulary R Documentation
Constructor for Class wordpiece_vocabulary
Description
Constructor for Class wordpiece_vocabulary
Usage
.new_wordpiece_vocabulary(vocab, is_cased)
Arguments
vocab
Character vector of tokens.
is_cased
Logical; whether the vocabulary is cased.
Value
The vocabulary with is_cased attached as an attribute, and the
class wordpiece_vocabulary applied.
wordpiece documentation built on March 18, 2022, 5:55 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| .new_wordpiece_vocabulary | R Documentation |
Constructor for Class wordpiece_vocabulary
Description
Constructor for Class wordpiece_vocabulary
Usage
.new_wordpiece_vocabulary(vocab, is_cased)
Arguments
vocab |
Character vector of tokens. |
is_cased |
Logical; whether the vocabulary is cased. |
Value
The vocabulary with is_cased attached as an attribute, and the
class wordpiece_vocabulary applied.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.