dot-infer_case_from_vocab: Determine Vocabulary Casedness
In morphemepiece: Morpheme Tokenization
.infer_case_from_vocab R Documentation
Determine Vocabulary Casedness
Description
Determine whether or not a wordpiece vocabulary is case-sensitive.
Usage
.infer_case_from_vocab(vocab)
Arguments
vocab
The vocabulary as a character vector.
Details
If none of the tokens in the vocabulary start with a capital letter, it will
be assumed to be uncased. Note that tokens like "\[CLS\]" contain uppercase
letters, but don't start with uppercase letters.
Value
TRUE if the vocabulary is cased, FALSE if uncased.
morphemepiece documentation built on April 16, 2022, 5:05 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| .infer_case_from_vocab | R Documentation |
Determine Vocabulary Casedness
Description
Determine whether or not a wordpiece vocabulary is case-sensitive.
Usage
.infer_case_from_vocab(vocab)
Arguments
vocab |
The vocabulary as a character vector. |
Details
If none of the tokens in the vocabulary start with a capital letter, it will be assumed to be uncased. Note that tokens like "\[CLS\]" contain uppercase letters, but don't start with uppercase letters.
Value
TRUE if the vocabulary is cased, FALSE if uncased.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.