.process_mp_vocab | R Documentation |
Process a Morphemepiece Vocabulary for Tokenization
.process_mp_vocab(v) ## Default S3 method: .process_mp_vocab(v) ## S3 method for class 'morphemepiece_vocabulary' .process_mp_vocab(v) ## S3 method for class 'integer' .process_mp_vocab(v) ## S3 method for class 'character' .process_mp_vocab(v)
v |
An object of class |
A character vector of tokens for tokenization.
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.