tok_token: Tokenizator of token
In UBESP-DCTV/costumer: COmprehensive Searches ThroUgh Machine learning for systEmatic Reviews
tok_token R Documentation
Tokenizator of token
Description
The function's aim is to access tokens at their single-words component level
maintaining the information of the original token structure
Usage
tok_token(doc)
Arguments
doc
(chr) A character vector representing a tokenized tocument
Value
(list) of character vector each element representing
the word-components of each original token
Examples
tokened_document <- c('this is', 'is a', 'a beautiful', 'beautiful day')
tok_token(tokened_document)
UBESP-DCTV/costumer documentation built on Feb. 1, 2023, 4:52 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| tok_token | R Documentation |
Tokenizator of token
Description
The function's aim is to access tokens at their single-words component level maintaining the information of the original token structure
Usage
tok_token(doc)
Arguments
doc |
(chr) A character vector representing a tokenized tocument |
Value
(list) of character vector each element representing the word-components of each original token
Examples
tokened_document <- c('this is', 'is a', 'a beautiful', 'beautiful day')
tok_token(tokened_document)
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.