tokenize | R Documentation |
Tokenize sentences using a tagger
tokenize(
x,
text_field = "text",
docid_field = "doc_id",
split = FALSE,
mode = c("parse", "wakati"),
tagger
)
x |
A data.frame like object or a character vector to be tokenized. |
text_field |
< |
docid_field |
< |
split |
split Logical. When passed as |
mode |
Character scalar to switch output format. |
tagger |
A tagger function created by |
A tibble or a named list of tokens.
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.