Description Usage Arguments See Also Examples
View source: R/unnest_sentence.R
These functions are wrappers around unnest_tokens( token = "sentences" )
unnest_tokens( token = "lines" )
and unnest_tokens( token = "paragraphs" )
.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 | unnest_sentences(
tbl,
output,
input,
strip_punct = FALSE,
format = c("text", "man", "latex", "html", "xml"),
to_lower = TRUE,
drop = TRUE,
collapse = NULL,
...
)
unnest_lines(
tbl,
output,
input,
format = c("text", "man", "latex", "html", "xml"),
to_lower = TRUE,
drop = TRUE,
collapse = NULL,
...
)
unnest_paragraphs(
tbl,
output,
input,
paragraph_break = "\n\n",
format = c("text", "man", "latex", "html", "xml"),
to_lower = TRUE,
drop = TRUE,
collapse = NULL,
...
)
|
tbl |
A data frame |
output |
Output column to be created as string or symbol. |
input |
Input column that gets split as string or symbol. The output/input arguments are passed by expression and support quasiquotation; you can unquote strings and symbols. |
strip_punct |
Should punctuation be stripped? |
format |
Either "text", "man", "latex", "html", or "xml". If not text, this uses the hunspell tokenizer, and can tokenize only by "word" |
to_lower |
Whether to convert tokens to lowercase. If tokens include
URLS (such as with |
drop |
Whether original input column should get dropped. Ignored if the original input and new output column have the same name. |
collapse |
Whether to combine text with newlines first in case tokens (such as sentences or paragraphs) span multiple lines. If NULL, collapses when token method is "ngrams", "skip_ngrams", "sentences", "lines", "paragraphs", or "regex". |
... |
Extra arguments passed on to tokenizers |
paragraph_break |
A string identifying the boundary between two paragraphs. |
unnest_tokens()
1 2 3 4 5 6 7 | library(dplyr)
library(janeaustenr)
d <- tibble(txt = prideprejudice)
d %>%
unnest_sentences(word, txt)
|
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.