tokenize: break character strings into words

Description Usage Arguments Value See Also Examples

View source: R/tokenize.R

Description

Separates a character string into individual words. Wraps stringr package str_split.

Usage

1

Arguments

x

length 1 character vector

Value

words character vector of tokenized words

See Also

str_split boundary

Examples

1
tokenize("This is a wonderful R package, isn't it?")

markallenthornton/affectr documentation built on May 17, 2019, 2:15 a.m.