tokenize: Tokenize
In dtburk/texanaaid: An Aide for Text Analysis

This function takes a Corpus or vector of documents and returns a list of character vectors of the tokens (words) in each document.

1	tokenize(x)

`x`	An object inheriting from Corpus, a list of character vectors, or a character vector.

A list of character vectors of the tokens (words) in each document.

1 2	docs <- c("What are you doing down there, crashy?", "I'm real good at lying to Lois.") words <- tokenize(docs)

dtburk/texanaaid documentation built on Nov. 12, 2019, 9:44 p.m.

dtburk/texanaaid index

README.md

Note that we can't provide technical support on individual packages. You should contact the package authors for that.

Description