tokenize_docs: Tokenize Docs

Description Usage Arguments Value Examples

View source: R/cleaning.R

Description

performs vectorized tokenization for each entry of the document

Usage

1

Arguments

docs

a vector or list of text samples

Value

a list of tokenized results for each each entry in the doc

Examples

1
tokenize_docs( c('First entry of the doc,', 'Second entry of the doc.') )

duncankmckinnon/ezRnlp documentation built on Aug. 6, 2020, 1:28 a.m.