getTokenizers: Tokenizers

Description Usage Value See Also Examples

View source: R/tokenizer.R

Description

Predefined tokenizers.

Usage

1

Value

A character vector with tokenizers provided by package tm.

See Also

Boost_tokenizer, MC_tokenizer and scan_tokenizer.

Examples

1

Example output

Loading required package: NLP
[1] "MC_tokenizer"   "scan_tokenizer"

tm documentation built on Nov. 18, 2020, 5:07 p.m.