getTokenizers: Tokenizers

Description Usage Value See Also Examples

View source: R/tokenizer.R

Description

Predefined tokenizers.

Usage

1

Value

A character vector with tokenizers provided by package tm.

See Also

Boost_tokenizer, MC_tokenizer and scan_tokenizer.

Examples

1

Example output

Loading required package: NLP
[1] "MC_tokenizer"   "scan_tokenizer"

tm documentation built on April 7, 2021, 3:01 a.m.