getTokenizers: Tokenizers

View source: R/tokenizer.R

getTokenizersR Documentation

Tokenizers

Description

Predefined tokenizers.

Usage

getTokenizers()

Value

A character vector with tokenizers provided by package tm.

See Also

Boost_tokenizer, MC_tokenizer and scan_tokenizer.

Examples

getTokenizers()

tm documentation built on Dec. 28, 2022, 1:51 a.m.