getNGrams: N-gram Tokenizer

Description Usage Arguments Examples

View source: R/NaiveTokenizer.R

Description

Get n-grams from a vector of tokens, supplied as parameter.

Usage

1
getNGrams(token_vec, n = 2)

Arguments

token_vec

vector of atomic character strings

n

cardinality of the pairs

Examples

1
getNGrams(c("Hello", "World", "!"), n = 2)

LazerLambda/RolliNLP documentation built on Oct. 17, 2020, 8:54 p.m.