find_tokens: Convert a list of tokens to ngrams

Description Usage Arguments Value

View source: R/find_tokens.R

Description

This code takes a list of text vectors, and returns a list of text vectors, including n-grams

Usage

1

Arguments

x

A character vector

split

The token to split on

regex

whether to treat the split token as a regular expression.

Value

a list of character vectors


zachmayer/r2vec documentation built on May 4, 2019, 9:05 p.m.