num_tokens: Parameter to determine number of tokens in ngram

View source: R/param_num_tokens.R

num_tokensR Documentation

Parameter to determine number of tokens in ngram

Description

Used in textrecipes::step_ngram().

Usage

num_tokens(range = c(1, 3), trans = NULL)

Arguments

range

A two-element vector holding the defaults for the smallest and largest possible values, respectively. If a transformation is specified, these values should be in the transformed units.

trans

A trans object from the scales package, such as scales::transform_log10() or scales::transform_reciprocal(). If not provided, the default is used which matches the units used in range. If no transformation, NULL.

Examples

num_tokens()

tidymodels/dials documentation built on March 18, 2024, 6:30 a.m.