dictionary_tokenize: Separate dictionary values using tokenizer

View source: R/dictionaries.R

dictionary_tokenizeR Documentation

Separate dictionary values using tokenizer

Description

Apply tokens() to dictionary values to improve pattern matching.

Usage

dictionary_tokenize(dictionary, ...)

Arguments

dictionary

a dictionary object.

...

passed to tokens().


quanteda documentation built on April 7, 2026, 1:06 a.m.