get_tokens: Retrieves tokens from a text

Description Usage Arguments Value

View source: R/deduplication_functions.R

Description

Removes stopwords and extracts tokens from text

Usage

1

Arguments

text

the text from which to remove stopwords

language

the language of the text

Value

a character vector of tokens from the text


elizagrames/synthesisr documentation built on May 26, 2019, 10:34 a.m.