getTokens: Get the tokens

Description Usage Arguments

View source: R/calcFrequency.R

Description

Get the tokens of a string where the format is "token/TAG".

Usage

1
getTokens(tokens)

Arguments

tokens

Character vector of tokens in the format of "token/TAG".


justinnafe/NextWord documentation built on May 20, 2019, 5:16 a.m.