TokenStream-class: Class for token stream operations.

Description Slots

Description

Class for token stream operations.

Slots

tokenStream

a data.table that will include a column "token"

corpus

the CWB corpus (character vector length 1)

encoding

the encoding of the CWB corpus (character vector length 1)


nrauscher/corpus documentation built on May 23, 2019, 9:34 p.m.