Token: Token
In DecisionScients/NLPStudio: Natural Language Processing in Objected Oriented R Environment
Description
Usage
Arguments
Format
Details
Value
Methods
Author(s)
See Also
Description
Token Tokens class
Usage
1
Arguments
x
Corpus object or a character vector containing text
n
Numeric for the nGram method. Indicates the nGram size.
Format
An object of class R6ClassGenerator of length 24.
Details
Creates character, word, sentence and paragraph tokens and nGrams using the
tokenizer package.
Value
Tokenizer object
Methods
new()Initializes an object of the Tokenizer class.
character(x)
word(x)
sentence(x)
paragraph(x)
nGrams(x, n)
Author(s)
John James, jjames@datasciencesalon.org
See Also
Other Corpus Tokenizer Family of Classes: Tokenizer
Other CorpusStudio Family of Classes: CorpusStudio,
KFold, Sample0,
Sample, Segment,
Split, TokenizerNLP,
TokenizerQ, Tokenizer
DecisionScients/NLPStudio documentation built on May 15, 2019, 12:51 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Description Usage Arguments Format Details Value Methods Author(s) See Also
Description
Token Tokens class
Usage
1 |
Arguments
x |
Corpus object or a character vector containing text |
n |
Numeric for the nGram method. Indicates the nGram size. |
Format
An object of class R6ClassGenerator of length 24.
Details
Creates character, word, sentence and paragraph tokens and nGrams using the tokenizer package.
Value
Tokenizer object
Methods
new()Initializes an object of the Tokenizer class.character(x)word(x)sentence(x)paragraph(x)nGrams(x, n)
Author(s)
John James, jjames@datasciencesalon.org
See Also
Other Corpus Tokenizer Family of Classes: Tokenizer
Other CorpusStudio Family of Classes: CorpusStudio,
KFold, Sample0,
Sample, Segment,
Split, TokenizerNLP,
TokenizerQ, Tokenizer
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.