tests/testTokenizer.R
In DataScienceSalon/predictifyR.3.0: Word Prediction Language Model Evaluation
td <- c("This isn't the New-York James' hotel!")
td1 <- quanteda::tokenize(td, what = 'word')
td2 <- quanteda::tokenize(td, what = 'fasterword')
td3 <- quanteda::tokenize(td, what = 'fastestword')
DataScienceSalon/predictifyR.3.0 documentation built on May 23, 2019, 8:25 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
td <- c("This isn't the New-York James' hotel!")
td1 <- quanteda::tokenize(td, what = 'word')
td2 <- quanteda::tokenize(td, what = 'fasterword')
td3 <- quanteda::tokenize(td, what = 'fastestword')
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.