gn_tokenizer: Tokenize word ngrams (1-7 default) of text
In jacob-ogre/us.geonames: US geographic placenames data, searches, and mapping
Description
The default of unigram to 7-gram tokenization was chosen because 99
placenames in the geonames gazetteer are <= 7 words long.
Usage
1
gn_tokenizer(text, min = 1, max = 7)
Arguments
text
A character vector to be tokenized
min
The minimum ngram length to create (default = 1)
max
The maximum ngram length to create (default = 7)
jacob-ogre/us.geonames documentation built on May 20, 2019, 6:03 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Description
The default of unigram to 7-gram tokenization was chosen because 99 placenames in the geonames gazetteer are <= 7 words long.
Usage
1 | gn_tokenizer(text, min = 1, max = 7)
|
Arguments
text |
A character vector to be tokenized |
min |
The minimum ngram length to create (default = 1) |
max |
The maximum ngram length to create (default = 7) |
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.