ngram_tokenizer: Ngrams tokenizer
In paithiov909/gibasa: An Alternative 'Rcpp' Wrapper of 'MeCab'
ngram_tokenizer R Documentation
Ngrams tokenizer
Description
Makes an ngram tokenizer function.
Usage
ngram_tokenizer(n = 1L)
Arguments
n
Integer.
Value
ngram tokenizer function
Examples
bigram <- ngram_tokenizer(2)
bigram(letters, sep = "-")
paithiov909/gibasa documentation built on June 14, 2025, 4:31 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| ngram_tokenizer | R Documentation |
Ngrams tokenizer
Description
Makes an ngram tokenizer function.
Usage
ngram_tokenizer(n = 1L)
Arguments
n |
Integer. |
Value
ngram tokenizer function
Examples
bigram <- ngram_tokenizer(2)
bigram(letters, sep = "-")
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.