Tokenizer: Tokenizer
In EagerAI/fastai: Interface to 'fastai'
Tokenizer R Documentation
Tokenizer
Description
Provides a consistent 'Transform' interface to tokenizers operating on 'DataFrame's and folders
Usage
Tokenizer(
tok,
rules = NULL,
counter = NULL,
lengths = NULL,
mode = NULL,
sep = " "
)
Arguments
tok
tokenizer
rules
rules
counter
counter
lengths
lengths
mode
mode
sep
separator
Value
None
EagerAI/fastai documentation built on April 16, 2024, 12:01 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| Tokenizer | R Documentation |
Tokenizer
Description
Provides a consistent 'Transform' interface to tokenizers operating on 'DataFrame's and folders
Usage
Tokenizer(
tok,
rules = NULL,
counter = NULL,
lengths = NULL,
mode = NULL,
sep = " "
)
Arguments
tok |
tokenizer |
rules |
rules |
counter |
counter |
lengths |
lengths |
mode |
mode |
sep |
separator |
Value
None
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.