dot-default_tokenizer: Shortcut to make sure we're using wordpiece
In macmillancontentscience/torchtransformers: Transformer Models in Torch
.default_tokenizer R Documentation
Shortcut to make sure we're using wordpiece
Description
Shortcut to make sure we're using wordpiece
Usage
.default_tokenizer(tokenizer)
Arguments
tokenizer
Value
The vocab or wordpiece_tokenize.
macmillancontentscience/torchtransformers documentation built on Aug. 6, 2023, 5:35 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| .default_tokenizer | R Documentation |
Shortcut to make sure we're using wordpiece
Description
Shortcut to make sure we're using wordpiece
Usage
.default_tokenizer(tokenizer)
Arguments
tokenizer |
Value
The vocab or wordpiece_tokenize.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.