dot-get_tokenizer_name: Look Up Tokenizer Name
In macmillancontentscience/torchtransformers: Transformer Models in Torch
.get_tokenizer_name R Documentation
Look Up Tokenizer Name
Description
Look Up Tokenizer Name
Usage
.get_tokenizer_name(tokenizer_scheme)
Arguments
tokenizer_scheme
A character scalar indicating the tokenizer scheme,
which is a name for a tokenizer plus a vocabulary.
Value
A character scalar tokenizer name.
macmillancontentscience/torchtransformers documentation built on Aug. 6, 2023, 5:35 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| .get_tokenizer_name | R Documentation |
Look Up Tokenizer Name
Description
Look Up Tokenizer Name
Usage
.get_tokenizer_name(tokenizer_scheme)
Arguments
tokenizer_scheme |
A character scalar indicating the tokenizer scheme, which is a name for a tokenizer plus a vocabulary. |
Value
A character scalar tokenizer name.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.