dot-validate_tokenizer_scheme: Make Sure Tokenizer Schemes are Recognized
In macmillancontentscience/torchtransformers: Transformer Models in Torch
.validate_tokenizer_scheme R Documentation
Make Sure Tokenizer Schemes are Recognized
Description
Make Sure Tokenizer Schemes are Recognized
Usage
.validate_tokenizer_scheme(tokenizer_scheme, allow_null = TRUE)
Arguments
tokenizer_scheme
A character scalar that indicates vocabulary +
tokenizer.
allow_null
A logical scalar indicating whether the scheme can be NULL.
Value
The scheme, validated.
macmillancontentscience/torchtransformers documentation built on Aug. 6, 2023, 5:35 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| .validate_tokenizer_scheme | R Documentation |
Make Sure Tokenizer Schemes are Recognized
Description
Make Sure Tokenizer Schemes are Recognized
Usage
.validate_tokenizer_scheme(tokenizer_scheme, allow_null = TRUE)
Arguments
tokenizer_scheme |
A character scalar that indicates vocabulary + tokenizer. |
allow_null |
A logical scalar indicating whether the scheme can be NULL. |
Value
The scheme, validated.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.