TokenizerIndex: List of all available Tokenizers
In aifeducation: Artificial Intelligence for Education
TokenizerIndex R Documentation
List of all available Tokenizers
Description
Named list containing all tokenizers as a string.
Usage
TokenizerIndex
Format
An object of class list of length 2.
See Also
Other Parameter Dictionary:
BaseModelsIndex,
DataSetsIndex,
doc_formula(),
get_TEClassifiers_class_names(),
get_called_args(),
get_depr_obj_names(),
get_magnitude_values(),
get_param_def(),
get_param_dict(),
get_param_doc_desc()
aifeducation documentation built on Nov. 19, 2025, 5:08 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| TokenizerIndex | R Documentation |
List of all available Tokenizers
Description
Named list containing all tokenizers as a string.
Usage
TokenizerIndex
Format
An object of class list of length 2.
See Also
Other Parameter Dictionary:
BaseModelsIndex,
DataSetsIndex,
doc_formula(),
get_TEClassifiers_class_names(),
get_called_args(),
get_depr_obj_names(),
get_magnitude_values(),
get_param_def(),
get_param_dict(),
get_param_doc_desc()
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.