special_tokens: Extract special tokens from tokenizer
In cregouby/docformer: Fit 'DocFormer' Models for Classification and Regression
.mask_id R Documentation
Extract special tokens from tokenizer
Description
Extract special tokens from tokenizer
Usage
.mask_id(tokenizer)
.pad_id(tokenizer)
.sep_id(tokenizer)
.cls_id(tokenizer)
cregouby/docformer documentation built on May 27, 2023, 11:19 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| .mask_id | R Documentation |
Extract special tokens from tokenizer
Description
Extract special tokens from tokenizer
Usage
.mask_id(tokenizer)
.pad_id(tokenizer)
.sep_id(tokenizer)
.cls_id(tokenizer)
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.