TransformersTokenizer: TransformersTokenizer

View source: R/import_modules.R

TransformersTokenizerR Documentation

TransformersTokenizer

Description

TransformersTokenizer

Usage

TransformersTokenizer(tokenizer)

Arguments

tokenizer

tokenizer object

Value

None


fastai documentation built on March 21, 2022, 9:07 a.m.