HF_TokenCategorize: HF_TokenCategorize

Description Usage Arguments Value

View source: R/blurr_hugging_face.R

Description

Reversible transform of a list of category string to 'vocab' id

Usage

1
HF_TokenCategorize(vocab = NULL, ignore_token = NULL, ignore_token_id = NULL)

Arguments

vocab

vocabulary

ignore_token

ignore token

ignore_token_id

ignore token id

Value

None


fastai documentation built on Oct. 25, 2021, 5:08 p.m.