Numericalize: Numericalize

View source: R/text_data.R

NumericalizeR Documentation

Numericalize

Description

Reversible transform of tokenized texts to numericalized ids

Usage

Numericalize(
  vocab = NULL,
  min_freq = 3,
  max_vocab = 60000,
  special_toks = NULL,
  pad_tok = NULL
)

Arguments

vocab

vocab

min_freq

min_freq

max_vocab

max_vocab

special_toks

special_toks

pad_tok

pad_tok

Value

None


fastai documentation built on June 22, 2024, 11:15 a.m.