tokenize: Tokenize features and target of a processed dataset of class...

View source: R/tokenize.R

tokenizeR Documentation

Tokenize features and target of a processed dataset of class ppred_examples_df

Description

Tokenize features and target of a processed ppred_examples_df object to fit the Transformer model.

Usage

tokenize(processed_df)

Arguments

processed_df

A preprocessed object of type ppred_examples_df returned by prepare_examples().

Value

A list of (sequence) tokens and additional numeric or categorical features.


processpredictR documentation built on Jan. 18, 2023, 1:09 a.m.