tokenize {processpredictR}R Documentation

Tokenize features and target of a processed dataset of class ppred_examples_df

Description

Tokenize features and target of a processed ppred_examples_df object to fit the Transformer model.

Usage

tokenize(processed_df)

Arguments

processed_df

A preprocessed object of type ppred_examples_df returned by prepare_examples().

Value

A list of (sequence) tokens and additional numeric or categorical features.


[Package processpredictR version 0.1.0 Index]