HF_TokenCategorize {fastai}

HF_TokenCategorize

Description

Reversible transform of a list of category string to 'vocab' id

Usage

HF_TokenCategorize(vocab = NULL, ignore_token = NULL, ignore_token_id = NULL)

Arguments

vocab

vocabulary

ignore_token

ignore token

ignore_token_id

ignore token id

Value

None