parallel_tokenize {fastai}R Documentation

Parallel_tokenize

Description

Calls optional 'setup' on 'tok' before launching 'TokenizeWithRules' using 'parallel_gen

Usage

parallel_tokenize(items, tok = NULL, rules = NULL, n_workers = 6)

Arguments

items

items

tok

tokenizer

rules

rules

n_workers

n_workers

Value

None


[Package fastai version 2.2.2 Index]