parallel_tokenize {fastai} | R Documentation |
Parallel_tokenize
Description
Calls optional 'setup' on 'tok' before launching 'TokenizeWithRules' using 'parallel_gen
Usage
parallel_tokenize(items, tok = NULL, rules = NULL, n_workers = 6)
Arguments
items |
items |
tok |
tokenizer |
rules |
rules |
n_workers |
n_workers |
Value
None
[Package fastai version 2.2.2 Index]