| TokenizeWithRules {fastai} | R Documentation |
TokenizeWithRules
Description
A wrapper around 'tok' which applies 'rules', then tokenizes, then applies 'post_rules'
Usage
TokenizeWithRules(tok, rules = NULL, post_rules = NULL)
Arguments
tok |
tokenizer |
rules |
rules |
post_rules |
post_rules |
Value
None
[Package fastai version 2.2.2 Index]