Tokenizer_from_df {fastai} | R Documentation |
Tokenizer_from_df
Description
Tokenizer_from_df
Usage
Tokenizer_from_df(
text_cols,
tok = NULL,
rules = NULL,
sep = " ",
n_workers = 6,
mark_fields = NULL,
tok_text_col = "text"
)
Arguments
text_cols |
text columns |
tok |
tokenizer |
rules |
special rules |
sep |
separator |
n_workers |
number of workers |
mark_fields |
mark fields |
tok_text_col |
output column name |
Value
None
[Package fastai version 2.2.2 Index]