tokenize1 {fastai}R Documentation

Tokenize1

Description

Call 'TokenizeWithRules' with a single text

Usage

tokenize1(text, tok, rules = NULL, post_rules = NULL)

Arguments

text

text

tok

tok

rules

rules

post_rules

post_rules

Value

None


[Package fastai version 2.2.2 Index]