R: Parameter to determine number of tokens in ngram

num_tokens {dials}

R Documentation

Parameter to determine number of tokens in ngram

Used in textrecipes::step_ngram().

num_tokens(range = c(1, 3), trans = NULL)

`range`	A two-element vector holding the defaults for the smallest and largest possible values, respectively. If a transformation is specified, these values should be in the transformed units.
`trans`	A `trans` object from the `scales` package, such as `scales::log10_trans()` or `scales::reciprocal_trans()`. If not provided, the default is used which matches the units used in `range`. If no transformation, `NULL`.

num_tokens()

[Package dials version 1.2.0 Index]