SpacyTokenizer {fastai} | R Documentation |
SpacyTokenizer
Description
Spacy tokenizer for 'lang'
Usage
SpacyTokenizer(lang = "en", special_toks = NULL, buf_sz = 5000)
Arguments
lang |
language |
special_toks |
special tokenizers |
buf_sz |
buffer size |
Value
none
[Package fastai version 2.2.2 Index]