feature_stats {corpustools}

Feature statistics

Description

Compute a number of useful statistics for features: term frequency, idf, etc.

Usage

feature_stats(tc, feature, context_level = c("document", "sentence"))

Arguments

tc

a tCorpus

feature

The name of the feature column

context_level

Should results be returned at document or sentence level

Value

a data.frame

Examples

tc = create_tcorpus(c('Text one first sentence. Text one second sentence', 'Text two'),
                    split_sentences = TRUE)


fs = feature_stats(tc, 'token')
head(fs)
fs = feature_stats(tc, 'token', context_level = 'sentence')
head(fs)