feature_stats: Feature statistics

In corpustools: Managing, Querying and Analyzing Tokenized Text

Feature statistics

Description

Compute a number of useful statistics for features: term frequency, idf, etc.

Usage

feature_stats(tc, feature, context_level = c("document", "sentence"))

Arguments

tc	a tCorpus
feature	The name of the feature column
context_level	Should results be returned at document or sentence level

Value

a data.frame

Examples

tc = create_tcorpus(c('Text one first sentence. Text one second sentence', 'Text two'),
                    split_sentences = TRUE)


fs = feature_stats(tc, 'token')
head(fs)
fs = feature_stats(tc, 'token', context_level = 'sentence')
head(fs)

corpustools documentation built on May 31, 2023, 8:45 p.m.