dtmremovetfidf: Remove terms from a Document-Term-Matrix and documents with...

In LDABiplots: Biplot Graphical Interface for LDA Models

Remove terms from a Document-Term-Matrix and documents with no terms based on the term frequency inverse document frequency

Description

Remove terms from a Document-Term-Matrix and documents with no terms based on the term frequency inverse document frequency. Either giving in the maximum number of terms (argument top), the tfidf cutoff (argument cutoff) or a quantile (argument prob)

Usage

dtmremovetfidf(dtm, top, cutoff, prob, remove_emptydocs = TRUE)

Arguments

dtm	an object class "dgCMatrix"
top	integer with the number of terms which should be kept as defined by the highest mean tfidf
cutoff	numeric cutoff value to keep only terms in dtm where the tfidf obtained by dtmtfidf is higher than this value
prob	numeric quantile indicating to keep only terms in dtm where the tfidf obtained by dtmtfidf is higher than the prob percent quantile
remove_emptydocs	logical indicating to remove documents containing no more terms after the term removal is executed. Defaults to TRUE.

Value

a sparse Matrix as returned by sparseMatrix where terms with high tfidf are kept and documents without any remaining terms are removed

LDABiplots documentation built on July 18, 2022, 5:06 p.m.