createZipf: createZipf

In DataScienceSalon/predictifyR.3.0: Word Prediction Language Model Evaluation

Description

createZipf Prepares zipf objects for a corpus

Usage

createZipf(korpus, vgc)

Arguments

korpus	- meta data for the corpus being analyzed
vgc	- the vocabulary growth curve data

Details

This function takes as its parameters, the corpus meta data and a vocabulary growth curve and returns a zip object used for downstream analysis. The zipf object includes:

• nTokensNumber of tokens in the document

• docTflDocument term frequency list

• docSpcDocument frequency spectrum object

• docLnreLarge number of rare elements (LNRE) object

• docEmpVgcEmpirical (observed) vocabulary growth curve

• docIntVgcInterpolated (smoothed) vocabulary growth curve

• goodnessLNRE goodness of fit#'

Value

zipfObjects - the zipf object used for analysis and plotting

Author(s)

John James, [e-mail]

See Also

createVGC createGrowthObject createZipfObject

DataScienceSalon/predictifyR.3.0 documentation built on May 23, 2019, 8:25 p.m.