createZipfObject: createZipfObject

In j2scode/predictifyR: Word Prediction Language Model Evaluation

Description

createZipfObject Prepares zipf objects for a document

Usage

createZipfObject(document, vgc, numSamples = 1000)

Arguments

document	- the document and meta data to be analyzed
vgc	- the vocabulary growth curve data
numSamples	- the number of samples, default = 1000

Details

This function takes as its parameters, the list containing the document and its meta data, a vocabulary growth curve, the number of samples (default = 1000), and returns a zip object used for downstream analysis. The zipf object includes:

• nTokensNumber of tokens in the document

• docTflDocument term frequency list

• docSpcDocument frequency spectrum object

• docLnreLarge number of rare elements (LNRE) object

• docEmpVgcEmpirical (observed) vocabulary growth curve

• docIntVgcInterpolated (smoothed) vocabulary growth curve

• goodnessLNRE goodness of fit#'

Value

zipfObjects - the zipf object used for analysis and plotting

Author(s)

John James, [e-mail]

See Also

createVGC createGrowthObject createZipf text2spc.fnc lnre lnre.spc N V EV

j2scode/predictifyR documentation built on May 14, 2019, 10:34 a.m.