entropy: Estimation of Entropy, Mutual Information and Related Quantities

This package implements various estimators of entropy, such as the shrinkage estimator by Hausser and Strimmer, the maximum likelihood and the Millow-Madow estimator, various Bayesian estimators, and the Chao-Shen estimator. It also offers an R interface to the NSB estimator. Furthermore, it provides functions for estimating Kullback-Leibler divergence, chi-squared, mutual information, and chi-squared statistic of independence. In addition there are functions for discretizing continuous random variables.

Author
Jean Hausser and Korbinian Strimmer
Date of publication
2014-11-14 08:16:32
Maintainer
Korbinian Strimmer <strimmerlab@gmail.com>
License
GPL (>= 3)
Version
1.2.1
URLs

View on CRAN

Man pages

discretize
Discretize Continuous Random Variables
entropy
Estimating Entropy From Observed Counts
entropy.ChaoShen
Chao-Shen Entropy Estimator
entropy.Dirichlet
Dirichlet Prior Bayesian Estimators of Entropy, Mutual...
entropy.empirical
Empirical Estimators of Entropy and Mutual Information and...
entropy-internal
Internal entropy functions
entropy.MillerMadow
Miller-Madow Entropy Estimator
entropy.NSB
R Interface to NSB Entropy Estimator
entropy.package
The entropy Package
entropy.plugin
Plug-In Entropy Estimator
entropy.shrink
Shrinkage Estimators of Entropy, Mutual Information and...
KL.plugin
Plug-In Estimator of the Kullback-Leibler divergence and of...
mi.plugin
Plug-In Estimator of Mutual Information and of the...

Files in this package

entropy
entropy/NAMESPACE
entropy/NEWS
entropy/R
entropy/R/entropy.R
entropy/R/entropy.Dirichlet.R
entropy/R/entropy.NSB.R
entropy/R/entropy.plugin.R
entropy/R/entropy.ChaoShen.R
entropy/R/entropy.shrink.R
entropy/R/entropy.MillerMadow.R
entropy/R/KL.plugin.R
entropy/R/entropy.empirical.R
entropy/R/discretize.R
entropy/R/mi.plugin.R
entropy/MD5
entropy/DESCRIPTION
entropy/man
entropy/man/entropy.NSB.Rd
entropy/man/entropy.Rd
entropy/man/KL.plugin.Rd
entropy/man/entropy.ChaoShen.Rd
entropy/man/entropy-internal.Rd
entropy/man/entropy.shrink.Rd
entropy/man/discretize.Rd
entropy/man/entropy.Dirichlet.Rd
entropy/man/mi.plugin.Rd
entropy/man/entropy.empirical.Rd
entropy/man/entropy.plugin.Rd
entropy/man/entropy.package.Rd
entropy/man/entropy.MillerMadow.Rd