shannon_entropy: Estimation of Shannon entropy for a categorical variable.
In eliasmacielr/msu: Multivariate Symmetric Uncertainty and Other Measurements

Description Usage Arguments Value Examples

The Shannon entropy estimates the average minimum number of bits needed to encode a string of symbols, based on the frequency of the symbols (see http://www.bearcave.com/misl/misl_tech/wavelets/compression/shannon.html).

1
2
3

shannon_entropy(x)

H(x)

`x`	A factor as the represented categorical variable.

Shannon entropy estimation of the categorical variable.

shannon_entropy(factor(c(1,0)))
shannon_entropy(factor(c('a','b','c')))
## Not run: 
shannon_entropy(1)
shannon_entropy(c('a','b','c'))

## End(Not run)