ent: Entropy

In kshirley/LDAtools: Tools to fit a topic model using Latent Dirichlet Allocation (LDA)

Description

This function calculates the entropy of a discrete (categorical) probability distribution

Usage

ent(x)

Arguments

x	a vector that contains either a normalized or un-normalized vector of probabilities of a discrete (categorical) distribution

Examples

x <- c(1, 1, 2, 2, 3)
ent(x)
y <- c(1/9, 1/9, 2/9, 2/9, 3/9)
ent(y) # should be same as ent(x)
z <- c(1/3, 1/3, 1/6, 1/6)
ent(z)
z2 <- c(1/3, 1/3, 1/6, 1/6, 0)
ent(z2) # should be the same as ent(z), since this version of entropy assumes 0*log(0) = 0

kshirley/LDAtools documentation built on May 20, 2019, 7:03 p.m.