shannon_cross_entropy: Shannon Cross Entropy

Description Usage Arguments Value Examples

View source: R/shannon.R

Description

Compute the base-b Shannon cross entropy between a true distribution p and an unnatural distribution q.

Usage

1

Arguments

p

Dist specifying the true distribution.

q

Dist specifying the unnatural distribution.

b

Numeric giving the base of the logarithm.

Value

Numeric giving the Shannon cross entropy.

Examples

1
2
3
4
5
6
p <- Dist(c(1, 0, 0))
q <- Dist(c(2, 1, 1))
shannon_cross_entropy(p, q)               # 1.0000000
shannon_cross_entropy(q, p)               # Inf
shannon_cross_entropy(p, q, b = 3)        # 0.6309298
shannon_cross_entropy(q, p, b = 3)        # Inf

rinform documentation built on April 1, 2018, 12:12 p.m.