Shannon.entropy: Compute Shannon entropy

In wavethresh: Wavelets Statistics and Transforms

Compute Shannon entropy

Description

Computes Shannon entropy of the squares of a set of coefficients.

Usage

Shannon.entropy(v, zilchtol=1e-300)

Arguments

v	A vector of coefficients (e.g. wavelet coefficients).
zilchtol	A small number. Any number smaller than this is considered to be zero for the purposes of this function.

Details

This function computes the Shannon entropy of the squares of a set of coefficients. The squares are used because we are only interested in the entropy of the energy of the coefficients, not their actual sign.

The entropy of the squares of v is given by sum( v^2 * log(v^2) ). In this implementation any zero coefficients (determined by being less than zilchtol) have a zero contribution to the entropy.

The Shannon entropy measures how "evenly spread" a set of numbers is. If the size of the entries in a vector is approximately evenly spread then the Shannon entropy is large. If the vector is sparsely populated or the entries are very different then the Shannon entropy is near zero. Note that the input vectors to this function usually have their norm normalized so that diversity of coefficients corresponds to sparsity.

Value

A number representing the Shannon entropy of the input vector.

RELEASE

Version 3.7.2 Copyright Guy Nason 1996

Author(s)

G P Nason

See Also

MaNoVe.wst, wst,

Examples

#
# Generate some test data
#
#
# A sparse set
#
Shannon.entropy(c(1,0,0,0))
#0
#
# A evenly spread set
#
Shannon.entropy( rep( 1/ sqrt(4), 4 ))
#1.386294

wavethresh documentation built on Sept. 11, 2024, 9:33 p.m.