entropy: Compute Shannon Entropy

View source: R/eig_functions.R

entropyR Documentation

Compute Shannon Entropy

Description

Helper function to compute Shannon entropy for a probability value. Entropy measures uncertainty about guilt/innocence.

Usage

entropy(p, base = 2)

Arguments

p

Probability value (between 0 and 1)

base

Logarithm base (default = 2 for bits)

Details

Entropy is computed as: H(p) = -[p*log(p) + (1-p)*log(1-p)] When p is 0 or 1 (certainty), entropy is 0. Maximum entropy (1 bit) occurs at p = 0.5 (maximum uncertainty).

Value

Shannon entropy in bits (if base = 2)


r4lineups documentation built on Nov. 10, 2026, 1:08 a.m.