power: Calculate test power

In IyarLin/hype: Variuos functions for proportions difference hypothesis testing

Description

this function calculates the test power (inverse of the type 2 probability).

Usage

power(mde, n_1, p_0, n_0, alpha, s, h, gamma)

Arguments

mde	minimum detectable effect
n_1	population 1 sample size
p_0	assumed population 0 p parameter
n_0	population 0 sample size
alpha	test significance level
s	either 1 (for one sided test) or 2 (for two sided test)
h	number of hypothesis tested in the same experiment (for Bonferroni correction)
gamma	minimum required lift

Details

In 2 sided tests each usually represents a different treatment. When doing one-sided tests it's usually the case that population 1 is considered the treatment and population 0 serves as the control. At any rate, one sided tests are always of the form p_1 - p_0 > C. For that reason for 1 sided tests one must set: mde > gamma >= 0

Value

test power

Examples

library(hype)

# For a thorugh simulation validation see
# https://github.com/IyarLin/hype/blob/master/inst/variuos_results_for_hypothesis_testing.pdf

# below we'll calculate power for 2 hypothesis tests performed
# in the same experiemnt
# note that h is set to 2 in order to reflect that

## hypothesis test number 1
power(
  mde = 0.025, n_1 = 10000, p_0 = 0.2, n_0 = 8000,
  alpha = 0.05, s = 1, h = 2, gamma = 0.01
)

## hypothesis test number 2
power(
  mde = 0.018, n_1 = 5000, p_0 = 0.1, n_0 = 3000,
  alpha = 0.05, s = 2, h = 2, gamma = 0
)

IyarLin/hype documentation built on July 20, 2020, 4:07 p.m.