prop_to_es: Proportions to Effect Size

In compute.es: Compute Effect Sizes

Description

Converts proportions (typically seen in studies reporting odds ratios) to an effect size of d (mean difference), g (unbiased estimate of d), r (correlation coefficient), z' (Fisher's z), and log odds ratio. The variances, confidence intervals and p-values of these estimates are also computed, along with NNT (number needed to treat), U3 (Cohen's U_(3) overlapping proportions of distributions), CLES (Common Language Effect Size) and Cliff's Delta.

Usage

propes(p1, p2, n.ab, n.cd, 
       level = 95, cer = 0.2, dig = 2, verbose = TRUE, id=NULL, data=NULL)

Arguments

p1	Proportion one.
p2	Proportion two.
n.ab	Total sample size for group A and B.
n.cd	Total sample size for group C and D.
level	Confidence level. Default is 95%.
cer	Control group Event Rate (e.g., proportion of cases showing recovery). Default is 0.2 (=20% of cases showing recovery). CER is used exclusively for NNT output. This argument can be ignored if input is not a mean difference effect size. Note: NNT output (described below) will NOT be meaningful if based on anything other than input from mean difference effect sizes (i.e., input of Cohen's d, Hedges' g will produce meaningful output, while correlation coefficient input will NOT produce meaningful NNT output).
dig	Number of digits to display. Default is 2 digits.
verbose	Print output from scalar values? If yes, then verbose=TRUE; otherwise, verbose=FALSE. Default is TRUE.
id	Study identifier. Default is NULL, assuming a scalar is used as input. If input is a vector dataset (i.e., data.frame, with multiple values to be computed), enter the name of the study identifier here.
data	name of data.frame. Default is NULL, assuming a scalar is used as input. If input is a vector dataset (i.e., data.frame, with multiple values to be computed), enter the name of the data.frame here.

Details

This formula will first compute an odds ratio and then transform to log odds and its variance. Then, Cohen's d will be calculated and this value will then be used to compute the remaining effect size estimates. The odds ratio is derived as follows

or= (p_(1)(1-p_(2)))/ (p_(2)(1-p_(1)))

The conversion to a log odds and its variance is defined as

ln(o)=% log(or)

v_(ln(o))= (1)/ (n_(AB)p_(1)(1-p_(1)))+ (1)/ (n_(CD)p_(2)(1-p_(2)))

where n_(AB) is the sum of group A and B sample size, n_(CD) is the sum of group C and D sample size, p_(1) is the proportion for group 1 and p_(2) is the proportion for group 2.

Value

d	Standardized mean difference (d).
var.d	Variance of d.
l.d	lower confidence limits for d.
u.d	upper confidence limits for d.
U3.d	Cohen's U_(3), for d.
cl.d	Common Language Effect Size for d.
cliffs.d	Cliff's Delta for d.
p.d	p-value for d.
g	Unbiased estimate of d.
var.g	Variance of g.
l.g	lower confidence limits for g.
u.g	upper confidence limits for g.
U3.g	Cohen's U_(3), for g.
cl.g	Common Language Effect Size for g.
p.g	p-value for g.
r	Correlation coefficient.
var.r	Variance of r.
l.r	lower confidence limits for r.
u.r	upper confidence limits for r.
p.r	p-value for r.
z	Fisher's z (z').
var.z	Variance of z'.
l.z	lower confidence limits for z'.
u.z	upper confidence limits for z'.
p.z	p-value for z'.
OR	Odds ratio.
l.or	lower confidence limits for OR.
u.or	upper confidence limits for OR.
p.or	p-value for OR.
lOR	Log odds ratio.
var.lor	Variance of log odds ratio.
l.lor	lower confidence limits for lOR.
u.lor	upper confidence limits for lOR.
p.lor	p-value for lOR.
N.total	Total sample size.
NNT	Number needed to treat.

Note

Detailed information regarding output values of:

(1) Cohen's d, Hedges' g (unbiased estimate of d) and variance

(2) Correlation coefficient (r), Fisher's z', and variance

(3) Log odds and variance

is provided below (followed by general information about NNT, U3, Common Language Effect Size, and Cliff's Delta):

Cohen's d, Hedges' g and Variance of g:

In this particular formula Cohen's d is calculated from the log odds as follows

d= (ln(o)sqrt(3))/ (pi)

The variance of d is derived from

v_(d)= (3v_(ln(o)))/ (pi^2)

The effect size estimate d has a small upward bias (overestimates the population parameter effect size) which can be removed using a correction formula to derive the unbiased estimate of Hedges' g. The correction factor, j, is defined as

J= 1- (3)/ (4df-1)

where df= degrees of freedom, which is n_(1)+n_(2)-2 for two independent groups. Then, to calculate g

g= Jd

and the variance of g

v_(g)= J^2v_(d)

Correlation Coefficient r, Fisher's z, and Variances:

In this particular formula r is calculated as follows

r= (d)/ (sqrt(d^2+a))

where a corrects for inbalance in n_(1) & n_(2) and is defined as

a= ((n_(1)+n_(2))^2)/ (n_(1)n_(2))

The variance of r is then defined as

v_(r)= (a^2v_(d))/ ((d^2+a)^3)

Often researchers are interested in transforming r to z' (Fisher's z) because r is not normally distributed, particularly at large values of r. Therefore, converting to z' will help to normally distribute the estimate. Converting from r to z' is defined as

z= .5^*log((1+r)/ (1-r)

and the variance of z

v_(z)= (1)/ (n-3)

where n is the total sample size for groups 1 and 2.

General information about NNT, U3, Common Language Effect Size, and Cliff's Delta:

Number needed to treat (NNT). NNT is interpreted as the number of participants that would need to be treated in one group (e.g., intervention group) in order to have one additional positive outcome over that of the outcome of a randomly selected participant in the other group (e.g., control group). In the compute.es package, NNT is calculated directly from d (Furukawa & Leucht, 2011), assuming relative normality of distribution and equal variances across groups, as follows:

NNT= 1/(Phi(d-Psi(CER))-CER)

U3. Cohen (1988) proposed a method for characterizing effect sizes by expressing them in terms of (normal) distribution overlap, called U3. This statistic describes the percentage of scores in one group that are exceeded by the mean score in another group. If the population means are equal then half of the scores in the treatment group exceed half the scores in the comparison group, and U3 = 50%. As the population mean difference increases, U3 approaches 100% (Valentine & Cooper, 2003).

Common Language Effect Size (CLES). CLES (McGraw & Wong, 1992) expresses the probability that a randomly selected score from one population will be greater than a randomly sampled score from another population. CLES is computed as the percentage of the normal curve that falls between negative infinity and the effect size (Valentine & Cooper, 2003).

Cliff's Delta/success rate difference. Cliff's delta (or success rate difference; Furukawa & Leucht (2011)) is a robust alternative to Cohen's d, when data are either non-normal or ordinal (with truncated/reduced variance). Cliff's Delta is a non-parametric procedure that provides the probability that individual observations in one group are likely to be greater than the observations in another group. It is the probability that a randomly selected participant of one population has a better outcome than a randomly selected participant of the second population (minus the reverse probability). Cliff's Delta of negative 1 or positive 1 indicates no overlap between the two groups, whereas a value of 0 indicates complete overlap and equal group distributions.

Cliff's Delta= 2*Phi(d/sqrt(2))-1

Author(s)

AC Del Re

Much appreciation to Dr. Jeffrey C. Valentine for his contributions in implementing U3 and CLES procedures and related documentation.

Maintainer: AC Del Re [e-mail]

References

Borenstein (2009). Effect sizes for continuous data. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta analysis (pp. 279-293). New York: Russell Sage Foundation.

Cohen, J. (1988). Statistical power for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.

Furukawa, T. A., & Leucht, S. (2011). How to obtain NNT from Cohen's d: comparison of two methods. PloS one, 6(4), e19070.

McGraw, K. O. & Wong, S. P. (1992). A common language effect size statistic. Psychological Bulletin, 111, 361-365.

Valentine, J. C. & Cooper, H. (2003). Effect size substantive interpretation guidelines: Issues in the interpretation of effect sizes. Washington, DC: What Works Clearinghouse.

See Also

failes, lores

Examples

 
# CALCULATE SEVERAL EFFECT SIZES BASED ON PROPORTIONS: 

propes(.50,.30, 30, 30)

compute.es documentation built on April 14, 2020, 7:37 p.m.