orddom-package: Ordinal Dominance Statistics
In orddom: Ordinal Dominance Statistics
Description
Details
Note
Author(s)
References
See Also
Examples
Description
This package provides ordinal, nonparametric statistics and effect sizes as an alternative to independent or paired group mean comparisons, with special reference to Cliff's delta statistics (or success rate difference, SRD), but also providing McGraw and Wong's common language effect size for the discrete case (i.e. Grissom and Kim's Probability of Superiority), Vargha and Delaney's A (or the Area Under a Receiver Operating Characteristic Curve AUC), and Cook & Sackett's number needed to treat (NNT) effect size (cf. Kraemer & Kupfer, 2006). For the nonparametric effect sizes, various bootstrap CI estimates may also be obtained. Nonparametric effect sizes are also expressed as Cohen's d based on percentages of group non-overlap (cf. Huberty & Lowman, 2000).
Details
Package: anRpackage
Type: Package
Version: 3.1
Date: 2013-02-07
License: GPL-2
Note
Please cite as:
Rogmann, J. J. (2013). Ordinal Dominance Statistics (orddom): An R Project for Statistical Computing package to compute ordinal, nonparametric alternatives to mean comparison (Version 3.1). Available online from the CRAN website http://cran.r-project.org/.
Major changes from orddom version 3.0 to 3.1
Correction for dmes list names
Major changes from orddom version 2.0 to 3.0
New function dmes to easily calculate nonparametric effect size measures independently from orddom
Easier and more reliable input possible (vectors, lists, arrays, data frames) (by means of new function return1colmatrix)
Individual variable label and test descriptions can now be assigned
Outputs now also contain Number Needed to Treat (NNT) effect size
(Para)metric Common Language effect size McGraw & Wong (1992) added
Metric d CI in orddom now based on Hedges & Olkin (1985)
Elimination of negative delta-between variance estimates for paired comparisons
Correction of symmetric CI for independent Cliff's delta statistics
New function dmes.boot to calculate bootstrap-based CI for nonparametric effect size measures and Cohen's d,
dmes.boot was largely based on R code provided by J. Ruscio and T. Mullen (2011) reused with kind permission
New function delta_gr now yields a graphical and interpretational output for Cliff's delta statistic
New options for one- and two-tailed CI in orddom and orddom_f, resulting in changes of rows 21 and 22 of independent and rows 18 and 19 of paired orddom result matrix
New Metric_t function (t, p and df can now be calculated and embedded in orddom as standard or Welch approximated)
Major changes from orddom Version 1.5 to 2.0
orddom now also accepts simple vectors as x or y.
New orddom_f() function file allows for file output of statistics for multiple sample comparisons (e.g. csv or analyses in MS Excel or Open Office Calc).
New orddom_p() function file allows for detailed tab-formatted output for single sample comparisons.
Package dependency on compute.es package was suspended (tes-Function for metric Cohen's d in orddom).
New metric_t() function for additional information on metric t-test results.
The dm() function can now also return difference matrices.
Improved stability of orddom function as well as minor corrections in orddom output and manuals.
Major changes from orddom Version 1.0 to 1.5
Calculation of CI and delta z-score-estimates can now be based on Students t-distribution rather than using fixed normal distribution z-scores.
Symmetric CIs can now be obtained to increase power of the delta statistics in certain cases.
Formulas used for calculation added in orddom manual.
Probability of Superiority statistic as well as variance estimates for delta in the independent groups analyses were corrected.
Minor changes were implemented to allow for calculation of d=+-1 extreme cases without error abort.
Output of raw y-dataset in independent group analysis was corrected.
Dependencies on packages psych and compute.es declared in DESCRIPTION and NAMESPACE files.
Author(s)
Dr. Jens J. Rogmann, University of Hamburg, Dept of Psychology, Germany
Maintainer: Jens J. Rogmann <Jens.Rogmann@uni-hamburg.de>
References
Cliff, N. (1993). Dominance statistics: Ordinal analyses to answer ordinal questions. Psychological Bulletin, 114, 494-509.
Cliff, N. (1996a). Ordinal Methods for Behavioral Data Analysis. Mahwah, NJ: Lawrence Erlbaum.
Cliff, N. (1996b). Answering ordinal questions with ordinal data using ordinal statistics. Multivariate Behavioral Research, 31, 331-350.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd edition). New York: Academic Press.
Cook, R.J. & Sackett, D. L. (1995). The number needed to treat: A clinically useful measure of treatment effect. British Medical Journal, 310, 452-454.
Delaney, H.D. & Vargha, A. (2002). Comparing Several Robust Tests of Stochastic Equality With Ordinally Scaled Variables and Small to Moderate Sized Samples. Psychological Methods, 7, 485-503.
Feng, D., & Cliff, N. (2004). Monte Carlo Evaluation of Ordinal d with Improved Confidence Interval. Journal of Modern Applied Statistical Methods, 3(2), 322-332.
Feng, D. (2007). Robustness and Power of Ordinal d for Paired Data. In Shlomo S. Sawilowsky (Ed.), Real Data Analysis (pp. 163-183). Greenwich, CT : Information Age Publishing.
Grissom, R.J. (1994). Probability of the superior outcome of one treatment over another. Journal of Applied Psychology, 79, 314-316.
Grissom, R.J. & Kim, J.J. (2005). Effect sizes for research. A broad practical approach. Mahwah, NJ, USA: Erlbaum.
Huberty, C. J. & Lowman, L. L. (2000). Group overlap as a basis for effect size. Educational and Psychological Measurement, 60, 543-563.
Kraemer, H.C. & Kupfer, D.J. (2006). Size of Treatment Effects and Their Importance to Clinical Research and Practice. Biological Psychiatry, 59, 990-996.
McGraw, K.O. & Wong, S.P. (1992). A common language effect size statistic. Psychological Bulletin, 111, 361-365.
Long, J. D., Feng, D., & Cliff, N. (2003). Ordinal analysis of behavioral data. In J. Schinka & W. F. Velicer (eds.), Research Methods in Psychology. Volume 2 of Handbook of Psychology (I. B. Weiner, Editor-in-Chief). New York: John Wiley & Sons.
Romano, J., Kromrey, J. D., Coraggio, J., & Skowronek, J. (2006). Appropriate statistics for ordinal level data: Should we really be using t-test and Cohen's d for evaluating group differences on the NSSE and other surveys?. Paper presented at the annual meeting of the Florida Association of Institutional Research, Feb. 1-3, 2006, Cocoa Beach, Florida. Last retrieved January 2, 2012, from www.florida-air.org/romano06.pdf
Ruscio, J. & Mullen, T. (2012). Confidence Intervals for the Probability of Superiority Effect Size Measure and the Area Under a Receiver Operating Characteristic Curve. Multivariate Behavioral Research, 47, 221-223.
Vargha, A., & Delaney, H. D. (1998). The Kruskal-Wallis test and stochastic homogeneity. Journal of Educational and Behavioral Statistics, 23, 170-192.
Vargha, A., & Delaney, H. D. (2000). A critique and improvement of the CL common language effect size statistic of McGraw and Wong. Journal of Educational and Behavioral Statistics, 25, 101-132.
See Also
orddom, dmes, dmes.boot and orddom_f.
Examples
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
## Not run:
#ordinal comparison and delta statistics for independent groups x and y
#(e.g. x:comparison/control group and y:treatment/experimental group)
orddom(x,y,paired=FALSE)
#
#ordinal comparison and delta statistics for paired data
#(e.g. x:Pretest/Baseline and y:Posttest)
orddom(x,y,paired=TRUE)
#
#Dominance Matrix production
dms(x,y,paired=T)
#
#Print dominance matrix
orddom_p(x,y,sections="4a")
#
#Graphic output and interpretational text for Cliff's delta statistics
delta_gr(x,y)
#
#nonparametric effect sizes (SRD/delta, A/AUC, CL/PS, NNT)
#(e.g. C:control group scores, T:treatment group scores)
dmes(C,T)
#
#Convert Cliff's delta value to Cohen's d (as distributional non-overlap)
delta2cohd(dmes(C,T)$dc)
#
#Confidence Interval estimate of AUC (by bootstrap)
#cf. Ruscio, J. & Mullen, T. (2012)
#(e.g. C:control group scores, T:treatment group scores)
dmes.boot(C,T,theta.es="Ac")
## End(Not run)
orddom documentation built on May 2, 2019, 2:45 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Description Details Note Author(s) References See Also Examples
Description
This package provides ordinal, nonparametric statistics and effect sizes as an alternative to independent or paired group mean comparisons, with special reference to Cliff's delta statistics (or success rate difference, SRD), but also providing McGraw and Wong's common language effect size for the discrete case (i.e. Grissom and Kim's Probability of Superiority), Vargha and Delaney's A (or the Area Under a Receiver Operating Characteristic Curve AUC), and Cook & Sackett's number needed to treat (NNT) effect size (cf. Kraemer & Kupfer, 2006). For the nonparametric effect sizes, various bootstrap CI estimates may also be obtained. Nonparametric effect sizes are also expressed as Cohen's d based on percentages of group non-overlap (cf. Huberty & Lowman, 2000).
Details
| Package: | anRpackage |
| Type: | Package |
| Version: | 3.1 |
| Date: | 2013-02-07 |
| License: | GPL-2 |
Note
Please cite as:
Rogmann, J. J. (2013). Ordinal Dominance Statistics (orddom): An R Project for Statistical Computing package to compute ordinal, nonparametric alternatives to mean comparison (Version 3.1). Available online from the CRAN website http://cran.r-project.org/.
Major changes from orddom version 3.0 to 3.1
Correction for dmes list names
Major changes from orddom version 2.0 to 3.0
New function dmes to easily calculate nonparametric effect size measures independently from orddom
Easier and more reliable input possible (vectors, lists, arrays, data frames) (by means of new function return1colmatrix)
Individual variable label and test descriptions can now be assigned
Outputs now also contain Number Needed to Treat (NNT) effect size
(Para)metric Common Language effect size McGraw & Wong (1992) added
Metric d CI in orddom now based on Hedges & Olkin (1985)
Elimination of negative delta-between variance estimates for paired comparisons
Correction of symmetric CI for independent Cliff's delta statistics
New function dmes.boot to calculate bootstrap-based CI for nonparametric effect size measures and Cohen's d,
dmes.boot was largely based on R code provided by J. Ruscio and T. Mullen (2011) reused with kind permission
New function delta_gr now yields a graphical and interpretational output for Cliff's delta statistic
New options for one- and two-tailed CI in orddom and orddom_f, resulting in changes of rows 21 and 22 of independent and rows 18 and 19 of paired orddom result matrix
New Metric_t function (t, p and df can now be calculated and embedded in orddom as standard or Welch approximated)
Major changes from orddom Version 1.5 to 2.0
orddom now also accepts simple vectors as x or y.
New orddom_f() function file allows for file output of statistics for multiple sample comparisons (e.g. csv or analyses in MS Excel or Open Office Calc).
New orddom_p() function file allows for detailed tab-formatted output for single sample comparisons.
Package dependency on compute.es package was suspended (tes-Function for metric Cohen's d in orddom).
New metric_t() function for additional information on metric t-test results.
The dm() function can now also return difference matrices.
Improved stability of orddom function as well as minor corrections in orddom output and manuals.
Major changes from orddom Version 1.0 to 1.5
Calculation of CI and delta z-score-estimates can now be based on Students t-distribution rather than using fixed normal distribution z-scores.
Symmetric CIs can now be obtained to increase power of the delta statistics in certain cases.
Formulas used for calculation added in orddom manual.
Probability of Superiority statistic as well as variance estimates for delta in the independent groups analyses were corrected.
Minor changes were implemented to allow for calculation of d=+-1 extreme cases without error abort.
Output of raw y-dataset in independent group analysis was corrected.
Dependencies on packages psych and compute.es declared in DESCRIPTION and NAMESPACE files.
Author(s)
Dr. Jens J. Rogmann, University of Hamburg, Dept of Psychology, Germany Maintainer: Jens J. Rogmann <Jens.Rogmann@uni-hamburg.de>
References
Cliff, N. (1993). Dominance statistics: Ordinal analyses to answer ordinal questions. Psychological Bulletin, 114, 494-509.
Cliff, N. (1996a). Ordinal Methods for Behavioral Data Analysis. Mahwah, NJ: Lawrence Erlbaum.
Cliff, N. (1996b). Answering ordinal questions with ordinal data using ordinal statistics. Multivariate Behavioral Research, 31, 331-350.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd edition). New York: Academic Press.
Cook, R.J. & Sackett, D. L. (1995). The number needed to treat: A clinically useful measure of treatment effect. British Medical Journal, 310, 452-454.
Delaney, H.D. & Vargha, A. (2002). Comparing Several Robust Tests of Stochastic Equality With Ordinally Scaled Variables and Small to Moderate Sized Samples. Psychological Methods, 7, 485-503.
Feng, D., & Cliff, N. (2004). Monte Carlo Evaluation of Ordinal d with Improved Confidence Interval. Journal of Modern Applied Statistical Methods, 3(2), 322-332.
Feng, D. (2007). Robustness and Power of Ordinal d for Paired Data. In Shlomo S. Sawilowsky (Ed.), Real Data Analysis (pp. 163-183). Greenwich, CT : Information Age Publishing.
Grissom, R.J. (1994). Probability of the superior outcome of one treatment over another. Journal of Applied Psychology, 79, 314-316.
Grissom, R.J. & Kim, J.J. (2005). Effect sizes for research. A broad practical approach. Mahwah, NJ, USA: Erlbaum.
Huberty, C. J. & Lowman, L. L. (2000). Group overlap as a basis for effect size. Educational and Psychological Measurement, 60, 543-563.
Kraemer, H.C. & Kupfer, D.J. (2006). Size of Treatment Effects and Their Importance to Clinical Research and Practice. Biological Psychiatry, 59, 990-996.
McGraw, K.O. & Wong, S.P. (1992). A common language effect size statistic. Psychological Bulletin, 111, 361-365.
Long, J. D., Feng, D., & Cliff, N. (2003). Ordinal analysis of behavioral data. In J. Schinka & W. F. Velicer (eds.), Research Methods in Psychology. Volume 2 of Handbook of Psychology (I. B. Weiner, Editor-in-Chief). New York: John Wiley & Sons.
Romano, J., Kromrey, J. D., Coraggio, J., & Skowronek, J. (2006). Appropriate statistics for ordinal level data: Should we really be using t-test and Cohen's d for evaluating group differences on the NSSE and other surveys?. Paper presented at the annual meeting of the Florida Association of Institutional Research, Feb. 1-3, 2006, Cocoa Beach, Florida. Last retrieved January 2, 2012, from www.florida-air.org/romano06.pdf
Ruscio, J. & Mullen, T. (2012). Confidence Intervals for the Probability of Superiority Effect Size Measure and the Area Under a Receiver Operating Characteristic Curve. Multivariate Behavioral Research, 47, 221-223.
Vargha, A., & Delaney, H. D. (1998). The Kruskal-Wallis test and stochastic homogeneity. Journal of Educational and Behavioral Statistics, 23, 170-192.
Vargha, A., & Delaney, H. D. (2000). A critique and improvement of the CL common language effect size statistic of McGraw and Wong. Journal of Educational and Behavioral Statistics, 25, 101-132.
See Also
orddom, dmes, dmes.boot and orddom_f.
Examples
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 | ## Not run:
#ordinal comparison and delta statistics for independent groups x and y
#(e.g. x:comparison/control group and y:treatment/experimental group)
orddom(x,y,paired=FALSE)
#
#ordinal comparison and delta statistics for paired data
#(e.g. x:Pretest/Baseline and y:Posttest)
orddom(x,y,paired=TRUE)
#
#Dominance Matrix production
dms(x,y,paired=T)
#
#Print dominance matrix
orddom_p(x,y,sections="4a")
#
#Graphic output and interpretational text for Cliff's delta statistics
delta_gr(x,y)
#
#nonparametric effect sizes (SRD/delta, A/AUC, CL/PS, NNT)
#(e.g. C:control group scores, T:treatment group scores)
dmes(C,T)
#
#Convert Cliff's delta value to Cohen's d (as distributional non-overlap)
delta2cohd(dmes(C,T)$dc)
#
#Confidence Interval estimate of AUC (by bootstrap)
#cf. Ruscio, J. & Mullen, T. (2012)
#(e.g. C:control group scores, T:treatment group scores)
dmes.boot(C,T,theta.es="Ac")
## End(Not run)
|
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.