raters: A Modification of Fleiss' Kappa in Case of Nominal and Ordinal Variables

Share:

The kappa statistic implemented by Fleiss is a very popular index for assessing the reliability of agreement among multiple observers. It is used both in the psychological and in the psychiatric field. Other fields of application are typically medicine, biology and engineering. Unfortunately,the kappa statistic may behave inconsistently in case of strong agreement between raters, since this index assumes lower values than it would have been expected. We propose a modification kappa implemented by Fleiss in case of nominal and ordinal variables. Monte Carlo simulations are used both to testing statistical hypotheses and to calculating percentile bootstrap confidence intervals based on proposed statistic in case of nominal and ordinal data.

Author
Daniele Giardiello [cre], Piero Quatto [aut], Enrico Ripamonti [aut], Stefano Vigliani [ctb]
Date of publication
2014-12-29 15:26:51
Maintainer
Daniele Giardiello <daniele.giardiello1@gmail.com>
License
GPL (>= 2)
Version
2.0.1

View on CRAN

Man pages

concordance
Inter-rater agreement among a set of raters for nominal data
diagnostic
Frequency of assignment of patients to diagnostic categories
raters-package
A Modification of Fleiss' Kappa in case of Nominal and...
uterine
Variability in classification of carcinoma in situ of the...
winetable
Sensory wine evaluation
wlin.conc
Inter-rater agreement among a set of raters for ordinal data...
wquad.conc
Inter-rater agreement among a set of raters for ordinal data...

Files in this package

raters
raters/NAMESPACE
raters/data
raters/data/winetable.rda
raters/data/diagnostic.rda
raters/data/uterine.rda
raters/R
raters/R/concordance.R
raters/R/wlin.conc.R
raters/R/wquad.conc.R
raters/MD5
raters/DESCRIPTION
raters/man
raters/man/winetable.Rd
raters/man/concordance.Rd
raters/man/wquad.conc.Rd
raters/man/wlin.conc.Rd
raters/man/raters-package.Rd
raters/man/uterine.Rd
raters/man/diagnostic.Rd