FleissK: Fleiss' Kappa

In BavoDC/AGREL: Package for calculating agreement/reliability indices

Description

Function to calculate Fleiss' Kappa (Fleiss, 1971).

Usage

FleissK(ratings, weights = "unweighted", conflev = 0.95, N = Inf)

Arguments

ratings	A dataframe or matrix of N x P with N the number of observations and P the number of raters.
weights	The weight matrix that has to be used to calculate the reliability. Default is unweighted,
conflev	Confidence level to calculate the confidence intervals of Fleiss' Kappa.
N	Final population correction factor for the variance of Fleiss' Kappa (Gwet, 2008).

Value

method	Method that was used to calculate reliability
subjects	Number of subjects in the dataframe
nraters	Number of raters
value	Value for Fleiss' Kappa
StdErr	The standard error of the estimated Kappa value
stat.name	The corresponding test statistic
statistic	The value of the test statistic
p.value	The p-value for the test
alpha	Alpha-level used to calculate the confidence intervals
Po	Overall proportion of agreement
Pe	Proportion of agreement expected by chance
ratings	The original dataframe with the ratings
WeightsMatrix	The weights matrix used.

References

Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, Vol.76(5), pp.378-382

Gwet, K.L. (2008). Variance Estimation of Nominal-Scale Inter-Rater Reliability with Random Selection of Raters Psychometrika, Vol.73(3), pp.407-430

Examples

# Load data
data(PsychMorbid)

FleissK(PsychMorbid)

BavoDC/AGREL documentation built on May 6, 2019, 7:22 a.m.