Description Details Author(s) References Examples

Computes a statistic as an index of inter-rater agreement among a set of raters in case of nominal or ordinal data.This procedure is based on a statistic not affected by Kappa paradoxes.
In case of ordinal data, the weighted versions of the statistic has been developed using a matrix of linear or quadratic weights.
The percentile Boostrap confidence interval is computed and the test argument allows to perform if the agreement is nil.
The p value can be approximated using the Normal, Chi-squared distribution or using Monte Carlo algorithm in case of nominal data. Otherwise, the approximation and the Monte Carlo algorithm is computed.
Fleiss' Kappa index is also shown in case of nominal data.
In a nutshell, the function `concordance`

can be used
in case of nominal scale while the functions `wlin.conc`

and `wquad.conc`

can be used in case of ordinal
data using linear or quadratic weights, respectively.

Package: | raters |

Type: | Package |

Version: | 2.0.1 |

Date: | 2014-12-29 |

License: | GPL(>=2) |

Daniele Giardiello, Piero Quatto, Enrico Ripamonti and Stefano Vigliani

Maintainer: Daniele Giardiello <[email protected]>

Fleiss, J.L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin **76, 378-382**.

Falotico, R. Quatto, P. (2010). On avoiding paradoxes in assessing inter-rater agreement. Italian Journal of Applied Statistics **22, 151-160.**

Falotico, R., Quatto, P. (2014). Fleiss' kappa statistic without paradoxes. Quality & Quantity, **1-8**.

Marasini, D. Quatto, P. Ripamonti, E. (2014). Assessing the inter-rater agreement for ordinal data through weighted indexes. Statistical methods in medical research.

1 2 3 4 5 6 7 8 9 10 11 12 13 | ```
# Nominal data
data(diagnostic)
concordance(diagnostic,test="Normal")
# Ordinal data with linear weights
data(winetable)
set.seed(12345)
wlin.conc(winetable,test="MC")
# Ordinal data with quadratic weights
data(winetable)
set.seed(12345)
wquad.conc(winetable,test="MC")
``` |

```
Inter-rater Agreement
$Fleiss
Kappa LCL UCL Std.Error Z value Pr(>|z|)
0.43024452 0.38247249 0.47801655 0.02437393 17.65183058 0.00000000
$Statistic
S LCL UCL pvalue
0.4444444 0.3471528 0.5555556 0.0000000
S* min LCL UCL pvalue
0.4097222 -0.4062500 0.3229167 0.4921875 0.0000000
S* min LCL UCL pvalue
0.6267361 -0.4062500 0.5277344 0.7153212 0.0000000
```

raters documentation built on May 29, 2017, 8:18 p.m.

Embedding an R snippet on your website

Add the following code to your website.

For more information on customizing the embed code, read Embedding Snippets.