reliability: calculate reliability-index

In EloChoice: Preference Rating for Visual Stimuli Based on Elo Ratings

Description

calculate reliability-index of Elo-ratings

Usage

reliability(x)

Arguments

x	elochoice-object, the result of elochoice

Value

a data.frame with as many rows as randomizations were run in the original call to elochoice(). The first column represents the unweighted and the second the weighted reliability index (R and R'), which is followed by the total number of trials that contributed to the calculation of the index. Note that this number cannot reach the total number of trials in the data set because at least for the very first trial we did not have an expectation for the outcome of that trial (and such trials do not contribute to the calculation of the reliability index).

Author(s)

Christof Neumann

References

\insertRef

clark2018EloChoice

Examples

# create data set and calculate ratings (with five randomizations)
xdata <- randompairs(12, 500)
x <- elochoice(xdata$winner, xdata$loser, runs=5)
# extract the reliability values
(u <- reliability(x))
# calculate average reliability index
mean(u$upset)
# and in its weighted form
mean(u$upset.wgt)

Example output

      upset upset.wgt totIA
1 0.8306452 0.9069672   496
2 0.8421053 0.9082367   494
3 0.8360324 0.9056167   494
4 0.8370221 0.9118787   497
5 0.8353414 0.9111204   498
[1] 0.8362293
[1] 0.9087639

EloChoice documentation built on July 4, 2019, 5:04 p.m.