View source: R/roc_functions.R
| make_rocdata | R Documentation |
Computes Receiver Operating Characteristic (ROC) data from lineup identification experiments following the methodology of Mickes, Wixted, and Gronlund.
make_rocdata(
data,
lineup_size = 6,
innocent_suspect = "auto",
thresholds = NULL
)
data |
A dataframe with the following columns:
|
lineup_size |
Integer. Number of people in the lineup (default = 6). Used to estimate false ID rate when fillers are chosen from target-absent lineups. |
innocent_suspect |
How innocent-suspect identifications in
target-absent lineups are obtained. |
thresholds |
Optional numeric vector of confidence criteria at which to evaluate the ROC. The default uses the confidence levels of the responses that can move an operating point; see Details. Supplying the criteria of a full sample keeps them fixed across bootstrap resamples. |
This function computes ROC curves following Wixted & Mickes (2012) and Mickes (2015). For each confidence criterion:
Correct ID rate = proportion of target-present lineups where suspect identified
False ID rate = proportion of target-absent lineups where suspect identified
The criteria are the confidence levels of the responses that enter the ROC: target-present suspect IDs, and target-absent suspect IDs (designated suspect) or filler IDs (estimated). The confidence given to rejections, or to filler IDs in target-present lineups, does not define a criterion, because it cannot move an operating point. Each criterion therefore gives a distinct point, and averages over points (DPP, z-ROC d') do not depend on how rejection confidence was coded.
With a designated innocent suspect, target-absent "suspect"
responses are used directly. Without one, filler IDs are divided by lineup
size. The two estimators are never added together. Dividing filler IDs by
lineup size assumes the innocent suspect is chosen at the average filler
rate, which holds for a fair lineup; with a biased lineup the estimated
false-ID rate, and so the ROC and pAUC, are wrong, and a designated innocent
suspect should be used when one is available. See
innocent_suspect for how the design is determined.
A list containing:
roc_data: Dataframe with correct_id_rate, false_id_rate, and confidence
pauc: Partial area under the curve
n_target_present: Number of target-present lineups
n_target_absent: Number of target-absent lineups
thresholds: The confidence criteria used, highest first
Wixted, J. T., & Mickes, L. (2012). The field of eyewitness memory should abandon probative value and embrace receiver operating characteristic analysis. Perspectives on Psychological Science, 7(3), 275-278.
Mickes, L. (2015). Receiver operating characteristic analysis and confidence-accuracy characteristic analysis in investigations of system variables and estimator variables that affect eyewitness memory. Journal of Applied Research in Memory and Cognition, 4(2), 93-102.
Gronlund, S. D., Wixted, J. T., & Mickes, L. (2014). Evaluating eyewitness identification procedures using receiver operating characteristic analysis. Current Directions in Psychological Science, 23(1), 3-10.
data(lineup_example)
roc <- make_rocdata(lineup_example)
roc$roc_data
roc$pauc
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.