make_rocdata: Compute ROC Data for Lineup Identification

View source: R/roc_functions.R

make_rocdataR Documentation

Compute ROC Data for Lineup Identification

Description

Computes Receiver Operating Characteristic (ROC) data from lineup identification experiments following the methodology of Mickes, Wixted, and Gronlund.

Usage

make_rocdata(
  data,
  lineup_size = 6,
  innocent_suspect = "auto",
  thresholds = NULL
)

Arguments

data

A dataframe with the following columns:

  • target_present: Logical. TRUE if guilty suspect in lineup, FALSE if innocent

  • identification: Character. "suspect", "filler", or "reject"

  • confidence: Numeric. Confidence rating (higher = more confident)

lineup_size

Integer. Number of people in the lineup (default = 6). Used to estimate false ID rate when fillers are chosen from target-absent lineups.

innocent_suspect

How innocent-suspect identifications in target-absent lineups are obtained. "designated": the lineups had a designated innocent suspect, so target-absent "suspect" rows are counted directly, and zero such rows means a false-ID rate of zero. "estimated": there was no designated innocent suspect, so the innocent-suspect count is estimated as filler IDs divided by lineup_size. "auto" (the default) chooses "designated" when any target-absent row is a suspect ID or the data have a non-missing suspect_pos column, and "estimated" otherwise, with a message.

thresholds

Optional numeric vector of confidence criteria at which to evaluate the ROC. The default uses the confidence levels of the responses that can move an operating point; see Details. Supplying the criteria of a full sample keeps them fixed across bootstrap resamples.

Details

This function computes ROC curves following Wixted & Mickes (2012) and Mickes (2015). For each confidence criterion:

  • Correct ID rate = proportion of target-present lineups where suspect identified

  • False ID rate = proportion of target-absent lineups where suspect identified

The criteria are the confidence levels of the responses that enter the ROC: target-present suspect IDs, and target-absent suspect IDs (designated suspect) or filler IDs (estimated). The confidence given to rejections, or to filler IDs in target-present lineups, does not define a criterion, because it cannot move an operating point. Each criterion therefore gives a distinct point, and averages over points (DPP, z-ROC d') do not depend on how rejection confidence was coded.

With a designated innocent suspect, target-absent "suspect" responses are used directly. Without one, filler IDs are divided by lineup size. The two estimators are never added together. Dividing filler IDs by lineup size assumes the innocent suspect is chosen at the average filler rate, which holds for a fair lineup; with a biased lineup the estimated false-ID rate, and so the ROC and pAUC, are wrong, and a designated innocent suspect should be used when one is available. See innocent_suspect for how the design is determined.

Value

A list containing:

  • roc_data: Dataframe with correct_id_rate, false_id_rate, and confidence

  • pauc: Partial area under the curve

  • n_target_present: Number of target-present lineups

  • n_target_absent: Number of target-absent lineups

  • thresholds: The confidence criteria used, highest first

References

Wixted, J. T., & Mickes, L. (2012). The field of eyewitness memory should abandon probative value and embrace receiver operating characteristic analysis. Perspectives on Psychological Science, 7(3), 275-278.

Mickes, L. (2015). Receiver operating characteristic analysis and confidence-accuracy characteristic analysis in investigations of system variables and estimator variables that affect eyewitness memory. Journal of Applied Research in Memory and Cognition, 4(2), 93-102.

Gronlund, S. D., Wixted, J. T., & Mickes, L. (2014). Evaluating eyewitness identification procedures using receiver operating characteristic analysis. Current Directions in Psychological Science, 23(1), 3-10.

Examples

data(lineup_example)
roc <- make_rocdata(lineup_example)
roc$roc_data
roc$pauc


r4lineups documentation built on Nov. 10, 2026, 1:08 a.m.