Four utilities in eyewitness identification practice: Dissociations between receiver operating characteristic (ROC)...

Area of Science:

• Forensic Psychology
• Criminal Justice
• Decision Analysis

Background:

• Eyewitness identifications are crucial in criminal justice but prone to errors.
• Current evaluation methods, like Receiver Operating Characteristic (ROC) curves, may not fully capture practical effectiveness.
• Understanding the utility of identification procedures is essential for optimizing their use.

Purpose of the Study:

• To propose a utility-based framework for evaluating eyewitness identification procedures.
• To introduce a novel graphical technique, utility difference curves, for assessing procedure performance.
• To highlight the impact of base rates and cost structures on identification procedure outcomes.

Main Methods:

• Developed a framework considering four types of utility: overall, high-confidence, average, and maximum attainable.
• Introduced utility difference curves as a graphical tool for analysis.
• Analyzed the trade-offs between identifying guilty suspects and misidentifying innocent suspects.

Main Results:

• Standard ROC curve approaches often fail to provide unambiguous guidance on the best eyewitness identification procedures.
• Utility difference curves effectively illustrate how varying base rates and cost structures influence the practical benefits of different procedures.
• The study clarifies conditions under which eyewitness experiment outcomes are clear versus those requiring careful trade-off analysis.

Conclusions:

• A utility-based understanding, incorporating base rates and error costs, is vital for evaluating eyewitness identification procedures.
• The proposed utility difference curves offer a more nuanced and practical method for comparing identification techniques.
• This research emphasizes the need for careful consideration of assumptions when interpreting eyewitness identification experiment results in criminal justice.