Does the Forensic Filler-Control Method Reduce Examiner Overconfidence? An Experimental Investigation Using Mock...

Area of Science:

• Forensic Science
• Cognitive Psychology
• Legal Testimony

Background:

• Examiner overconfidence in forensic science contributes to wrongful convictions.
• Overconfidence occurs when subjective certainty exceeds objective accuracy.
• Proposed methods to reduce overconfidence include the forensic filler-control method.

Purpose of the Study:

• To evaluate the effectiveness of the forensic filler-control method in reducing examiner overconfidence.
• To compare the accuracy and calibration of the filler-control method against the standard forensic analysis procedure.
• To assess the impact of the filler-control method on both incriminating and exonerating evidence values.

Main Methods:

• Two experiments were conducted with undergraduate and forensic science student samples.
• Participants performed forensic analyses using either the standard method or the filler-control method.
• The filler-control method involved presenting known non-matching "filler" samples alongside suspect samples to provide error feedback.

Main Results:

• The filler-control method did not reduce examiner overconfidence; instead, it led to worse calibration and greater overconfidence in match judgments.
• Non-match judgments were less accurate with the filler-control method, reducing its exonerating value (negative predictive value).
• The filler-control method improved the reliability of incriminating evidence (positive predictive value) by diverting false positives to fillers.

Conclusions:

• The forensic filler-control method, as tested, is not superior to the standard procedure for forensic analysis.
• Neither method uniformly enhances both the inculpatory and exculpatory value of forensic evidence.
• Alternative procedures are needed to improve the reliability and accuracy of forensic evaluations.