Panero et al. (2016): Failure to replicate methods caused the failure to replicate results

Area of Science:

• Cognitive Psychology
• Literary Studies
• Social Cognition

Background:

• Previous research suggests literary fiction enhances theory of mind (ToM).
• Panero et al. (2016) failed to replicate these findings, reporting no significant effect of literary fiction on ToM.
• This commentary critically examines the methodology of Panero et al. (2016).

Purpose of the Study:

• To re-evaluate the findings of Panero et al. (2016) by addressing methodological limitations.
• To determine if literary fiction reading improves performance on the Reading the Mind in the Eyes Test (RMET).
• To reconcile conflicting results regarding the impact of literary fiction on ToM.

Main Methods:

• Analysis of data from Panero et al. (2016), focusing on participant engagement and random assignment.
• Exclusion of participants who did not sufficiently engage with assigned texts.
• Exclusion of data from studies with compromised random assignment procedures.

Main Results:

• Significant threats to internal validity were identified in Panero et al. (2016), including issues with text exposure and random assignment.
• After correcting for methodological flaws, literary fiction reading was found to improve ToM performance compared to popular genre fiction.
• The re-analysis aligns with prior studies, indicating that methodological inconsistencies led to the failure to replicate previous results.

Conclusions:

• The findings of Panero et al. (2016) are unreliable due to significant methodological issues.
• Reading literary fiction demonstrably enhances theory of mind (ToM) abilities.
• Careful replication of experimental methods is crucial for obtaining reliable research findings.