Detecting jingle and jangle fallacies by identifying consistencies and variabilities in study specifications - a call...

Area of Science:

• Psychological Science
• Research Methodology
• Scientific Communication

Background:

• Jingle fallacies occur when distinct phenomena share a term; jangle fallacies occur when similar phenomena have different terms.
• These fallacies arise from vague links between theory and empirical studies, varied designs, and statistical methods.
• Existing methods like systematic reviews have not fully addressed these naming inconsistencies.

Purpose of the Study:

• To explore integrated approaches for identifying and mitigating jingle and jangle fallacies in psychological science.
• To propose a framework for organizing studies based on detailed specifications.
• To discuss the role of computational technologies in addressing these fallacies.

Main Methods:

• Organizing studies by detailed specifications: theoretical background, methods, study designs, and results.
• Developing a combinatorial algorithm and flexible inclusion criteria for study analysis.
• Exploring the application of Natural Language Processing (NLP) for fallacy detection.

Main Results:

• A proposed method identifies jingle fallacies when identical specifications yield disparate outcomes.
• Jangle fallacies can be indicated when differing specifications consistently produce similar results.
• Advanced computational tools, like NLP, show potential for automated detection.

Conclusions:

• Addressing jingle and jangle fallacies requires a holistic strategy across all scientific levels.
• Organizing research by specifications and employing computational methods offers a feasible approach.
• Mitigating these fallacies is crucial for improving clarity and rigor in psychological science.