Exploring the statistical fragility of creativity studies using the alternate uses task: A systematic review protocol

Area of Science:

• Cognitive Psychology
• Psychometrics

Background:

• The Alternate Uses Task (AUT) is a key measure of creative potential.
• Concerns exist regarding the robustness and statistical fragility of findings from AUT studies.
• Over-reliance on p-values may lead to unreliable results in creativity research.

Purpose of the Study:

• To systematically evaluate the statistical fragility of findings from studies using the Alternate Uses Task (AUT).
• To assess the robustness of creative potential measurements derived from the AUT.
• To utilize the continuous fragility index (CFI) for a rigorous evaluation.

Main Methods:

• Systematic review of eligible two-arm experimental studies (randomized or non-randomized) reporting significant AUT outcomes.
• Comprehensive literature search across Medline, Embase, PsycInfo, and ERIC databases.
• Calculation of the median continuous fragility index (CFI) as the primary outcome; multivariable regression for secondary analysis.

Main Results:

• This section will report the median CFI across included studies, indicating the statistical fragility of AUT findings.
• Secondary analyses will explore study-level predictors associated with statistical fragility.
• Results will quantify the robustness of creativity assessments.

Conclusions:

• Findings will highlight the extent of statistical fragility in creativity research utilizing the AUT.
• The study aims to promote enhanced reporting standards and methodological rigor in creativity research.
• This work encourages more robust and reliable measurement of creative potential.