On "Confirmatory" Methodological Research in Statistics and Related Fields

Area of Science:

• Statistics
• Biostatistics
• Methodological Research

Background:

• Empirical research is categorized as exploratory or confirmatory.
• The exploratory-confirmatory distinction is under-examined in empirical methodological research.
• This study addresses the gap in understanding this distinction within methodological research.

Purpose of the Study:

• Revisit empirical methodological research using the exploratory-confirmatory lens.
• Examine current practices in biostatistics regarding this distinction.
• Provide recommendations for designing, interpreting, and reporting methodological research.

Main Methods:

• Literature survey of 115 biostatistics articles.
• Analysis of research practices through the exploratory-confirmatory framework.
• Development of practical recommendations based on findings.

Main Results:

• Most published methodological studies are fundamentally exploratory, despite potential confirmatory framing.
• Both exploratory and confirmatory modes are vital for methodological advancement.
• A continuum exists between pure exploration and strict confirmation in methodological research.

Conclusions:

• Transparent reporting of research mode (exploratory/confirmatory spectrum) is recommended.
• Emphasize the importance of pre-defined study protocols, especially for confirmatory research.
• Appropriate design, interpretation, and reporting enhance the rigor of empirical methodological research.