Complex Problem Solving: What It Is and What It Is Not.

Area of Science:

• Cognitive Psychology
• Psychological Assessment
• Human-Computer Interaction

Background:

• Computer-simulated scenarios have been utilized in problem-solving research for over four decades.
• Research focus has shifted from simple to complex, real-world problem scenarios.
• Discussions on assessing complex problem-solving have prioritized psychometric properties over content validity.

Purpose of the Study:

• To re-center the discussion on the content validity of complex problem-solving assessments.
• To identify and define the essential features characterizing complex problems.
• To guide future research in developing more content-valid measures of complex problem-solving.

Main Methods:

• Conceptual analysis of existing literature on complex problem-solving.
• Theoretical framework development to delineate key features of complex problems.
• Review of assessment methodologies in computer-simulated problem-solving environments.

Main Results:

• Identified a gap in research that overemphasizes psychometric reliability at the expense of content validity.
• Proposed a framework for understanding the defining characteristics of complex problems.
• Highlighted the need for assessment tools that accurately reflect the nature of complex problem-solving.

Conclusions:

• Content validity is crucial for accurately assessing complex problem-solving skills.
• Future research should prioritize defining and measuring the inherent features of complex problems.
• A balanced approach considering both psychometric properties and content validity is essential for advancing the field.