The EFPA Test-Review Model: When Good Intentions Meet a Methodological Thought Disorder

Area of Science:

• Psychology
• Psychometrics
• Measurement Theory

Background:

• The European Federation of Psychologists' Associations (EFPA) has established test review standards without addressing critiques of psychometric test theory.
• Measurement experts like Joel Michell have described current psychometric test theory as "pathological".

Purpose of the Study:

• To propose a new framework for evidence-based assessment construction for "Next Generation" psychological assessments.
• To address the limitations of traditional item-based, statistical test theory in light of evolving assessment practices.

Main Methods:

• Critically evaluating existing psychometric test standards and guidelines.
• Developing a new framework for evidence-bases that avoids assumptions of equal-interval or quantitatively structured psychological attributes.
• Analyzing the lack of substantive refutations to critiques of psychometric theory.

Main Results:

• A new framework is proposed for "Next Generation" assessments, moving beyond traditional psychometric assumptions.
• Existing psychometric test standards may not adequately support new assessment methodologies.
• Critiques of psychometric test theory by experts remain largely unaddressed by professional bodies.

Conclusions:

• Psychologists and professional associations may be in denial regarding fundamental issues in psychometric theory.
• Adherence to current EFPA guidelines might necessitate legal justification for professional beliefs in the future.
• The field faces a paradigm shift, potentially moving away from traditional psychometric models.