Related Experiment Video
Updated: Aug 12, 2026
10:27
Training Synesthetic Letter-color Associations by Reading in Color
Published on: February 20, 2014
On the science of Rorschach research
1Department of Psychology, University of Alaska Anchorage, USA. afgjm@uaa.alaska.edu
Journal of Personality Assessment
|August 15, 2000
Summary
This critique addresses inaccuracies in Wood et al.'s (1999b) article regarding research methodology, statistical analysis, and the validity of diagnostic efficiency statistics. The author highlights misrepresentations and flawed arguments concerning incremental validity, regression analysis, and composite measures.
Area of Science:
- Psychological research methodology
- Statistical analysis in psychology
- Test validity and diagnostic efficiency
Background:
- Wood et al. (1999b) presented general points on research design and validity, including the utility of extreme groups designs and diagnostic efficiency statistics.
- However, the article contained specific inaccuracies and misrepresentations concerning statistical analyses and research findings.
Purpose of the Study:
- To critically evaluate and correct specific methodological and statistical claims made by Wood et al. (1999b).
- To address misinterpretations of data and citations related to incremental validity, regression analysis, and the use of composite measures.
Main Methods:
- Detailed critique of specific claims within Wood et al. (1999b).
- Re-examination of statistical procedures, including regression analyses and the calculation of diagnostic efficiency statistics (e.g., HEV).
- Comparison of cited literature and expert recommendations against the claims made by Wood et al.
Main Results:
- Wood et al. (1999b) made improper citations and misrepresented findings regarding the incremental validity of the Rorschach over the MMPI-2.
- Their critique of regression analyses by Burns and Viglione (1996) was based on misinterpretations of statistical texts and improper alpha levels.
- The article erroneously simplified extreme group designs and criticized composite measures despite their established validity.
- A faulty z-score formula for HEV was presented and defended, despite evidence of its near-perfect correlation with the correct formula.
Conclusions:
- Wood et al. (1999b) contained numerous specific errors in statistical application, citation, and interpretation.
- The critique underscores the importance of accurate statistical reporting and methodological rigor in psychological research.
- Proper application of statistical methods and careful interpretation of diagnostic efficiency statistics are crucial for valid research outcomes.
Related Concept Videos
02:40The Scientific Method
Research is what makes the difference between facts and opinions. Facts are observable realities, and opinions are personal judgments, conclusions, or attitudes that may or may not be accurate. In the scientific community, facts can be established only using evidence collected through empirical research.
01:56Ethics in Research
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
01:13Psychology as a Science
Psychology, as a scientific discipline, aims to understand the mind and behavior through rigorous and systematic methods. The foundation of psychological research is evidence-based, relying heavily on the scientific method to derive and validate knowledge. This structured approach ensures that findings are reliable, valid, and applicable to broader contexts.
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...