Related Experiment Videos
Sample homogeneity and coefficient alpha: comment on MJI and Alkhateeb's reliability generalization study and a
1University of North Texas, Department of Technology and Cognition, P.O. Box 311335, Denton, TX 76203-1335, USA. rhenson@unt.edu
Psychological Reports
|November 11, 2005
Summary
This study examines reliability generalization in educational research, specifically critiquing a 2005 study on the Conceptions of Mathematics Questionnaire. It clarifies coefficient alpha
Area of Science:
- Educational Measurement
- Psychometrics
- Research Methodology
Background:
- Reliability generalization studies are common in research literature.
- Mji and Alkhateeb (2005) conducted a reliability generalization study on the Conceptions of Mathematics Questionnaire.
- Concerns exist regarding the application and interpretation of reliability generalization methods.
Purpose of the Study:
- To comment on the methodology of reliability generalization used in Mji and Alkhateeb's (2005) study.
- To clarify theoretical aspects of coefficient alpha.
- To identify data features influencing score reliability measures.
Main Methods:
- Critical analysis of a published reliability generalization study.
- Theoretical discussion of psychometric principles, specifically coefficient alpha.
- Examination of factors affecting score reliability.
Main Results:
- Identified an issue in the application of reliability generalization in the cited study.
- Provided a clearer theoretical understanding of coefficient alpha.
- Highlighted specific data characteristics that impact reliability estimates.
Conclusions:
- The interpretation of reliability generalization requires careful theoretical consideration.
- Coefficient alpha's behavior is influenced by specific data properties.
- Accurate assessment of score reliability is crucial for valid educational research.