Related Experiment Video
Updated: Jun 1, 2026
07:28
A Protocol of Manual Tests to Measure Sensation and Pain in Humans
Published on: December 19, 2016
Advice on total-score reliability issues in psychosomatic measurement.
Klaas Sijtsma1, Wilco H M Emons
1Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands. k.sijtsma@uvt.nl
Journal of Psychosomatic Research
|June 1, 2011
Summary
Reliability in psychosomatic research scales is crucial. Using highly reliable scales reduces faulty decisions, but coefficient alpha is a weak reliability estimator and factor analysis should assess internal consistency.
Area of Science:
- Psychometrics
- Psychosomatic Research
- Statistical Modeling
Background:
- Scale construction in psychosomatic research faces significant reliability challenges.
- These issues can lead to errors in data interpretation and application.
- Addressing these problems is vital for accurate research outcomes.
Purpose of the Study:
- To identify and address critical reliability issues in scale construction for psychosomatic research.
- To illustrate how these reliability problems can cause research errors.
- To propose practical solutions and recommendations for improving scale reliability.
Main Methods:
- Utilized psychometric results from five computational studies.
- Employed artificial data generation from psychometric models for three studies.
- Conducted analytical approaches for the remaining two studies.
Main Results:
- Student's t test power is more influenced by sample size than total-score reliability.
- High reliability is essential for accurate correlation estimates involving test scores.
- Coefficient alpha provides limited insight into questionnaire structure and is a poor reliability estimator.
Conclusions:
- The relationship between scale length, reliability, and statistical power is intricate.
- Recommends using highly reliable scales in research and diagnostics to minimize decision errors.
- Advocates for factor analysis to assess internal consistency and replacing coefficient alpha with superior reliability estimators.
Related Concept Videos
01:29Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
01:22Self-Report Tests of Personality
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
01:52Regression Toward the Mean
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when researchers try to extrapolate results...
02:40The Scientific Method
Research is what makes the difference between facts and opinions. Facts are observable realities, and opinions are personal judgments, conclusions, or attitudes that may or may not be accurate. In the scientific community, facts can be established only using evidence collected through empirical research.
01:29Introspection
Introspection, long upheld as a reliable route to self-knowledge, involves examining one's thoughts, emotions, and mental processes. It underpins many psychological practices, from mindfulness meditation to psychotherapy and self-help strategies. However, empirical evidence challenges the accuracy of introspection as a means of understanding oneself.Limitations of Introspective InsightSeminal work by Nisbett and Wilson demonstrated that individuals are frequently unaware of the true causes...
01:29Measures of Intelligence
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...