On the Relationship Between Item Stem Formulation and Criterion Validity of Multiple-Component Measuring Instruments
Natalja Menold1, Tenko Raykov2
1Technische Universität Dresden, Dresden, Germany.
Educational and Psychological Measurement
|February 21, 2022
Summary
Item formulation significantly impacts criterion validity in measurement instruments. How questions are phrased, especially using single versus double-barreled stems, affects research findings in social sciences.
Area of Science:
- Psychometrics
- Educational Measurement
- Social Science Research
Background:
- Criterion validity is crucial for measurement instrument accuracy.
- Item formulation, particularly stem complexity, may influence validity.
- Understanding these effects is vital for reliable research.
Purpose of the Study:
- To examine how item formulation affects criterion validity.
- To compare validity differences based on item stem complexity (single vs. double-barreled).
- To assess latent validity differences across groups exposed to varied item stems.
Main Methods:
- Empirical data collection.
- Random assignment of participants to different item stem conditions.
- Evaluation of criterion validity differences across groups.
Main Results:
- Instrument validity is demonstrably influenced by item stem formulation.
- Differences in criterion validity were observed between groups.
- Complex item stems (double-barreled) may impact validity differently than single-sentence stems.
Conclusions:
- The way measurement instrument items are formulated is a critical factor in their validity.
- Researchers must carefully consider item wording to ensure accurate and reliable results.
- Findings have implications for improving research practices in education and social sciences.
Related Concept Videos
01:29Reliability and Validity
13.3K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.3K
01:29Measures of Intelligence
7.9K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.9K
02:01Factorial Design
13.3K
Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...
13.3K
01:22Self-Report Tests of Personality
489
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
489
01:25Yield Criteria for Ductile Materials under Plane Stress
223
In designing structural elements and machine parts using ductile materials, it is crucial to ensure that these components withstand applied stresses without yielding. Yielding is initially determined through a tensile test, which evaluates the material's response to uniaxial stress. However, tensile stress is insufficient when components face biaxial or plane stress conditions This condition requires advanced criteria to predict failure.
The Maximum Shearing Stress Criterion, also known as...
The Maximum Shearing Stress Criterion, also known as...
223
01:25Formulating and Validating Nursing Diagnosis II
3.1K
Nursing diagnoses represent a problem validated by major defining characteristics. There are four categories of nursing diagnoses: problem-focused, risk, health promotion or wellness, and syndrome. The anatomy of a nursing diagnosis includes three components: problem statement or diagnostic label, defining characteristics, and related factors.
Risk nursing diagnoses represent clinical judgments of an individual, family, or community more vulnerable to developing the health problem than others...
Risk nursing diagnoses represent clinical judgments of an individual, family, or community more vulnerable to developing the health problem than others...
3.1K