On the Practical Consequences of Misfit in Mokken Scaling

Daniela Ramona Crişan1, Jorge N Tendeiro1, Rob R Meijer1

  • 1University of Groningen, The Netherlands.

Insights

Mokken scale analysis is key for questionnaire quality. This study shows that while item issues can affect results, removing them often has minor impacts, emphasizing content validity alongside statistical rules.

Area of Science:

  • Psychometrics
  • Psychological Measurement
  • Scale Analysis

Background:

  • Mokken scale analysis is widely used for evaluating questionnaire psychometric properties.
  • Empirical studies often focus on scale formation, with less attention to the impact of violating common rules of thumb.

Purpose of the Study:

  • To investigate the practical consequences of retaining or removing items that do not meet Mokken scale analysis rules of thumb.
  • To assess the influence of low scalability items on various psychometric outcomes.

Main Methods:

  • Utilized simulated data to model the effects of item retention/removal.
  • Examined the impact on test score reliability, person ordering and selection, and criterion-related validity.

Main Results:

  • Items with low scalability demonstrated a discernible influence on reliability, person ordering, selection, and validity estimates.
  • Removing misfitting items generally resulted in minor changes to the overall outcomes.

Conclusions:

  • While some outcome variables showed robustness against scale violations, researchers should not solely depend on automated item selection algorithms.
  • Content validity is crucial for constructing meaningful psychometric instruments, complementing statistical analyses.

Related Concept Videos

Scaling01:26

Scaling

In designing and analyzing filters, resonant circuits, or circuit analysis at large, working with standard element values like 1 ohm, 1 henry, or 1 farad can be convenient before scaling these values to more realistic figures. This approach is widely utilized by not employing realistic element values in numerous examples and problems; it simplifies mastering circuit analysis through convenient component values. The complexity of calculations is thereby reduced, with the understanding that...
448
Modeling and Similitude01:12

Modeling and Similitude

Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
505
Design Example: Creating a Hydraulic Model of a Dam Spillway01:21

Design Example: Creating a Hydraulic Model of a Dam Spillway

Scaled hydraulic models of dam spillways provide a practical way to replicate and study the intricate flow dynamics of these structures. Often built to a 1:15 ratio, these models allow for observing critical water behavior, such as velocity distribution, flow patterns, and energy dissipation.
554
Mismatch Repair01:20

Mismatch Repair

Organisms are capable of detecting and fixing nucleotide mismatches that occur during DNA replication. This sophisticated process requires identifying the new strand and replacing the erroneous bases with correct nucleotides. Mismatch repair is coordinated by many proteins in both prokaryotes and eukaryotes.
The Mutator Protein Family Plays a Key Role in DNA Mismatch Repair
The human genome has more than 3 billion base pairs of DNA per cell. Prior to cell division, that vast amount of genetic...
6.1K
Typical Model Studies01:30

Typical Model Studies

Fluid mechanics model studies often utilize scaled-down systems to predict fluid behavior in full-scale environments, such as river flows, dam spillways, and structures interacting with open surfaces. Maintaining Froude number similarity in river models is crucial, as it replicates surface flow features like wave patterns and velocities.
543
Transformers with Off-Nominal Turns Ratios01:25

Transformers with Off-Nominal Turns Ratios

In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the...
435