Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Measures of Intelligence01:29

Measures of Intelligence

6.4K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
6.4K
Fundamental Attribution Error01:14

Fundamental Attribution Error

12.8K
According to some social psychologists, people tend to overemphasize internal factors as explanations—or attributions—for the behavior of other people. They tend to assume that the behavior of another person is a trait of that person, and to underestimate the power of the situation on the behavior of others. They tend to fail to recognize when the behavior of another is due to situational variables, and thus to the person’s state. This erroneous assumption is...
12.8K
The Anchoring-and-Adjustment Heuristic01:25

The Anchoring-and-Adjustment Heuristic

7.2K
In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the...
7.2K
Wechsler's Contribution to Measures of Intelligence01:23

Wechsler's Contribution to Measures of Intelligence

1.4K
David Wechsler, a psychologist who worked with World War I veterans, developed a significant IQ test in 1939 called the Wechsler-Bellevue Intelligence Scale. This test was innovative because it combined several subtests that measured both verbal and nonverbal skills, reflecting Wechsler's belief that intelligence is a global capacity involving purposeful action, rational thinking, and effective interaction with the environment. This test later evolved into the Wechsler Adult Intelligence...
1.4K
Reliability and Validity01:29

Reliability and Validity

12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Self-Report Tests of Personality01:22

Self-Report Tests of Personality

309
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
309

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Meta-analytic associations between the Student-Teacher Relationship Scale and students' social competence with peers.

School psychology review·2024
Same author

A Comparison of Response Time Threshold Scoring Procedures in Mitigating Bias From Rapid Guessing Behavior.

Educational and psychological measurement·2024
Same author

Investigating the Effect of Differential Rapid Guessing on Population Invariance in Equating.

Applied psychological measurement·2022
Same author

A Comparison of Robust Likelihood Estimators to Mitigate Bias From Rapid Guessing.

Applied psychological measurement·2022
Same author

Assessing the Accuracy of Parameter Estimates in the Presence of Rapid Guessing Misclassifications.

Educational and psychological measurement·2022
Same author

Quantifying the Distorting Effect of Rapid Guessing on Estimates of Coefficient Αlpha.

Applied psychological measurement·2021
Same journal

A Simple Approach for Differential Test Functioning Based on Sum Scores.

Educational and psychological measurement·2026
Same journal

Evaluating Factor Retention in Large Factor Analysis Models: A Simulation Study Comparing 15 Methods.

Educational and psychological measurement·2026
Same journal

Agreement and Alignment in Binary Rating Tasks: Strategic Convergence as an Equilibrium Outcome.

Educational and psychological measurement·2026
Same journal

Interactions Between Termination Criteria and Ability Estimators in Computerized Adaptive Testing.

Educational and psychological measurement·2026
Same journal

Identification and Diagnosis of Misreporting in Surveys.

Educational and psychological measurement·2026
Same journal

The Aggregated Latent Profile Index: Measuring Person Profile Differentiation Within a Bootstrap-Validated Latent Profile Space.

Educational and psychological measurement·2026
See all related articles

Related Experiment Video

Updated: Jun 7, 2025

A Tactile Automated Passive-Finger Stimulator TAPS
19:44

A Tactile Automated Passive-Finger Stimulator TAPS

Published on: June 3, 2009

13.6K

Is Effort Moderated Scoring Robust to Multidimensional Rapid Guessing?

Joseph A Rios1, Jiayi Deng2

  • 1Grad Student Academy, San Diego, CA, USA.

Educational and Psychological Measurement
|November 20, 2024
PubMed
Summary
This summary is machine-generated.

The unidimensional effort-moderated (EM) scoring approach performs well against multidimensional rapid guessing (RG), especially when RG is 12% or less. EM scoring shows comparable results to the Holman-Glas (HG) method in ability estimation and reliability.

Keywords:
item response theorymodel fitnoneffortful respondingrapid guessingreliability

More Related Videos

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

700
Multimedia Battery for Assessment of Cognitive and Basic Skills in Mathematics BM-PROMA
10:58

Multimedia Battery for Assessment of Cognitive and Basic Skills in Mathematics BM-PROMA

Published on: August 28, 2021

4.4K

Related Experiment Videos

Last Updated: Jun 7, 2025

A Tactile Automated Passive-Finger Stimulator TAPS
19:44

A Tactile Automated Passive-Finger Stimulator TAPS

Published on: June 3, 2009

13.6K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

700
Multimedia Battery for Assessment of Cognitive and Basic Skills in Mathematics BM-PROMA
10:58

Multimedia Battery for Assessment of Cognitive and Basic Skills in Mathematics BM-PROMA

Published on: August 28, 2021

4.4K

Area of Science:

  • Psychometrics
  • Educational Measurement
  • Statistical Modeling

Background:

  • Rapid guessing (RG) is a significant challenge in standardized testing, potentially compromising data integrity.
  • Various scoring methods have been proposed to mitigate the impact of RG.
  • The unidimensional effort-moderated (EM) scoring procedure is a popular approach, but its robustness to multidimensional RG is not well understood.

Purpose of the Study:

  • To evaluate the performance of the unidimensional effort-moderated (EM) scoring procedure against multidimensional rapid guessing (RG).
  • To compare EM scoring with the Holman-Glas (HG) method, a multidimensional scoring approach.
  • To assess the impact of RG on model fit distortion, ability parameter recovery, and omega reliability.

Main Methods:

  • A simulation study was conducted manipulating test difficulty, proportion of RG, and the association between ability and RG propensity.
  • The study compared EM scoring and HG scoring across 80 different conditions.
  • Key metrics analyzed included model fit distortion, ability parameter recovery, and omega reliability distortion.

Main Results:

  • EM scoring demonstrated superior model fit compared to HG scoring when RG constituted 12% or less of item responses.
  • No significant differences were found between EM and HG scoring in ability parameter recovery and omega reliability distortion under moderate multidimensional RG.
  • RG had a limited impact on aggregated ability and reliability estimates, even with up to 40% RG in the sample data.

Conclusions:

  • The unidimensional EM scoring procedure is robust to multidimensional RG, particularly when the proportion of RG is low.
  • EM scoring offers comparable performance to HG scoring in terms of ability estimation and reliability, even under moderate RG conditions.
  • The findings suggest that EM scoring can be a reliable method for handling RG in educational and psychological assessments.