Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Equating and item banking with the Rasch model.

Journal of applied measurement·2002
Same author

Development of a scale for measuring invasive plant environmentalism.

Journal of applied measurement·2002
Same author

Development of a nutrition self-efficacy scale for prospective physicians.

Journal of applied measurement·2002
Same author

Measuring change across multiple occasions using the Rasch Rating Scale Model.

Journal of outcome measurement·1999
Same author

Measuring pretest-posttest change with a Rasch Rating Scale Model.

Journal of outcome measurement·1999
Same author

Radionuclide cycling in terrestrial ecosystems. ORNL-4168.

ORNL. U.S. Atomic Energy Commission·1967

Related Experiment Video

Updated: Jul 17, 2026

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats
08:06

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats

Published on: June 18, 2018

Detecting differential rater functioning over time (DRIFT) using a Rasch multi-faceted rating scale model.

E W Wolfe1, B C Moulder, C M Myford

  • 1Michigan State University, East Lansing 48840, USA. wolfee@msu.edu

Journal of Applied Measurement
|May 16, 2002
PubMed
Summary

This study introduces Differential Rater Functioning Over Time (DRIFT), identifying rater-by-time interactions. Rasch measurement procedures effectively detect DRIFT, classifying raters, especially for primacy, recency, and centrality effects.

More Related Videos

Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

Advancing Dyslexia Assessment in Children Through Computerized Testing
09:00

Advancing Dyslexia Assessment in Children Through Computerized Testing

Published on: August 16, 2024

Related Experiment Videos

Last Updated: Jul 17, 2026

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats
08:06

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats

Published on: June 18, 2018

Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

Advancing Dyslexia Assessment in Children Through Computerized Testing
09:00

Advancing Dyslexia Assessment in Children Through Computerized Testing

Published on: August 16, 2024

Area of Science:

  • Psychometrics
  • Educational Measurement
  • Rater Behavior Analysis

Background:

  • Rater variability is a significant concern in assessment.
  • Rater effects can change over time, impacting data reliability.
  • Existing methods may not fully capture dynamic rater behaviors.

Purpose of the Study:

  • To introduce and define Differential Rater Functioning Over Time (DRIFT).
  • To present Rasch measurement procedures for identifying DRIFT.
  • To evaluate the effectiveness of these procedures in simulated data.

Main Methods:

  • Development of Rasch measurement models to detect rater-by-time interactions.
  • Simulation of rating data with various DRIFT effects (primacy/recency, centrality/extremism, practice/fatigue).
  • Application of proposed procedures to classify aberrant raters.

Main Results:

  • Procedures effectively classified raters for primacy, recency, and differential centrality/extremism with moderate to large effect sizes.
  • Classification accuracy for practice and fatigue effects was lower.
  • Statistical power for practice/fatigue effects was limited, requiring very large effect sizes.

Conclusions:

  • Rasch-based methods can identify specific types of DRIFT, improving rater assessment.
  • The procedures show promise for detecting dynamic rater effects in assessment data.
  • Further research may be needed to enhance detection of practice/fatigue effects.