Related Experiment Video
Updated: Jan 28, 2026

Assessment of Mouse Judgment Bias through an Olfactory Digging Task
Published on: March 4, 2022
Quantifying Item Invariance for the Selection of the Least Biased Assessment
W Holmes Finch1, Brian F French, Maria E Hernandez Finch
1W. Holmes Finch, Department of Educational Psychology, Ball State University, Muncie, IN 47306, USA, whfinch@bsu.edu.
Abstract:
An important aspect of educational and psychological measurement and evaluation of individuals is the selection of scales with appropriate evidence of reliability and validity for inferences and uses of the scores for the population of interest. One aspect of validity is the degree to which a scale fairly assesses the construct(s) of interest for members of different subgroups within the population. Typically, this issue is addressed statistically through assessment of differential item functioning (DIF) of individual items, or differential bundle functioning (DBF) of sets of items. When selecting an assessment to use for a given application (e.g., measuring intelligence), or which form of an assessment to use in a given instance, researchers need to consider the extent to which the scales work with all members of the population. Little research has examined methods for comparing the amount or magnitude of DIF/DBF present in two assessments when deciding which assessment to use. The current simulation study examines 6 different statistics for this purpose. Results show that a method based on the random effects item response theory model may be optimal for instrument comparisons, particularly when the assessments being compared are not of the same length.
Related Concept Videos
Confirmation Biases
Hindsight Biases
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Linear time-invariant Systems
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
Correspondence Bias
Self-Serving Bias

