Related Experiment Video
Updated: Jul 20, 2026
07:36
Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
Video-based versus written situational judgment tests: a comparison in terms of predictive validity
Filip Lievens1, Paul R Sackett
1Department of Personnel Management and Work and Organizational Psychology, Ghent University, Ghent, Belgium. Filip.Lievens@ugent.be
The Journal of Applied Psychology
|September 7, 2006
Summary
Video-based situational judgment tests (SJTs) show higher predictive validity than written SJTs for interpersonal criteria, despite lower cognitive ability correlation. Format changes require careful consideration and validation.
Area of Science:
- Psychological testing
- Educational assessment
Background:
- Situational judgment tests (SJTs) are used to assess workplace behavior.
- The impact of SJT format (video vs. written) on predictive validity is under-explored.
Purpose of the Study:
- To compare the predictive validity of video-based SJTs versus written SJTs.
- To investigate the influence of SJT format on correlations with cognitive ability and criterion prediction.
Main Methods:
- 1,159 students completed a video-based SJT; 1,750 completed an identical written SJT.
- The study was conducted in a high-stakes testing environment.
- Predictive validity, incremental validity, and face validity were assessed.
Main Results:
- Video-based SJTs showed lower correlation with cognitive ability than written SJTs.
- Video-based SJTs demonstrated higher predictive and incremental validity for interpersonal criteria.
- Applicant reactions were favorable, with no significant difference in face validity between formats.
Conclusions:
- Video-based SJTs may offer advantages in predicting interpersonal criteria.
- Caution is advised when changing SJT formats; validation is crucial.
- The findings have implications for the design and implementation of SJTs in high-stakes settings.
Related Concept Videos
01:29Theory of Attribution II: Kelley's Covariation Theory
Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus: Comparing...
02:55Stereotypes, Prejudice, and Discrimination
Humans are very diverse and although we share many similarities, we also have many differences. The social groups we belong to help form our identities (Tajfel, 1974). These differences may be difficult for some people to reconcile, which may lead to prejudice toward people who are different. Prejudice is a negative attitude and feeling toward an individual based solely on one’s membership in a particular social group (Allport, 1954; Brown, 2010). Prejudice is common against people who are...
01:29Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
01:29Measures of Intelligence
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
02:01Group Design
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...