Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Measures of Intelligence01:29

Measures of Intelligence

7.8K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.8K
Reliability and Validity01:29

Reliability and Validity

13.2K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.2K
Self-Report Tests of Personality01:22

Self-Report Tests of Personality

454
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
454
Binet's Contribution to Measures of Intelligence01:23

Binet's Contribution to Measures of Intelligence

1.4K
Alfred Binet, along with his student Théophile Simon, was tasked by the French Ministry of Education in 1904 to create a method for identifying students who struggled to learn through conventional classroom instruction. This initiative aimed to address overcrowding by placing such students in specialized schools. Binet and Simon developed an intelligence test comprising 30 tasks, ranging from simple commands, like touching one's nose or ear, to more complex tasks, such as drawing...
1.4K
Wechsler's Contribution to Measures of Intelligence01:23

Wechsler's Contribution to Measures of Intelligence

1.6K
David Wechsler, a psychologist who worked with World War I veterans, developed a significant IQ test in 1939 called the Wechsler-Bellevue Intelligence Scale. This test was innovative because it combined several subtests that measured both verbal and nonverbal skills, reflecting Wechsler's belief that intelligence is a global capacity involving purposeful action, rational thinking, and effective interaction with the environment. This test later evolved into the Wechsler Adult Intelligence...
1.6K
Cognitive Dissonance01:38

Cognitive Dissonance

33.6K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
33.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Action video game playing impacts occupational screening for high-stakes professionals.

Communications psychology·2026
Same author

A comprehensive psychometrics of cognitive ability measures: Reliability, practice effects, and the stability of latent factor structures across retesting.

Behavior research methods·2026
Same author

High-stakes psychomotor ability assessment: a military selection case study of practice effects in airplane tracking tasks.

Cognitive research: principles and implications·2025
Same author

Investigating Transfer of Input Device Practice on Psychomotor Performance in an Aviation Selection Test.

Human factors·2025
Same author

Limitations of current spatial ability testing for military aviators.

Military psychology : the official journal of the Division of Military Psychology, American Psychological Association·2024
Same author

Scan-based eye tracking measures are predictive of workload transition performance.

Applied ergonomics·2022
Same journal

Self-face recognition under self-implicating threat: preserved self-prioritization and recalibrated control dynamics.

Cognitive research: principles and implications·2026
Same journal

Out of sight, out of mind? How discarded items shape environmental judgments.

Cognitive research: principles and implications·2026
Same journal

Implicit learning of social information in contextual cueing.

Cognitive research: principles and implications·2026
Same journal

A downside of conceptual metaphor: metaphoric alignments of black and white.

Cognitive research: principles and implications·2026
Same journal

Visual attention in bilingual instructional videos: effects of audiovisual congruency and subtitle language.

Cognitive research: principles and implications·2026
Same journal

Predicting accuracy in eyewitness showups: confidence and response time in the laboratory, confidence in the field.

Cognitive research: principles and implications·2026
See all related articles

Related Experiment Video

Updated: Sep 10, 2025

Eye Tracking During A Complex Aviation Task For Insights Into Information Processing
07:48

Eye Tracking During A Complex Aviation Task For Insights Into Information Processing

Published on: April 4, 2025

569

Process-based measures in high-stakes testing: practical implications for construct validity within military aviation

Joseph T Coyne1, Laura Jamison2, Kaylin Strong3

  • 1Informaiton Technology Division, Naval Research Laboratory, Washington, DC, USA. joseph.t.coyne4.civ@us.navy.mil.

Cognitive Research: Principles and Implications
|August 19, 2025
PubMed
Summary
This summary is machine-generated.

Familiarity with high-stakes pilot selection tests, like spatial ability and attention measures, can reduce their effectiveness. Practice negates novelty, impacting construct measurement and training prediction.

More Related Videos

Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator
03:49

Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator

Published on: May 19, 2023

1.1K
Collecting Sleep, Circadian, Fatigue, and Performance Data in Complex Operational Environments
08:36

Collecting Sleep, Circadian, Fatigue, and Performance Data in Complex Operational Environments

Published on: August 8, 2019

12.1K

Related Experiment Videos

Last Updated: Sep 10, 2025

Eye Tracking During A Complex Aviation Task For Insights Into Information Processing
07:48

Eye Tracking During A Complex Aviation Task For Insights Into Information Processing

Published on: April 4, 2025

569
Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator
03:49

Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator

Published on: May 19, 2023

1.1K
Collecting Sleep, Circadian, Fatigue, and Performance Data in Complex Operational Environments
08:36

Collecting Sleep, Circadian, Fatigue, and Performance Data in Complex Operational Environments

Published on: August 8, 2019

12.1K

Area of Science:

  • Cognitive Psychology
  • Human Factors Engineering
  • Psychometric Testing

Background:

  • Process-based measures in high-stakes testing rely on task novelty.
  • Pilot selection batteries face challenges from applicant practice and test replication.
  • Applicant motivation and access to unofficial test preparation software impact measure validity.

Purpose of the Study:

  • To compare process-based spatial ability and attention measures in a high-stakes military pilot selection battery with lab-based measures.
  • To investigate the impact of practice and familiarity on the validity of these measures.
  • To assess the predictive power of high-stakes measures for flight training outcomes.

Main Methods:

  • 307 Naval Flight Students completed spatial ability, attention, and general processing measures.
  • One spatial task was identical to the Navy's pilot selection battery task.
  • Lab-based and high-stakes versions of tests were administered and correlated with training outcomes.

Main Results:

  • Lab spatial ability measures were highly correlated, but the high-stakes version was not correlated with lab measures.
  • High-stakes spatial and attention measures did not correlate with training outcomes, unlike lab measures.
  • Familiarity and practice in the high-stakes environment appear to diminish the tests' ability to measure constructs and predict performance.

Conclusions:

  • Practice and familiarity with high-stakes process-based measures can invalidate their intended construct measurement.
  • High-stakes measures may lose predictive validity for training outcomes due to practice effects.
  • Test developers must account for applicant practice in high-stakes environments, especially for novelty-dependent measures.