Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Theory of Attribution II: Kelley's Covariation Theory

Theory of Attribution II: Kelley's Covariation Theory

Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus: Comparing...

Lazarus's Cognitive Appraisal Theory

Lazarus's Cognitive Appraisal Theory

Cognitive psychologist Richard Lazarus proposed the cognitive-mediational theory of emotions, which emphasizes how individuals' assessments of stressors significantly affect their experience of stress. According to Lazarus, the stress response is determined by a two-step appraisal process: primary appraisal and secondary appraisal. These cognitive appraisals help individuals evaluate the potential impact of a stressor and determine the adequacy of their coping resources.
Primary Appraisal:...

Data Validation

Data Validation

Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...

Revisionist Views of Adolescent and Adult Cognition

Revisionist Views of Adolescent and Adult Cognition

A revisionist approach to Jean Piaget's theory of cognitive development has brought new insights that challenge and reinterpret his established ideas. Piaget proposed that the formal operational stage, emerging in adolescence, represents the culmination of cognitive maturity. During this stage, individuals are said to develop abstract thinking, engage in systematic problem-solving, and show a form of egocentrism, believing others are as preoccupied with their behavior as they are themselves.

Naturalistic Observations

Naturalistic Observations

If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Longitudinal integrated clerkships: a hermeneutic literature review.

Advances in health sciences education : theory and practice·2026

Same author

Creating a centre of excellence in rural health care: strategy, tactics and initial outcomes of the Riverland Academy of Clinical Excellence.

Rural and remote health·2025

Same author

Computer Adaptive vs. Non-adaptive Medical Progress Testing: Feasibility, Test Performance, and Student Experiences.

Perspectives on medical education·2024

Same author

Composite Reliability of Workplace Based Assessment of International Medical Graduates.

MedEdPublish (2016)·2024

Same author

Studies on Reliability and Measurement Error of Measurements in Medicine - From Design to Statistics Explained for Medical Researchers.

Patient related outcome measures·2023

Same author

Using Resident-Sensitive Quality Measures Derived From Electronic Health Record Data to Assess Residents' Performance in Pediatric Emergency Medicine.

Academic medicine : journal of the Association of American Medical Colleges·2022

Search research articles

Related Experiment Video

Updated: May 26, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Published on: August 29, 2025

Programmatic assessment and Kane's validity perspective.

Lambert W T Schuwirth¹, Cees P M van der Vleuten

¹Flinders Innovation in Clinical Education, Flinders University, South Australia, Australia. Lambert.schuwirth@flinders.edu.au

Medical Education

|December 14, 2011

Summary

Programmatic assessment leverages multiple instruments, not just standard psychometric methods, to enhance validity. Kane's framework guides the integration of diverse arguments for robust assessment programs.

Related Experiment Videos

Last Updated: May 26, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Published on: August 29, 2025

Area of Science:

Educational Measurement
Assessment Theory
Psychometrics

Background:

Programmatic assessment integrates various instruments, acknowledging that no single tool is universally superior.
Traditional psychometric methods often employ a one-size-fits-all approach, potentially overlooking the nuances of different assessment needs.
Kane's validity theory offers a framework to appreciate diverse assessment strategies.

Purpose of the Study:

To explore the application of Kane's validity theory to programmatic assessment.
To illustrate how different arguments and methods can strengthen validity inferences in assessment.
To highlight the value of varied approaches beyond standard psychometrics within an assessment program.

Main Methods:

Discussion of four key inferences within Kane's validity theory: observation-to-score, score-to-universe score, universe score-to-target domain, and target domain-to-construct.
Providing examples and descriptions of approaches supporting each validity inference.
Examining the role of various arguments and methods in bolstering assessment validity.

Main Results:

Standard psychometric methods are complemented by a range of other arguments in programmatic assessment.
Specific methods discussed include item review, quality control, examiner training, probabilistic and saturation approaches, and judgment processes.
Epidemiological methods such as collation, triangulation, and member-checking are also valuable components.

Conclusions:

Programmatic assessment benefits from a combination of standard psychometric techniques and diverse supporting arguments.
The integration of various methods enhances the overall quality and validity of assessment procedures.
Kane's framework provides a valuable structure for understanding and implementing these multifaceted assessment strategies.