Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Data Validation01:03

Data Validation

6.0K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
6.0K
Reliability and Validity01:29

Reliability and Validity

13.3K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.3K
Self-Evaluation Maintenance Model01:29

Self-Evaluation Maintenance Model

81
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
81

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Patients' Voices and the Assessment of Medical Trainees: A Discourse Analysis.

Perspectives on medical education·2026
Same author

Building CAR-E: A Novel Artificial Intelligence Agent for Coaching Conversations.

Perspectives on medical education·2026
Same author

The Implementation of Competency-Based Medical Education in Surgical Training: A Scoping Review.

Journal of surgical education·2026
Same author

Investigating a Model to Predict Milestones From Entrustable Professional Activity Levels for Medicine-Pediatrics Residents.

Academic pediatrics·2026
Same author

Getting Real(ist) With Program Evaluation.

Hospital pediatrics·2026
Same author

CBME As a Philosophy of Training: Balancing Fidelity and Flexibility in Emergency Medicine.

AEM education and training·2026

Related Experiment Video

Updated: Oct 31, 2025

Development of a Virtual Reality Assessment of Everyday Living Skills
10:32

Development of a Virtual Reality Assessment of Everyday Living Skills

Published on: April 23, 2014

18.7K

Constructing a Validity Map for a Workplace-Based Assessment System: Cross-Walking Messick and Kane.

Benjamin Kinnear1, Matthew Kelleher2, Brian May3

  • 1B. Kinnear is associate professor of internal medicine and pediatrics, Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio; ORCID: https://orcid.org/0000-0003-0052-4130 .

Academic Medicine : Journal of the Association of American Medical Colleges
|June 29, 2021
PubMed
Summary
This summary is machine-generated.

This study introduces a validity map for workplace-based assessment (WBA) in health professions education. It uses a rhetorical approach to organize evidence for summative decisions, improving the evaluation of competency-based programs.

More Related Videos

The Ladder Rung Walking Task: A Scoring System and its Practical Application.
09:38

The Ladder Rung Walking Task: A Scoring System and its Practical Application.

Published on: June 12, 2009

26.3K
Practical Methodology of Cognitive Tasks Within a Navigational Assessment
05:19

Practical Methodology of Cognitive Tasks Within a Navigational Assessment

Published on: June 1, 2015

13.8K

Related Experiment Videos

Last Updated: Oct 31, 2025

Development of a Virtual Reality Assessment of Everyday Living Skills
10:32

Development of a Virtual Reality Assessment of Everyday Living Skills

Published on: April 23, 2014

18.7K
The Ladder Rung Walking Task: A Scoring System and its Practical Application.
09:38

The Ladder Rung Walking Task: A Scoring System and its Practical Application.

Published on: June 12, 2009

26.3K
Practical Methodology of Cognitive Tasks Within a Navigational Assessment
05:19

Practical Methodology of Cognitive Tasks Within a Navigational Assessment

Published on: June 1, 2015

13.8K

Area of Science:

  • Medical Education
  • Assessment and Evaluation
  • Health Professions Education

Background:

  • Competency-based education in health professions relies on workplace-based assessment (WBA) for summative decisions.
  • WBAs require robust validity evidence beyond traditional psychometric analysis.
  • Existing validity frameworks can be complex to apply to WBA systems.

Purpose of the Study:

  • To develop a structured method for mapping validity evidence for summative decisions in entrustment-based WBA systems.
  • To enhance the rigor and transparency of validity arguments for WBAs.
  • To address the complexity of WBA validity by integrating established frameworks.

Main Methods:

  • A rhetorical argumentation process was employed to create a validity map.
  • Two validity frameworks (Messick's sources and Kane's inferences) were cross-walked.
  • A four-step iterative process involved critical questioning, evidence seeking, categorization, and visual representation.

Main Results:

  • The developed validity map visually organizes evidence across Messick's sources and Kane's inferences.
  • The rhetorical question-response process facilitated a structured critical appraisal of the WBA system.
  • The process successfully identified gaps in the existing evidence base for WBAs.

Conclusions:

  • The validity map provides a systematic approach to organizing and appraising evidence for WBA systems.
  • This method enhances the validity argument for summative decisions in competency-based health professions education.
  • Future iterations aim to incorporate evidence quality and stakeholder feedback for broader applicability.