Jove
Visualize
Contact Us

Related Concept Videos

Multiple Comparison Tests01:13

Multiple Comparison Tests

3.9K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.9K
Reliability and Validity01:29

Reliability and Validity

12.8K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.8K
Self-Report Tests of Personality01:22

Self-Report Tests of Personality

381
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
381
Measures of Intelligence01:29

Measures of Intelligence

7.6K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.6K
Wechsler's Contribution to Measures of Intelligence01:23

Wechsler's Contribution to Measures of Intelligence

1.5K
David Wechsler, a psychologist who worked with World War I veterans, developed a significant IQ test in 1939 called the Wechsler-Bellevue Intelligence Scale. This test was innovative because it combined several subtests that measured both verbal and nonverbal skills, reflecting Wechsler's belief that intelligence is a global capacity involving purposeful action, rational thinking, and effective interaction with the environment. This test later evolved into the Wechsler Adult Intelligence...
1.5K
Strategies for Assessing and Addressing Confounding01:25

Strategies for Assessing and Addressing Confounding

119
Confounding is a critical issue in epidemiological studies, often leading to misleading conclusions about associations between exposures and outcomes. It occurs when the relationship between the exposure and the outcome is mixed with the effects of other factors that influence the outcome. Given that, addressing confounding is of high importance for drawing accurate inferences in research.
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
119

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Implementing Core Entrustable Professional Activities in Emergency Medicine Clerkships: A Psychometric Study of Student Growth.

AEM education and training·2026
Same author

Where Scholarship Falls Short: Assessing Scholarly Productivity in Emergency Medicine Residency Training.

AEM education and training·2026
Same author

Assessing Core Entrustable Professional Activities in the pre-clerkship Phase of Undergraduate Medical Education.

Academic medicine : journal of the Association of American Medical Colleges·2026
Same author

Predictive Validity and Differential Prediction of the MCAT Section Scores for Medical Students' Performance in Preclinical Courses.

Medical science educator·2026
Same author

Assessment of Emergency Medicine Residents' Situational Awareness and Perception of Patient Safety Culture in the Emergency Department.

AEM education and training·2025
Same author

Sex and racial bias in medical student EPA assessments: Findings and hypotheses for bias mitigation targets.

Medical teacher·2025
Same journal

Decision-making in programmatic assessment is only a challenge when we make it one.

Advances in health sciences education : theory and practice·2026
Same journal

Historicizing health professions education research: history as a strategic analytic resource.

Advances in health sciences education : theory and practice·2026
Same journal

Factors influencing workplace collaboration and learning between resident doctors and senior nurses: a scoping review.

Advances in health sciences education : theory and practice·2026
Same journal

Grave lessons: a guide to historiographical research in health professions education.

Advances in health sciences education : theory and practice·2026
Same journal

A scoping review of inquiry in medicine and nursing using Dewey's perspective.

Advances in health sciences education : theory and practice·2026
Same journal

"Teaching is important, but it's not important": a qualitative study of teacher identity among early-career academics in health professions.

Advances in health sciences education : theory and practice·2026
See all related articles
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jul 20, 2025

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

6.9K

Assessing clinical competence: a multitrait-multimethod matrix construct validity study.

Andrea Vallevand1, David E Manthey2, Kim Askew2

  • 1Wake Forest University School of Medicine, Winston-Salem, USA. avalleva@wakehealth.edu.

Advances in Health Sciences Education : Theory and Practice
|August 2, 2023
PubMed
Summary
This summary is machine-generated.

This study applied advanced statistical methods to assess medical students' clinical skills. The multitrait-multimethod matrix analysis demonstrated the validity of these assessments, particularly for professionalism.

Keywords:
Clerkship assessmentClinical coachingClinical competenceConstruct validityMultitrait-Multimethod MatrixReliability and validity

More Related Videos

Multimedia Battery for Assessment of Cognitive and Basic Skills in Mathematics BM-PROMA
10:58

Multimedia Battery for Assessment of Cognitive and Basic Skills in Mathematics BM-PROMA

Published on: August 28, 2021

4.5K
Development of a Virtual Reality Assessment of Everyday Living Skills
10:32

Development of a Virtual Reality Assessment of Everyday Living Skills

Published on: April 23, 2014

18.5K

Related Experiment Videos

Last Updated: Jul 20, 2025

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

6.9K
Multimedia Battery for Assessment of Cognitive and Basic Skills in Mathematics BM-PROMA
10:58

Multimedia Battery for Assessment of Cognitive and Basic Skills in Mathematics BM-PROMA

Published on: August 28, 2021

4.5K
Development of a Virtual Reality Assessment of Everyday Living Skills
10:32

Development of a Virtual Reality Assessment of Everyday Living Skills

Published on: April 23, 2014

18.5K

Area of Science:

  • Medical Education
  • Psychometrics
  • Health Professions Education

Background:

  • Medical education increasingly focuses on clinical competency.
  • Entrustable Professional Activities (EPAs) provide a framework for assessing clinical skills.
  • Current clinical skills assessment methods often lack rigorous validation.

Purpose of the Study:

  • To investigate the construct validity of clinical skills assessments in medical education.
  • To apply the multitrait-multimethod matrix analysis to evaluate multiple assessment methods.
  • To explore the reliability and validity of assessing critical clinical skills.

Main Methods:

  • Operationalized four traits: professionalism, data gathering, data synthesis, and data delivery.
  • Assessed traits using three methods: direct observation, workplace-based evaluations, and objective structured clinical examinations.
  • Employed multitrait-multimethod matrix analysis to intercorrelate traits and methods.

Main Results:

  • Reliability values ranged from adequate to good across assessment methods.
  • Most validity coefficients were statistically significant.
  • Professionalism showed the clearest convergent and divergent validity.
  • A substantial method effect was observed, especially in workplace-based assessments.

Conclusions:

  • The multitrait-multimethod matrix approach is a valuable, underutilized tool for assessing complex constructs like clinical skills in medical education.
  • Findings can inform faculty development to enhance the reliability and validity of clinical assessments.
  • Improved assessment validity is crucial for ensuring clinical competency in medical professionals.