Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Kendall's Coefficient of Concordance

Kendall's Coefficient of Concordance

Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects or...

Standards of Care II

Standards of Care II

Nurses bear specific legal responsibilities under several federal statutes, including:

Multiple Comparison Tests

Multiple Comparison Tests

Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Repertoire and clinical hierarchy of AR locus alterations in castration-resistant prostate cancer.

Annals of oncology : official journal of the European Society for Medical Oncology·2025

Same author

Abstracts of presentations to the Annual Meetings of the Canadian Society of Colon and Rectal Surgeons Canadian Association of General Surgeons Canadian Association of Thoracic Surgeons: Canadian Surgery Forum, Toronto, Ont., September 6-9, 2007.

Canadian journal of surgery. Journal canadien de chirurgie·2023

Same author

Arterial stiffness for the early prediction of pre-eclampsia compared with blood pressure, uterine artery Doppler and angiogenic biomarkers: a prospective cohort study.

BJOG : an international journal of obstetrics and gynaecology·2023

Same author

Advanced practice physiotherapy care in emergency departments for patients with musculoskeletal disorders: a pragmatic cluster randomized controlled trial and cost analysis.

Trials·2023

Same author

Abstracts of presentations to the Annual Meetings of the Canadian Association of General Surgeons Canadian Association of Thoracic Surgeons Canadian Hepato-Pancreato-Biliary Society Canadian Society of Surgical Oncology Canadian Society of Colon and Rectal Surgeons: Victoria, BC Sept. 10-13, 2009.

Canadian journal of surgery. Journal canadien de chirurgie·2022

Same author

Pulse-shape discrimination against low-energy Ar-39 beta decays in liquid argon with 4.5 tonne-years of DEAP-3600 data.

The European physical journal. C, Particles and fields·2021

Search research articles

Related Experiment Videos

Script concordance testing in continuing professional development: local or international reference panels?

E M Pleguezuelos¹, E Hornos, V Dory

¹PRACTICUM Institute of Applied Research in Health Sciences Education, Madrid, Spain.

Advances in Health Sciences Education : Theory and Practice

|November 30, 2012

Summary

This summary is machine-generated.

Pooling responses from international experts in continuing professional development (CPD) using the Practicum Script Concordance Test (PSCT) maintains high psychometric quality. Composite panels, regardless of size, demonstrate reliable participant ranking for effective professional development assessment.

Related Experiment Videos

Area of Science:

Medical Education
Psychometrics
Continuing Professional Development

Background:

The PRACTICUM Institute offers international online continuing professional development (CPD) programs.
These programs utilize the Practicum Script Concordance Test (PSCT) for self-testing and feedback.
Investigating the psychometric properties of composite panels is crucial for large-scale CPD programs.

Purpose of the Study:

To assess the psychometric consequences of pooling responses from international expert panels.
To evaluate the impact of increasing composite panel size on test psychometrics.
To determine the reliability and validity of using composite panels in CPD assessments.

Main Methods:

97 cardiologists in Mexico completed 62 PSCT cases (305 questions).
A composite panel was formed with experts from Mexico, Argentina, and Brazil (n=28).
Random panels of increasing sizes (5-25) were generated to analyze score reliability, discrimination, and ranking.

Main Results:

High correlation coefficients (0.951-0.981) were observed between local and composite panels.
Cronbach's alpha values exceeded 0.85 for all panels, indicating excellent internal consistency.
Generalizability analysis showed high and stable participant ranking (G coefficient 0.91-0.93), although absolute scores varied with panel size.

Conclusions:

Composite panels composed of carefully selected international experts are suitable for continuing professional development (CPD) environments.
The Practicum Script Concordance Test (PSCT) demonstrates high psychometric quality across various panel sizes.
While participant ranking is stable, absolute score interpretation requires caution due to variations with panel size.