Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Setting standards on educational tests.

John J Norcini1

  • 1Foundation for Advancement of International Medical Education and Research (FAIMER), Philadelphia, Pennsylvania, USA. jnorcini@ecfmg.org

Medical Education
|April 24, 2003
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Excess Mortality Among US Physicians During the COVID-19 Pandemic.

JAMA internal medicine·2023
Same author

Associations between initial American Board of Internal Medicine certification and maintenance of certification status of attending physicians and in-hospital mortality of patients with acute myocardial infarction or congestive heart failure: a retrospective cohort study of hospitalisations in Pennsylvania, USA.

BMJ open·2022
Same author

We Must Graduate Physicians, Not Doctors.

Academic medicine : journal of the Association of American Medical Colleges·2019
Same author

Pathways to Independent Primary Care Clinical Practice: How Tall Is the Shortest Giant?

Academic medicine : journal of the Association of American Medical Colleges·2019
Same author

Interprofessional communication in a socio-hierarchical culture: development of the TRI-O guide.

Journal of multidisciplinary healthcare·2019
Same author

Assessing clinical reasoning skills using Script Concordance Test (SCT) and extended matching questions (EMQs): A pilot for urology trainees.

Journal of advances in medical education & professionalism·2019
Same journal

Channelling Socrates to re-imagine asynchronous online learning.

Medical education·2026
Same journal

Moving beyond tokenism: A structured and intentional approach to embedding health advocacy in medical education.

Medical education·2026
Same journal

When I say … 'in situ simulation'.

Medical education·2026
Same journal

Examiner training and calibration for simulated clinical examinations: A scoping review.

Medical education·2026
Same journal

When systems set the limits of supervision.

Medical education·2026
Same journal

From psychometrics to partnerships: Broadening what counts as validity evidence.

Medical education·2026
See all related articles

Setting professional assessment standards involves defining score boundaries for competence. Key methods focus on expert judgment, data, and transparency to ensure credible results and stakeholder trust.

Area of Science:

  • Educational Measurement and Assessment
  • Professional Standards Development

Background:

  • Professional assessment is crucial for evaluating competence.
  • Establishing clear performance benchmarks is essential for fair evaluation.

Purpose of the Study:

  • To introduce methods for setting standards in professional assessments.
  • To provide an overview of practical steps and popular techniques for standard setting.

Main Methods:

  • Defining the role of a standard as a performance boundary.
  • Outlining practical steps: type of standard, method selection, judge selection, meetings, cutpoint calculation.
  • Illustrating four popular standard-setting methods for written and clinical examinations.

Main Results:

Related Experiment Videos

  • Key criteria for method selection include test purpose alignment, expert judgment, data-informed decisions, research support, transparency, and due diligence.
  • Standard credibility hinges on the expertise and representativeness of the standard setters.
  • Post-standard setting requires ensuring stakeholder credibility and sensible pass rates relative to other competence markers.

Conclusions:

  • Standards reflect professional values within the context of test purpose, content, examinee ability, and the educational setting.
  • Standard-setting methods systematically aggregate value judgments to establish consensus scores.