Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Surveys

Surveys

Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.

Metacognition

Metacognition

Metacognition is a conscious process where individuals are aware of their cognitive and executive processes, such as planning before solving a problem or self-monitoring during reading. For instance, a writer may need help with composing a piece. The situation involves a writer who is working on a piece of writing, but while doing so, they realize that something is missing. They notice that their characters lack depth or details. This realization occurs because the writer is reflecting on their...

Response Surface Methodology

Response Surface Methodology

Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:

Design Example: Marking Boundaries of a Site Using a Compass

Design Example: Marking Boundaries of a Site Using a Compass

Marking site boundaries using a compass is a precise surveying technique that ensures the accuracy of boundary delineation. The process begins by using provided site details, including the bearings and lengths of each boundary line. The initial step involves calculating latitudes and departures for all sides of the site. This computation verifies that the traverse is free of errors, ensuring a closed and accurate boundary.The process starts at a known point, such as Point A, which is often...

Role of Shaping in Operant Conditioning

Role of Shaping in Operant Conditioning

Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

The line we draw: shifting epistemic regimes of standard setting in health professions education.

Advances in health sciences education : theory and practice·2026

Same author

It is still about validity: On assessment length, burden and culture change.

Medical education·2025

Same author

Promoting best practice in assessment - a professional development initiative for optometry programs.

Clinical & experimental optometry·2025

Same author

When I say … assessment burden.

Medical education·2025

Same author

Perspectivism and Health Professions Assessment.

Academic medicine : journal of the Association of American Medical Colleges·2024

Same author

Diversity Audit of Medical School Examination Questions.

Teaching and learning in medicine·2023

Search research articles

Related Experiment Video

Updated: Jun 30, 2025

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

Twelve tips for developing effective marking schemes for constructed-response examination questions.

Neville G Chiavaroli¹, Jacob Pearce¹

¹Australian Council for Educational Research, Camberwell, Australia.

Medical Teacher

|March 14, 2024

Summary

This summary is machine-generated.

Developing effective marking schemes for constructed-response questions (CRQs) is crucial for summative assessments in professional education. This article provides 12 key principles for designing and implementing robust CRQ marking schemes.

Keywords:

Constructed-response questions levels-based marking schemes rubrics

More Related Videos

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Published on: February 7, 2025

Related Experiment Videos

Last Updated: Jun 30, 2025

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Published on: February 7, 2025

Area of Science:

Medical Education
Health Professions Education
Assessment

Background:

Constructed-response questions (CRQs) are vital for assessing learning objectives and professional competencies.
Existing literature on rubrics primarily focuses on formative classroom use, not summative assessments.
Guidance for developing marking schemes for high-stakes examinations is limited.

Purpose of the Study:

To address the gap in guidance for developing marking schemes for summative assessments.
To provide practical principles for creating effective marking schemes for CRQs.
To support educators in drawing valid inferences about examinee competence.

Main Methods:

Review of educational literature on assessment and rubrics.
Synthesis of practical experience with medical and health professional educators.
Development of 12 key principles for designing and implementing marking schemes.

Main Results:

Identification of 12 actionable principles for effective CRQ marking schemes.
Distinction between principles for formative versus summative assessment marking.
Focus on ensuring validity and appropriate inference of examinee competence.

Conclusions:

Effective marking schemes are essential for valid summative assessments using CRQs.
Specific principles are required for developing marking schemes in high-stakes examination contexts.
The 12 principles offered aim to enhance the design and implementation of CRQ marking schemes in professional education.