Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Surveys

Surveys

Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.

Multiple Comparison Tests

Multiple Comparison Tests

Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...

Group Design

Group Design

The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...

Strategies for Assessing and Addressing Confounding

Strategies for Assessing and Addressing Confounding

Confounding is a critical issue in epidemiological studies, often leading to misleading conclusions about associations between exposures and outcomes. It occurs when the relationship between the exposure and the outcome is mixed with the effects of other factors that influence the outcome. Given that, addressing confounding is of high importance for drawing accurate inferences in research.
Confounding can be addressed at both the design phase of a study and through analytical methods after data...

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Cochran's Q Test

Cochran's Q Test

Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square distribution,...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Genomic, Proteomic, and Phenotypic Spectrum of Novel O-Sialoglycoprotein Endopeptidase Variant in Four Affected Individuals With Galloway-Mowat Syndrome.

Frontiers in genetics·2022

Same author

Exome Sequencing Reveals Novel <i>TTN</i> Variants in Saudi Patients with Congenital Titinopathies.

Genetic testing and molecular biomarkers·2021

Same author

Progressive Multifocal Leukoencephalopathy in the Absence of Typical Radiological Changes: Can We Make a Diagnosis?

The American journal of case reports·2019

Same author

Quality assessment of recent evidence-based clinical practice guidelines for management of type 2 diabetes mellitus in adults using the AGREE II instrument.

Journal of evaluation in clinical practice·2017

Same author

Biallelic mutations in human DCC cause developmental split-brain syndrome.

Nature genetics·2017

Same author

Microbiology and antimicrobials sensitivity of supprative otitis media.

Saudi medical journal·2016

Search research articles

Related Experiment Video

Updated: Jun 4, 2026

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

A practical discussion to avoid common pitfalls when constructing multiple choice questions items.

Eiad A Al-Faris¹, Ibrahim A Alorainy, Ahmad A Abdel-Hameed

¹Department of Family and Community Medicine, College of Medicine, King Saud University, Riyadh, Kingdom of Saudi Arabia.

Journal of Family & Community Medicine

|March 2, 2011

Summary

This guide helps improve Multiple Choice Questions (MCQs) for better assessments. Avoiding common flaws in MCQs enhances their quality and reliability in educational testing.

Keywords:

Pitfalls assessment student

More Related Videos

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

Combining Computer Game-Based Behavioural Experiments With High-Density EEG and Infrared Gaze Tracking

Combining Computer Game-Based Behavioural Experiments With High-Density EEG and Infrared Gaze Tracking

Published on: December 16, 2010

Related Experiment Videos

Last Updated: Jun 4, 2026

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

Combining Computer Game-Based Behavioural Experiments With High-Density EEG and Infrared Gaze Tracking

Combining Computer Game-Based Behavioural Experiments With High-Density EEG and Infrared Gaze Tracking

Published on: December 16, 2010

Area of Science:

Educational Assessment
Psychometrics

Background:

Multiple Choice Questions (MCQs) are a globally prevalent assessment tool.
High-quality MCQs offer reliable measurement per testing hour.
Item flaws can compromise the validity of MCQ assessments.

Purpose of the Study:

To provide a guide for enhancing the quality of MCQs in higher education.
To address common technical flaws in MCQ construction.
To improve the validity and reliability of educational assessments.

Main Methods:

Identification and categorization of technical item flaws in MCQs.
Discussion of flaws related to testwiseness and irrelevant difficulty.
Inclusion of examples and self-assessment exercises for clarity.

Main Results:

Technical item flaws are classified into testwiseness and irrelevant difficulty.
Understanding and avoiding these flaws is crucial for valid MCQ assessment.
The guide offers practical strategies for constructing better MCQs.

Conclusions:

Improving MCQ quality through flaw avoidance enhances assessment validity.
Well-constructed MCQs are essential for accurate evaluation in education.
This resource aims to make MCQ assessment more effective and learner-friendly.