Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Nursing Clinical Information System01:27

Nursing Clinical Information System

Nursing Clinical Information System (NCIS)
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
Cochran's Q Test01:17

Cochran's Q Test

Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square distribution,...
Health Information Technology and Healthcare Information System01:30

Health Information Technology and Healthcare Information System

Health Information Technology (HIT)
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Multiple Comparison Tests01:13

Multiple Comparison Tests

Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Confirmation Biases01:31

Confirmation Biases

The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Digit ratio (2D:4D) and academic success as measured by achievement in the academic degree "Habilitation".

PloS one·2019
Same author

Effects of conditioned social fear on ethanol drinking and vice-versa in male mice.

Psychopharmacology·2019
Same author

LDL cholesterol relates to depression, its severity, and the prospective course.

Progress in neuro-psychopharmacology & biological psychiatry·2019
Same author

Acid sphingomyelinase controls dopamine activity and responses to appetitive stimuli in mice.

Brain research bulletin·2019
Same author

FDG-PET underscores the key role of the thalamus in frontotemporal lobar degeneration caused by C9ORF72 mutations.

Translational psychiatry·2019
Same author

Mindfulness-based Stress Reduction in Pregnancy: an App-Based Programme to Improve the Health of Mothers and Children (MINDFUL/PMI Study).

Geburtshilfe und Frauenheilkunde·2019
Same journal

The "Twilight Zone" Is a Danger Zone: Why the Occupational-Clinical Divide in Burnout Assessment Is a False Dichotomy.

Evaluation & the health professions·2026
Same journal

Evaluating Equity in AI-Supported Functional Assessment: Agreement Between Clinician Judgment and Digital Metrics in Stroke Rehabilitation.

Evaluation & the health professions·2026
Same journal

Psychometric Properties of the Arabic Version of the PROMIS Sleep Disturbance 8b Short Form Among Nurses.

Evaluation & the health professions·2026
Same journal

Commentary: Systemic Inequities in Japan's Technical Intern Training Program (TITP): Health, Labor, and Legal Vulnerabilities of Foreign Trainees.

Evaluation & the health professions·2026
Same journal

Application of Patient-Reported Outcome Measurements in Traditional Chinese Medicine Clinical Trials for Musculoskeletal Disorders in China: A Registry-Based Analysis.

Evaluation & the health professions·2026
Same journal

Divergent Socioeconomic Pathways to Biologically Uncontrolled Diabetes by Gender: A Bayesian Analysis of NHANES 2021-2023.

Evaluation & the health professions·2026
See all related articles

Related Experiment Video

Updated: Jun 12, 2026

A Computerized Functional Skills Assessment and Training Program Targeting Technology Based Everyday Functional Skills
07:31

A Computerized Functional Skills Assessment and Training Program Targeting Technology Based Everyday Functional Skills

Published on: February 13, 2020

Web-based application to eliminate five contraindicated multiple-choice question practices.

Andreas Brunnquell1, Umüt Degirmenci, Sebastian Kreil

  • 1Department of Psychiatry and Psychotherapy, University Erlangen, Germany.

Evaluation & the Health Professions
|May 21, 2010
PubMed
Summary
This summary is machine-generated.

This study introduces a web application to automatically detect and fix common errors in multiple-choice questions (MCQs), improving the reliability of medical education assessments. The tool identifies 60% of formal didactic flaws, enhancing question quality.

More Related Videos

A Computer-Based Platform for Aiding Clinicians in Eating Disorder Analysis and Diagnosis
04:19

A Computer-Based Platform for Aiding Clinicians in Eating Disorder Analysis and Diagnosis

Published on: May 10, 2022

E-Patient Counseling Trial (E-PACO): Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
06:28

E-Patient Counseling Trial (E-PACO): Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy

Published on: August 1, 2019

Related Experiment Videos

Last Updated: Jun 12, 2026

A Computerized Functional Skills Assessment and Training Program Targeting Technology Based Everyday Functional Skills
07:31

A Computerized Functional Skills Assessment and Training Program Targeting Technology Based Everyday Functional Skills

Published on: February 13, 2020

A Computer-Based Platform for Aiding Clinicians in Eating Disorder Analysis and Diagnosis
04:19

A Computer-Based Platform for Aiding Clinicians in Eating Disorder Analysis and Diagnosis

Published on: May 10, 2022

E-Patient Counseling Trial (E-PACO): Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
06:28

E-Patient Counseling Trial (E-PACO): Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy

Published on: August 1, 2019

Area of Science:

  • Medical Education
  • Educational Technology

Background:

  • Multiple-choice questions (MCQs) are vital for assessing factual knowledge in medical education.
  • Formal errors in MCQs can significantly reduce their validity and reliability.
  • Common flaws include negative stems, unfocused stems, cueing words, and item similarities.

Purpose of the Study:

  • To develop and validate a web application for automatically detecting and eliminating common formal errors in MCQs.
  • To improve the quality and validity of MCQs used in medical education.

Main Methods:

  • Development of a web application utilizing simple string algorithms and dynamic keyword comparisons.
  • The application was designed to identify five frequent MCQ flaws: negative stem, unfocused stem, cueing words, longest item = right item flaw, and stem/item similarities.
  • Validation was performed on approximately 800 continuous medical education (CME) questions.

Main Results:

  • The developed web application successfully detected 60% of all formal didactic errors in the tested MCQ sample.
  • The system demonstrated feasibility in identifying common MCQ flaws through basic string operations.

Conclusions:

  • It is feasible to enhance MCQ quality by implementing web applications that automatically detect common flaws.
  • The developed tool offers a practical solution for improving the validity of medical education assessments.
  • Remaining errors can be addressed through supplementary author guidelines.