Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

14.2K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Validation of the Short Form of Korean-Everyday Cognition (K-ECog).

Journal of Korean medical science·2023
Same author

Post-hoc simulation study of computerized adaptive testing for the Korean Medical Licensing Examination.

Journal of educational evaluation for health professions·2018
Same author

Usefulness of the DETECT program for assessing the internal structure of dimensionality in simulated data and results of the Korean nursing licensing examination.

Journal of educational evaluation for health professions·2017
See all related articles

Related Experiment Video

Updated: Feb 24, 2026

Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

6.3K

Overview and current management of computerized adaptive testing in licensing/certification examinations.

Dong Gi Seo1

  • 1Department of Psychology, College of Social Science, Hallym University, Chuncheon, Korea.

Journal of Educational Evaluation for Health Professions
|August 17, 2017
PubMed
Summary
This summary is machine-generated.

Computerized adaptive testing (CAT) offers accurate ability estimations for national licensing exams. This method, based on item response theory, is a viable option for high-stakes assessments.

Keywords:
CertificationComputersEmergency medical techniciansLicensurePsychometrics

More Related Videos

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
A Computerized Functional Skills Assessment and Training Program Targeting Technology Based Everyday Functional Skills
07:31

A Computerized Functional Skills Assessment and Training Program Targeting Technology Based Everyday Functional Skills

Published on: February 13, 2020

7.5K

Related Experiment Videos

Last Updated: Feb 24, 2026

Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

6.3K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
A Computerized Functional Skills Assessment and Training Program Targeting Technology Based Everyday Functional Skills
07:31

A Computerized Functional Skills Assessment and Training Program Targeting Technology Based Everyday Functional Skills

Published on: February 13, 2020

7.5K

Area of Science:

  • Psychometrics
  • Educational Measurement
  • Computerized Adaptive Testing

Background:

  • Computerized adaptive testing (CAT) has been utilized in high-stakes professional examinations since 1994.
  • CAT implementation aims to enhance the precision of ability estimations in medical and health licensing examinations.
  • Item response theory (IRT) underpins most CAT systems, assuming stable examinee and item characteristics.

Purpose of the Study:

  • To outline the implementation process and components of Computerized Adaptive Testing (CAT).
  • To discuss the management aspects and challenges associated with CAT systems.
  • To evaluate the suitability of CAT for national licensing examinations.

Main Methods:

  • The study details a 5-step implementation process for CAT, including feasibility assessment and item bank establishment.
  • Key components of the CAT algorithm are identified: item bank, starting item, item selection rule, scoring procedure, and termination criterion.
  • CAT management strategies such as content balancing, item analysis, and bank updates are described.

Main Results:

  • CAT has been successfully implemented in major U.S. examinations like the NCLEX-RN and NREMT certification.
  • The 5-step implementation framework and 5 core algorithm components provide a structured approach to CAT deployment.
  • Challenges include the costs associated with CAT platform construction and required computer technology.

Conclusions:

  • Computerized adaptive testing (CAT) presents a promising approach for national licensing examinations to achieve more accurate examinee ability estimations.
  • Measurement theory provides a robust foundation for implementing CAT in high-stakes testing environments.
  • CAT's structured methodology and IRT basis support its adoption for standardized assessments.