Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Measures of Intelligence

Measures of Intelligence

Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...

Response Surface Methodology

Response Surface Methodology

Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:

Data Validation

Data Validation

Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:

Self-Evaluation Maintenance Model

Self-Evaluation Maintenance Model

The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...

Quality Assurance

Quality Assurance

Quality assurance is the overarching term used to describe the activities employed to ensure the proper performance of a system. These activities can be classified into three categories: quality control, quality assessment, and internal corrective measures. Typically, these activities work cyclically: quality control is performed before and during the analysis, while quality assessment occurs during and after the investigation. Internal corrective measures are implemented based on the findings...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Artificial Intelligence-Powered Simulation for Telehealth Communication Training: Bridging Traditional Simulation and Artificial Intelligence.

Simulation in healthcare : journal of the Society for Simulation in Healthcare·2026

Same author

Combining Systems Thinking and Emotional Intelligence to Navigate Complexity in Simulation Debriefing.

Simulation in healthcare : journal of the Society for Simulation in Healthcare·2026

Same author

From Clinical Learning Environment Comparison Survey (CLECS) 2.0 to 3.0: Evaluating Reliability Characteristics.

Nurse educator·2026

Same author

A scoping review of literature about 3D printing: knowledge, skills and attitude for simulation educators in healthcare.

3D printing in medicine·2025

Same author

Education and Evaluation of Electronic Fetal Monitor Interpretation: A Scoping Review.

MCN. The American journal of maternal child nursing·2025

Same author

Digital recordings of a clinical encounter facilitate reflection in physical therapy students and clinicians.

Frontiers in medicine·2025

Search research articles

Related Experiment Video

Updated: May 17, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Published on: August 29, 2025

A method and resources for assessing the reliability of simulation evaluation instruments.

Katie A Adamson¹, Suzan Kardong-Edgren

¹University of Washington Tacoma Nursing and Healthcare Leadership Program, USA. kadamson@u.washington.edu

Nursing Education Perspectives

|October 16, 2012

Summary

A new method for rapid psychometric assessment of nursing simulation evaluation tools was piloted. This approach uses video-archived simulations and multiple raters to ensure reliable and valid assessments of student performance.

Related Experiment Videos

Last Updated: May 17, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Published on: August 29, 2025

Area of Science:

Nursing Education
Healthcare Simulation
Psychometrics

Background:

Assessing psychometric properties of evaluation instruments is crucial for valid and reliable student performance evaluations in simulation.
Existing methods for psychometric assessment can be time-consuming.

Purpose of the Study:

To describe a successfully piloted method for rapid psychometric assessment of three nursing simulation evaluation instruments.
To provide a framework for researchers and educators to assess their own simulation evaluation tools.

Main Methods:

A novel method utilizing a database of validated, video-archived simulations depicting varying levels of nursing student proficiency.
A sample of 29 raters viewed and scored multiple scenarios over six weeks.
Analyses included inter- and intrarater reliability, internal consistency, and validity.

Main Results:

Descriptive and inferential statistics confirmed the validity of the leveled scenarios.
Inter- and intrarater reliability and internal consistencies were determined for the Lasater Clinical Judgment Rubric, Seattle University Evaluation Tool, and Creighton-Simulation Evaluation Instrument.
The study provides data supporting the psychometric properties of the evaluated instruments.

Conclusions:

The piloted method facilitates rapid psychometric assessment of simulation evaluation instruments.
The findings support the validity and reliability of the leveled simulation scenarios.
Resources are provided for readers to assess their own simulation evaluation instruments.