Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Advances in patient-specific 3D-printed models in temporal bone surgery.

Current opinion in otolaryngology & head and neck surgery·2026

Same author

Consensus on key concepts in audiometry.

Danish medical journal·2026

Same author

Surgeons' perspectives on patient-specific 3D-printed temporal bone models: What do we need?

International journal of pediatric otorhinolaryngology·2026

Same author

National and Individual-Level Economic Burden of Local Corticosteroid Use and Concomitant Use of Multiple Local Corticosteroid Formulations-A Nationwide Cohort Study.

Clinical and experimental allergy : journal of the British Society for Allergy and Clinical Immunology·2026

Same author

Augmented Reality and 3D Printing as an Aid to Surgical Planning in Modern Microtia Reconstruction.

The Journal of craniofacial surgery·2026

Same author

Effect of case-specific 3D-printed models on surgical performance in cadaveric dissection-a randomized controlled trial.

European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery·2026

Search research articles

Related Experiment Video

Updated: Aug 25, 2025

Evaluation of Patients' Posture and Gait Profile After Lumbar Fusion Surgery by Video Rasterstereography and Treadmill Gait Analysis

Published on: March 23, 2019

Are Video Recordings Reliable for Assessing Surgical Performance? A Prospective Reliability Study Using

Andreas Frithioff¹, Martin Frendø, Søren Foghsgaard

¹From the Copenhagen Hearing and Balance Center, Department of Otorhinolaryngology-Head & Neck Surgery and Audiology (A.F., M.F., S.F., M.S., S.A.W.A.), Rigshospitalet, Copenhagen; and Copenhagen Academy for Medical Education and Simulation (CAMES; A.F., M.F., S.A.W.A.), Center for HR & Education, Copenhagen, Denmark.

Simulation in Healthcare : Journal of the Society for Simulation in Healthcare

|October 19, 2022

Summary

This summary is machine-generated.

Video-based and physical surgical skills assessments demonstrate equal reliability. Rater performance was unaffected by assessment modality, suggesting distinct physical or video-based evaluations are optimal.

More Related Videos

Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery

Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery

Published on: August 12, 2021

Author Spotlight: Segmentation and VR for Advanced Neurovascular Interventions

Author Spotlight: Segmentation and VR for Advanced Neurovascular Interventions

Published on: April 5, 2024

Related Experiment Videos

Last Updated: Aug 25, 2025

Evaluation of Patients' Posture and Gait Profile After Lumbar Fusion Surgery by Video Rasterstereography and Treadmill Gait Analysis

Published on: March 23, 2019

Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery

Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery

Published on: August 12, 2021

Author Spotlight: Segmentation and VR for Advanced Neurovascular Interventions

Author Spotlight: Segmentation and VR for Advanced Neurovascular Interventions

Published on: April 5, 2024

Area of Science:

Medical Education
Surgical Training
Assessment Methodology

Background:

Surgical skills assessment is crucial for patient safety.
Video-based assessment offers objective evaluation without physical assessor presence.
Reliability of video-based surgical assessment requires further investigation.

Purpose of the Study:

To compare the reliability of video-based versus physical assessment of surgical skills.
To evaluate performance on 3D-printed models and human cadavers.
To determine optimal rater and performance numbers for reliable assessment.

Main Methods:

Eighteen residents performed mastoidectomies on 3D-printed models and cadavers.
Expert raters evaluated performances physically and via video recordings.
Interrater and intrarater reliability were analyzed using kappa statistics and generalizability theory.

Main Results:

Video-based and physical assessments showed comparable reliability (G coefficient 0.85 vs. 0.80 for models, 0.86 vs. 0.87 for cadavers).
Moderate interrater reliability was observed (mean κ 0.58 for video, 0.60 for physical).
Two raters evaluating two video performances or three raters physically assessing two performances ensured high-stakes reliability for models.

Conclusions:

Video-based and physical assessments are equally reliable for surgical skills evaluation.
Assessment modality should be consistent (either physical or video), not combined.
Rater performance can be influenced by switching between assessment methods.