Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Statistical Analysis: Overview

Statistical Analysis: Overview

When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...

Ratio Level of Measurement

Ratio Level of Measurement

The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated. For...

Measures of Central Tendency

Measures of Central Tendency

The "center" of a data set is also a way of describing location. The two most widely used measures of the "center" of the data are the mean (average) and the median. The words "mean" and "average" are often used interchangeably. The substitution of one word for the other is common practice. The technical term is "arithmetic mean" and "average" is technically a center location. However, in practice among non-statisticians, "average" is commonly accepted for "arithmetic mean."

Variability: Analysis

Variability: Analysis

Measures of variability are statistical metrics that reveal the dispersion pattern within a dataset. They are pivotal in biostatistics, providing insights into the heterogeneity within health and biological data. Variability signifies the degree to which data points diverge from one another, helping researchers understand the potential range of values and associated uncertainty within the data.
The range is a simple measure of variability, indicating the difference between the highest and...

Uncertainty in Measurement: Accuracy and Precision

Uncertainty in Measurement: Accuracy and Precision

Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same journal

Psychometric Testing of the Veterans Health Administration Resident Competency Assessment Scale for New Graduate Registered Nurse Competency.

Journal of nursing care quality·2026

Same journal

Blood Culture Contamination Reduction Using a Diversion Device in the Emergency Department.

Journal of nursing care quality·2026

Same journal

C. Differently: A Nurse-Driven Multidisciplinary Initiative to Overcome C. difficile's Challenges for Better Patient Outcomes.

Journal of nursing care quality·2026

Same journal

Enhancing Heart Failure Care Through Community Paramedic Education.

Journal of nursing care quality·2026

Same journal

Fostering Nurse Preceptor Preparedness: A Quality Improvement Project.

Journal of nursing care quality·2026

Same journal

Charting and Predicting Risk: Artificial Intelligence/Machine Learning Pilot Model for Hospital-Acquired Pressure Injuries.

Journal of nursing care quality·2026

Search research articles

Related Experiment Video

Updated: May 19, 2026

Assessment of Child Anthropometry in a Large Epidemiologic Study

Assessment of Child Anthropometry in a Large Epidemiologic Study

Published on: February 2, 2017

Abstraction of core measure data: creating a process for interrater reliability.

Holly A George¹, Shelly L Davis, Cynthia F Mitchell

¹Value Performance, Measurement and Patient Safety Department at Dartmouth-Hitchcock Medical Center, Lebanon, NH, USA. holly.a.george@hitchcock.org

Journal of Nursing Care Quality

|September 6, 2012

Summary

Improving healthcare quality data is crucial. An interrater reliability process for data abstraction using Centers for Medicare and Medicaid Services core measures reduced variability and enhanced data accuracy.

More Related Videos

Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly

Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly

Published on: April 14, 2014

Related Experiment Videos

Last Updated: May 19, 2026

Assessment of Child Anthropometry in a Large Epidemiologic Study

Assessment of Child Anthropometry in a Large Epidemiologic Study

Published on: February 2, 2017

Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly

Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly

Published on: April 14, 2014

Area of Science:

Health Services Research
Quality Improvement Science
Data Management in Healthcare

Background:

Healthcare facilities face increasing pressure for accurate quality data for internal improvements and reimbursement.
Reliable and valid data abstraction is essential for effective healthcare quality initiatives.
Variability in data abstraction can compromise the integrity of quality metrics.

Purpose of the Study:

To describe an interrater reliability process for data abstraction.
To demonstrate the application of this process using Centers for Medicare and Medicaid Services (CMS) core measures.
To show how improved reliability enhances data quality.

Main Methods:

Implemented a structured interrater reliability process for data abstraction.
Utilized Centers for Medicare and Medicaid Services (CMS) core measures as the data source.
Trained abstractors and conducted reliability assessments to measure agreement.

Main Results:

The interrater reliability process successfully reduced variability between data abstractors.
Achieved higher quality data through consistent and validated abstraction methods.
Demonstrated improved agreement among abstractors on CMS core measures.

Conclusions:

An interrater reliability process is effective in improving the quality of healthcare data abstraction.
Standardized data abstraction methods enhance the validity and reliability of quality metrics.
This approach supports better decision-making for healthcare improvement and accurate reimbursement.