Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Uncertainty in Measurement: Accuracy and Precision03:37

Uncertainty in Measurement: Accuracy and Precision

73.6K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value. 
73.6K
Systematic Error: Methodological and Sampling Errors01:15

Systematic Error: Methodological and Sampling Errors

1.4K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
1.4K
Random and Systematic Errors01:20

Random and Systematic Errors

10.9K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
10.9K
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

6.3K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.3K
Naturalistic Observations02:30

Naturalistic Observations

15.4K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The Association Between Number of Hospital Advanced Practice Providers and Surgical Morbidity.

Cancer medicine·2026
Same author

Long-Term Storage of Formalin-Fixed Paraffin-Embedded Tissues Negatively Impacts Next-Generation Sequencing: Successful Restoration with a DNA Repair Enzyme.

Clinical chemistry·2026
Same author

Incorporating external risk information with the Cox model under population heterogeneity: applications to trans-ancestry polygenic hazard scores.

Journal of the Royal Statistical Society. Series A, (Statistics in Society)·2026
Same author

Recruitment Mode Selectivity and Interview Mode Measurement Effects in a Population-Based Assessment of Cognitive Performance.

International journal of methods in psychiatric research·2026
Same author

Factors Underlying Stroke Recovery Variation by Neighborhood Socioeconomic Status.

JAMA network open·2026
Same author

Private equity acquisitions and cancer care: nothing to see here? Not so fast.

Journal of the National Cancer Institute·2026

Related Experiment Video

Updated: Jun 16, 2025

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow
09:18

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Published on: December 15, 2023

2.7K

Limitations of the Inter-Unit Reliability: A Set of Practical Examples.

Nicholas Hartman1,2, Vahakn B Shahinian2,3, Valarie B Ashby1,2

  • 1Department of Biostatistics, University of Michigan, Ann Arbor, MI, U.S.A.

Health Services & Outcomes Research Methodology
|August 15, 2024
PubMed
Summary

Inter-Unit Reliability (IUR) may underestimate healthcare quality variation. Best practices in measure development can lower IUR, potentially leading to the unjustified discarding of valuable quality measures.

Keywords:
Healthcare Quality MeasuresProvider ProfilingQuality of CareReliabilityRisk Adjustment

More Related Videos

Assessment of Child Anthropometry in a Large Epidemiologic Study
09:36

Assessment of Child Anthropometry in a Large Epidemiologic Study

Published on: February 2, 2017

27.0K
Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

7.4K

Related Experiment Videos

Last Updated: Jun 16, 2025

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow
09:18

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Published on: December 15, 2023

2.7K
Assessment of Child Anthropometry in a Large Epidemiologic Study
09:36

Assessment of Child Anthropometry in a Large Epidemiologic Study

Published on: February 2, 2017

27.0K
Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

7.4K

Area of Science:

  • Health Services Research
  • Quality Improvement
  • Biostatistics

Background:

  • Healthcare quality measures are vital for evaluating provider performance.
  • Assessing measure reliability is crucial before clinical implementation.
  • Inter-Unit Reliability (IUR) is a common statistic for assessing reliability.

Purpose of the Study:

  • To illustrate the practical implications of a limitation in the Inter-Unit Reliability (IUR) statistic.
  • To demonstrate how certain measure development practices can affect IUR values.
  • To highlight potential negative consequences of using arbitrary IUR thresholds.

Main Methods:

  • Illustrative examples to demonstrate the practical implications of IUR limitations.
  • Analysis of how risk adjustment and exclusion of unstable values impact IUR.
  • Discussion of the consequences of discarding measures based on IUR thresholds.

Main Results:

  • The Inter-Unit Reliability (IUR) may include variation unrelated to actual healthcare quality.
  • Best practices like risk adjustment and exclusion of unstable data can decrease the sample IUR.
  • This suggests that seemingly low IUR values do not always indicate poor reliability.

Conclusions:

  • The IUR statistic has a severe limitation where between-provider variation may not reflect quality of care.
  • Standard measure development practices can inadvertently reduce IUR.
  • Discarding measures solely based on low IUR values may lead to the loss of useful quality indicators.