Related Experiment Video
Updated: May 10, 2026
07:57
Accuracy in Dental Medicine, A New Way to Measure Trueness and Precision
Published on: April 29, 2014
How to report reliability in orthodontic research: Part 1
Richard E Donatelli1, Shin-Jae Lee
1Department of Orthodontics, College of Dentistry, University of Florida, Gainesville, FL, USA.
Summary
Reliability testing in research often uses inappropriate statistical methods like paired t tests. This article highlights issues and promotes better reporting, including the Bland-Altman plot for observer agreement.
Area of Science:
- Statistics in Medical Research
- Orthodontic Research Methodology
Background:
- Duplicate measurements are crucial for assessing interobserver and intraobserver agreement in research.
- Inappropriate statistical analyses, such as paired t tests and correlation coefficients, are frequently used for reliability testing.
- This leads to flawed interpretations of measurement consistency.
Discussion:
- Paired t tests and correlation coefficients are statistically problematic for evaluating reliability.
- These methods do not adequately assess agreement between repeated measurements.
- Misapplication can lead to incorrect conclusions about measurement precision.
Key Insights:
- Reliability assessment requires appropriate statistical techniques beyond simple paired tests or correlations.
- The Bland-Altman plot offers a superior graphical method for evaluating both intra- and interobserver reliability.
- Accurate reliability reporting is essential for the validity of research findings, particularly in orthodontics.
Outlook:
- Encouraging the adoption of robust statistical methods for reliability testing in orthodontic research.
- Promoting the use of graphical techniques like Bland-Altman plots for clearer visualization of agreement.
- Improving the overall quality and interpretability of reliability data in scientific publications.
Related Concept Videos
01:29Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
01:21Types of Reports II: Incident or Occurrence Report
An Incident or Occurrence Report in a healthcare setting is a crucial document used to record any unexpected occurrence that may or may not have affected a patient, employee, or visitor. Such reports are critical to improving patient safety and include all details leading up to and including the event.
Purposes:
In the healthcare industry, reports play a crucial role in documenting incidents within an agency. The primary objective of these reports is to ensure patient safety, uphold the...
Purposes:
In the healthcare industry, reports play a crucial role in documenting incidents within an agency. The primary objective of these reports is to ensure patient safety, uphold the...
01:26Types of Reports III: Telephone and Verbal Reports
Telephone and Verbal Reports in healthcare settings are two communication methods for conveying therapeutic instructions from healthcare providers to nurses or other healthcare staff.
Here's an overview of each type:
Telephone Orders
Here's an overview of each type:
Telephone Orders