Do Hospital Rankings Mislead Patients? Variability Among National Rating Systems for Orthopaedic Surgery
Romil F Shah1, David W Manning, Bennet A Butler
1From the Department of Surgery (Dr. Shah, Dr. Bilimoria), Surgical Outcomes and Quality Improvement Center (SOQIC), Feinberg School of Medicine, Northwestern University, and Department of Orthopaedics (Dr. Shah, Dr. Manning, Dr. Butler), Northwestern University, Chicago, IL.
Introduction:
A growing number of online hospital rating systems for orthopaedic surgery are found. Although the accuracy and consistency of these systems have been questioned in other fields of medicine, no formal analysis of these systems in orthopaedics has been found.
Methods:
Five hospital rating systems (US News, HealthGrades, CareChex, Women's Choice, and Hospital Compare) were examined which designate "high-performing" and "low-performing" hospitals for orthopaedic surgery. Descriptive analysis was conducted for all hospitals defined as high- or low-performing in any of the five rating systems, and assessment for agreement/disagreement between ratings was done. A subsample of hospitals ranked by all systems was then created, and agreement between rating systems was investigated using a Cohen's kappa. Each hospital was included in a multinomial logistic regression model investigating which hospital characteristics increased the odds of being favorably/unfavorably rated by each system.
Results:
One thousand six hundred forty hospitals were evaluated by every rating system. Six hundred thirty-eight unique hospitals were identified as high-performing by at least 1 rating system; however, no hospital was ranked as high-performing by all five rating systems. Four hundred fifty-two unique hospitals were identified as low-performing; however, no hospital was ranked as low-performing by all the three rating systems which define low-performing hospitals. Within the study subsample of hospitals evaluated by each system, little agreement between any combination of rating systems (κ < 0.10) regarding top-tier or bottom-tier performance was found. It was more likely for a hospital to be considered high-performing by one system and low-performing by another (10.66%) than for the majority of the five rating systems to consider a hospital high-performing (3.76%).
Conclusion:
Little agreement between hospital quality rating systems for orthopaedic surgery is found. Publicly available hospital ratings for performance in orthopaedic surgery offer conflicting results and provide little guidance to patients, providers, or payers when selecting a hospital for orthopaedic surgery.
Level Of Evidence:
Level 1 economic study.
Related Concept Videos
00:59Hospitals-II
Nurses that work in...
01:29Issues And Trends In Healthcare Delivery System
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
01:30Health Information Technology and Healthcare Information System
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
01:11Variability: Analysis
The range is a simple measure of variability, indicating the difference between the highest and...
00:55Ordinal Level of Measurement
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...
01:14SBAR II: Application of SBAR
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...