Rating Spine Surgeons: Physician Review Websites Versus a Patient-reported Outcomes-derived Ranking

This was an observational study.

This study aims to determine the correlation between patient-reported outcomes (PROs) pulled from a national spine registry and physician ratings from physician review websites (PRWs).

PRWs are frequently utilized by patients to make health care decisions; however, many PRWs appear to incorporate subjective experiences unrelated to a surgeon's clinical performance into ratings. As such, their utility as a health care decision-making tool remains unclear.

This study evaluated 8834 patients from the Quality Outcomes Database (QOD) who underwent 1-level elective lumbar spine surgery. The lumbar module of QOD was queried to rank 124 surgeons using PROs (Oswestry Disability Index, EuroQOL, Numerical Rating Scale-back/leg pain, and patient satisfaction). The QOD PRO-ranking system was compared against PRWs including Healthgrades, Vitals, WebMD, and Google. The Spearman correlation coefficients, Kruskal-Wallis tests, and multiple linear regression models were used for statistical comparison. The primary outcome was the correlation between PRW scores and PROs.

Surgeon PRO-derived ranking showed high intercorrelational congruence with coefficients between the 3 PROs (Oswestry Disability Index, EuroQOL, Numerical Rating Scale back/leg) ranging between 0.70 and 0.88. Low correlations were observed between PRO-derived rankings and PRWs, ranging from 0.23 to 0.37. Healthgrades performed most similarly to PRO-derived rankings, correlating best with patient satisfaction, though the correlation was low (ρ=0.37).

While PRWs are often used to evaluate surgeon competency, these results demonstrate they poorly correlate with a surgeon's clinical ability measured by PROs. PRWs should be used with caution when making health care decisions by patients, payers, and administrators.

Level III.