Validating Reports of Chronic Conditions in the Medicare CAHPS Survey
Matthew W Brault1,2, Bruce E Landon1,3, Alan M Zaslavsky1
1Department of Health Care Policy, Harvard Medical School, Boston.
Insights
The Medicare CAHPS survey
Area of Science:
- Health Services Research
- Medical Informatics
- Patient-Reported Outcomes
Background:
- The Medicare Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey collects data on patient-reported health history and chronic conditions.
- Concerns exist regarding the agreement between patient self-reports and administrative data for health history information.
Purpose of the Study:
- To validate CAHPS measures of chronic conditions by comparing them with claims-based data from the Medicare Chronic Conditions Warehouse (CCW).
Main Methods:
- Linked CAHPS survey responses (2010-2012) from 301,050 fee-for-service Medicare beneficiaries with their claims data in the CCW.
- Identified equivalent condition measures across both data sources.
- Calculated sensitivity and specificity for CAHPS condition measures and used regression models to analyze patient characteristic effects on sensitivity.
Main Results:
- CAHPS measures showed varying sensitivity for different conditions, ranging from 0.513 for stroke to 0.773 for cancer.
- Sensitivity was lower in older beneficiaries, those reporting good self-rated health, and those with fair/poor mental health.
- Specificity was high across all conditions (≥0.904), reaching 0.961 for stroke.
Conclusions:
- Despite differences in data definitions and timeframes, CAHPS measures demonstrated reasonable validity for chronic conditions.
- Observed variations in sensitivity are likely related to patient characteristics influencing health severity or proxy indicators of illness severity.
Background:
The Medicare Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey includes items about chronic conditions, health history, and self-rated health. Questions remain about the concordance between patient reports and administrative sources on questions related to health history.
Objective:
To validate CAHPS measures of chronic conditions against claims-based measures from the Medicare Chronic Conditions Warehouse (CCW).
Methods:
We linked CAHPS responses from 301,050 fee-for-service Medicare beneficiaries in 2010-2012 with summaries of their claims in the CCW and identified nearest equivalent measures of conditions across sources. We calculated sensitivities and specificities for conditions and estimated regression models to assess the effects of patient characteristics on the sensitivity.
Results:
The sensitivity of CAHPS measures differed across conditions, ranging from 0.513 for history of stroke to 0.773 for history of cancer. Sensitivity was generally lower for older beneficiaries, those reporting good self-rated health, and those with fair or poor mental health. Specificity was 0.904 or greater for all conditions, up to 0.961 for stroke.
Conclusions:
Despite difference in timeframes and definitions of conditions, the measured sensitivities demonstrated reasonable validity. Variation in sensitivity is consistent with covariates that either directly measure health severity within a diagnosis or can be construed as a proxy for severity of illness.
More Related Videos
07:49Slow-release Drug Delivery through Elvax 40W to the Rat Retina: Implications for the Treatment of Chronic Conditions
Published on: September 17, 2014
10:08The Evoked Potential Operant Conditioning System EPOCS: A Research Tool and an Emerging Therapy for Chronic Neuromuscular Disorders
Published on: August 25, 2022
Related Concept Videos
Surveys
Introduction to Surveying, Plane Surveying and Geodetic Surveys
Types of Surveys
Survey Safety
Errors and Mistakes in Surveying
Reliability and Validity
