Validating Reports of Chronic Conditions in the Medicare CAHPS Survey

Matthew W Brault1,2, Bruce E Landon1,3, Alan M Zaslavsky1

  • 1Department of Health Care Policy, Harvard Medical School, Boston.

Medical Care
|August 28, 2019
PubMed

Insights

The Medicare CAHPS survey

Area of Science:

  • Health Services Research
  • Medical Informatics
  • Patient-Reported Outcomes

Background:

  • The Medicare Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey collects data on patient-reported health history and chronic conditions.
  • Concerns exist regarding the agreement between patient self-reports and administrative data for health history information.

Purpose of the Study:

  • To validate CAHPS measures of chronic conditions by comparing them with claims-based data from the Medicare Chronic Conditions Warehouse (CCW).

Main Methods:

  • Linked CAHPS survey responses (2010-2012) from 301,050 fee-for-service Medicare beneficiaries with their claims data in the CCW.
  • Identified equivalent condition measures across both data sources.
  • Calculated sensitivity and specificity for CAHPS condition measures and used regression models to analyze patient characteristic effects on sensitivity.

Main Results:

  • CAHPS measures showed varying sensitivity for different conditions, ranging from 0.513 for stroke to 0.773 for cancer.
  • Sensitivity was lower in older beneficiaries, those reporting good self-rated health, and those with fair/poor mental health.
  • Specificity was high across all conditions (≥0.904), reaching 0.961 for stroke.

Conclusions:

  • Despite differences in data definitions and timeframes, CAHPS measures demonstrated reasonable validity for chronic conditions.
  • Observed variations in sensitivity are likely related to patient characteristics influencing health severity or proxy indicators of illness severity.
Abstract

Related Concept Videos

Surveys02:16

Surveys

Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
16.6K
Introduction to Surveying, Plane Surveying and Geodetic Surveys01:27

Introduction to Surveying, Plane Surveying and Geodetic Surveys

Surveying is the art and science of mapping the earth's surface. It involves measuring distances, angles in horizontal or vertical directions, and levels to understand the shape and size of land features. Surveying techniques are essential for various tasks, such as identifying the levels of a land area with reference to a specific point, and mapping undulations and water bodies.There are two main types of surveying: plane surveys and geodetic surveys. Plane surveys assume the earth is flat,...
996
Types of Surveys01:27

Types of Surveys

Surveys are essential for marking property boundaries near water bodies. Different types of surveys are defined, each with its own function. Land surveys mark the property boundaries, while route surveys determine the position of properties on nearby highways. Topographic surveys create maps by capturing the three-dimensional features of the land. Hydrographic surveys focus on the shapes of underwater areas and the movement of streams through the properties. Mine surveys determine the relative...
354
Survey Safety01:28

Survey Safety

Surveying near highways, rough terrain, or power lines involves significant risks. Working along highways is particularly dangerous and requires the use of warning signs and flagmen. It is safest to avoid working directly on roads and use offsets whenever possible. When highway work is unavoidable, it must follow all safety guidelines. Surveyors should wear bright clothing, such as orange reflective vests, to ensure visibility to motorists, coworkers, and hunters. In construction zones, wearing...
373
Errors and Mistakes in Surveying01:19

Errors and Mistakes in Surveying

Errors and mistakes in surveying refer to inaccuracies in measurements and data recording. The errors are deviations from the actual value caused by human sensory limitations, equipment flaws, or environmental effects. These errors are typically unintentional and can result from the inherent imperfections in the instruments used, atmospheric conditions, or the observer’s inability to perceive exact measurements. On the other hand, mistakes are caused by the surveyor's lack of...
637
Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.7K