Cross-sectional analysis of accuracy versus interpretability in Medicare Advantage risk adjustment
View abstract on PubMed
Summary
This summary is machine-generated.Machine learning (ML) models modestly improve Medicare risk adjustment accuracy but significantly reduce interpretability. Further research is needed to balance predictive power with transparency for public fund oversight.
Area Of Science
- Health economics
- Health informatics
- Machine learning in healthcare
Background
- Medicare Advantage risk adjustment models manage over $300 billion in annual public funds.
- Policymakers require accurate and interpretable models for oversight of public spending.
Purpose Of The Study
- To evaluate the trade-off between predictive accuracy and interpretability of machine learning (ML) models in Medicare risk adjustment.
- To compare ML models against traditional approaches for risk adjustment accuracy and complexity.
Main Methods
- A cross-sectional analysis of 2018-2019 Medicare claims data from 3,602,618 beneficiaries.
- Estimation of various risk adjustment models, including traditional and ML-based methods.
- Assessment of model performance using out-of-sample Mean Absolute Error (MAE) and Mean Squared Error (MSE), and interpretability via coefficient count.
Main Results
- ML models, particularly gradient-boosted trees, significantly improved prediction accuracy (MAE reductions of -1,352; MSE reductions of -5).
- Model complexity increased over 1000x with ML approaches, diminishing interpretability.
- Gradient-boosted trees showed reduced responsiveness to diagnosis coding, potentially mitigating upcoding incentives.
Conclusions
- Standard ML models offer modest gains in predictive accuracy for risk adjustment at the cost of substantial interpretability loss.
- Future research must focus on enhancing ML model accuracy while preserving the interpretability crucial for public fund oversight.
Related Concept Videos
In cross-sectional research, a researcher compares multiple segments of the population at the same time. If they were interested in people's dietary habits, the researcher might directly compare different groups of people by age. Instead of following a group of people for 20 years to see how their dietary habits changed from decade to decade, the researcher would study a group of 20-year-old individuals and compare them to a group of 30-year-old individuals and a group of 40-year-old...
Profile leveling and cross-sections are surveying methods used to determine and document terrain elevations for infrastructure projects such as highways, railroads, canals, and pipelines. These methods provide data for earthwork planning and alignment of proposed routes. Profile leveling involves measuring elevations along a fixed line to create a vertical terrain profile. A surveyor sets up a leveling instrument at the benchmark (BM) and records a backsight (BS) to determine the...
Fluorescence in-situ hybridization (FISH) is often required in combination with histopathology and molecular diagnostics for selection of therapy in personalized medicine. A novel non-cross-linking, formalin-free tissue fixative that allows high quality morphologic, molecular and FISH analyses from the same specimen by addition of a post-fixation step before FISH is...
The disease triggers autoreactive immune cells to attack myelin proteins, degrading the myelin sheath surrounding neuronal...
Here, we present a protocol for rapid muscle fiber analyses, which allows improved staining quality, and thereby automatic acquisition and quantification of fiber populations using the freely available software...
The cross-sectional anatomy of the spinal cord offers a detailed view of its complex structure and function within the central nervous system. At the core of the spinal cord lies the gray matter, characterized by its butterfly or "H"-shaped appearance in cross-section. This central region is enveloped by white matter, with the overall structure divided into symmetrical halves by the dorsal median sulcus and the ventral median fissure.
Gray Matter and its Components
Central to the gray matter is...

