Related Experiment Video
Updated: Mar 13, 2026

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Testing the Replicability of a Successful Care Management Program: Results from a Randomized Trial and Likely
G Greg Peterson1, Jelena Zurovac1, Randall S Brown2
1Mathematica Policy Research, Washington, DC.
A care management program failed to replicate earlier success in reducing hospitalizations and Medicare costs. The lack of replication was due to improvements in the control group, not worsening outcomes for the intervention group.
Area of Science:
- Health Services Research
- Chronic Disease Management
- Health Economics
Background:
- A prior randomized trial demonstrated the success of an intensive care management program for Medicare beneficiaries with chronic illnesses.
- Replication of this success in a subsequent trial was assessed to determine its generalizability and identify factors influencing outcomes.
Purpose of the Study:
- To evaluate whether a successful care management program could achieve similar results in a later period.
- To investigate potential reasons for any discrepancies in program effectiveness compared to the initial trial.
Main Methods:
- A randomized trial involving 483 Medicare fee-for-service beneficiaries with chronic illnesses in eastern Pennsylvania.
- Comparison of intensive care management services against usual care, with outcomes derived from Medicare claims and nurse contact data.
Main Results:
- The program did not significantly reduce hospitalizations or generate Medicare savings between 2010 and 2014.
- Observed outcomes were statistically different (p < .05) from the first trial (2002-2010), with no significant treatment-control difference in hospitalization rates.
- The control group's improved risk-adjusted hospitalization rate, rather than a decline in the treatment group's outcomes, explained the lack of observed impact.
Conclusions:
- Successful interventions in one trial setting may not consistently replicate in different contexts or timeframes.
- Future replication success may depend on assessing the continued presence of care gaps that the original program addressed.
Related Concept Videos
Methods of Documentation VI: Case Management Model
For example, a patient with a chronic...
Blinding
Randomized Experiments
Simple randomization
Simple...
Methods Of Healthcare Delivery System
Managed Care System:
The managed care system is designed to control the cost while maintaining the quality of care. The patient's care from admission to discharge is planned by the primary care provider or the case manager, also known as the gatekeeper. In a managed care system, the number of care providers is...
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs
Crossover Experiments
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
