Related Experiment Video
Updated: Mar 28, 2026

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
Published on: September 27, 2019
Assessing evidence for MTM quality measure development: a scoping review
Jennifer M Bingham1, Carlyn E Vogel1, Catherine E Cooke2
1Pharmacy Quality Alliance, Alexandria, VA.
Objectives:
Performance measures for health care quality programs should rely on a strong evidence base, given their impact on patients, providers, and payers. The purpose of this review was to assess the literature on the association between medication therapy management (MTM) services and outcomes to substantiate a new quality measure.
Study Design:
Scoping review.
Methods:
We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews. The search included articles published between January 2006 and October 2024. Studies were included if they assessed the impact of Medicare Part D MTM service outcomes, followed Part D program MTM eligibility requirements, and were Medicare beneficiary specific. The search strategy was adapted for use in PubMed and grey literature. Reviewers extracted data using a screening tool developed for this study and used the Grading of Recommendations Assessment, Development, and Evaluation Evidence to Decision framework to determine the certainty of the evidence for risk of bias, indirectness, inconsistency, and imprecision.
Results:
Of 424 screened articles, 27 studies met the inclusion criteria and were reviewed for certainty. Of these, 6 (22%) assessed for risk of bias had high levels of certainty that the true effect was similar to the estimated effect, whereas the levels of certainty for directness, consistency, and precision were rated low for all 6 studies.
Conclusions:
The association between Part D MTM services and outcomes exists but is not sufficient to support recommendations for a new MTM quality measure. Future research with stronger study designs is warranted to support future measure development.
Related Concept Videos
Quality Assurance
Quality Control
Quality control helps track data, visualize trends, and identify variations, making it easier to detect deviations that may affect the accuracy of an analysis. One way to do this is by generating a quality control chart, which...
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Conversion of Units
The first step in the unit conversion is to list the given units and the units required...
Estimation of the Physical Quantities
Testing a Claim about Standard Deviation
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...

