Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Sep;34(9):1857-1864.
doi: 10.1007/s11606-019-05069-5. Epub 2019 Jun 27.

Measures Used to Assess the Impact of Interventions to Reduce Low-Value Care: a Systematic Review

Affiliations

Measures Used to Assess the Impact of Interventions to Reduce Low-Value Care: a Systematic Review

Jennifer K Maratt et al. J Gen Intern Med. 2019 Sep.

Abstract

Importance: Studies of interventions to reduce low-value care are increasingly common. However, little is known about how the effects of such interventions are measured.

Objective: To characterize measures used to assess interventions to reduce low-value care.

Evidence review: We searched PubMed and Web of Science to identify studies published between 2010 and 2016 that examined the effects of interventions to reduce low-value care. We also searched ClinicalTrials.gov to identify ongoing studies. We extracted data on characteristics of studies, interventions, and measures. We then developed a framework to classify measures into the following categories: utilization (e.g., number of tests ordered), outcome (e.g., mortality), appropriateness (e.g., overuse of antibiotics), patient-reported (e.g., satisfaction), provider-reported (e.g., satisfaction), patient-provider interaction (e.g., informed decision-making elements), value, and cost. We also determined whether each measure was designed to assess unintended consequences.

Findings: A total of 1805 studies were identified, of which 101 published and 16 ongoing studies were included. Of published studies (N = 101), 68% included at least one measure of utilization, 41% of an outcome, 52% of appropriateness, 36% of cost, 8% patient-reported, and 3% provider-reported. Funded studies were more likely to use patient-reported measures (17% vs 0%). Of ongoing studies (registered trials) (N = 16), 69% included at least one measure of utilization, 75% of an outcome, 50% of appropriateness, 19% of cost, 50% patient-reported, 13% provider-reported, and 6% patient-provider interaction. Of published studies, 34% included at least one measure of an unintended consequence as compared to 63% of ongoing studies.

Conclusions and relevance: Most published studies focused on reductions in utilization rather than on clinically meaningful measures (e.g., improvements in appropriateness, patient-reported outcomes) or unintended consequences. Investigators should systematically incorporate more clinically meaningful measures into their study designs, and sponsors should develop standardized guidance for the evaluation of interventions to reduce low-value care.

Keywords: interventions; low-value care; measures.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they do not have a conflict of interest.

Figures

Figure 1
Figure 1
Flow diagram of search results. *WOS Web of Science. De-prescribing, de-intensification, unnecessary (lab, test, imaging, utilization), performance measurement, and behavioral economics. 2 articles identified as published studies in clinicaltrials.gov, 2 articles identified by AcademyHealth from the Choosing Wisely Campaign.

Similar articles

Cited by

References

    1. de Vries EF, Struijs JN, Heijink R, Hendrikx RJ, Baan CA. Are low-value care measures up to the task? A systematic review of the literature. BMC Health Serv Res. 2016;16:1–12. doi: 10.1186/s12913-016-1656-3. - DOI - PMC - PubMed
    1. Institute of Medicine . Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: The National Academies Press; 2001. - PubMed
    1. Baker DW, Qaseem A, Reynolds PP, Gardner LA, Schneider EC. Design and use of performance measures to decrease low-value services and achieve cost-conscious care. Ann Intern Med. 2012;158:55–59. doi: 10.7326/0003-4819-158-1-201301010-00560. - DOI - PubMed
    1. American Board of Internal Medicine. Choosing Wisely: An Initiative of the ABIM Foundation. Available at: http://www.choosingwisely.org [Accessed February 12, 2019].
    1. Kerr EA, Kullgren JT, Saini SD. Choosing wisely: how to fulfill the promise in the next 5 years. Health Aff. 2017;36:2012–18. doi: 10.1377/hlthaff.2017.0953. - DOI - PubMed

Publication types

MeSH terms

LinkOut - more resources