Measures Used to Assess the Impact of Interventions to Reduce Low-Value Care: a Systematic Review
- PMID: 31250366
- PMCID: PMC6712188
- DOI: 10.1007/s11606-019-05069-5
Measures Used to Assess the Impact of Interventions to Reduce Low-Value Care: a Systematic Review
Abstract
Importance: Studies of interventions to reduce low-value care are increasingly common. However, little is known about how the effects of such interventions are measured.
Objective: To characterize measures used to assess interventions to reduce low-value care.
Evidence review: We searched PubMed and Web of Science to identify studies published between 2010 and 2016 that examined the effects of interventions to reduce low-value care. We also searched ClinicalTrials.gov to identify ongoing studies. We extracted data on characteristics of studies, interventions, and measures. We then developed a framework to classify measures into the following categories: utilization (e.g., number of tests ordered), outcome (e.g., mortality), appropriateness (e.g., overuse of antibiotics), patient-reported (e.g., satisfaction), provider-reported (e.g., satisfaction), patient-provider interaction (e.g., informed decision-making elements), value, and cost. We also determined whether each measure was designed to assess unintended consequences.
Findings: A total of 1805 studies were identified, of which 101 published and 16 ongoing studies were included. Of published studies (N = 101), 68% included at least one measure of utilization, 41% of an outcome, 52% of appropriateness, 36% of cost, 8% patient-reported, and 3% provider-reported. Funded studies were more likely to use patient-reported measures (17% vs 0%). Of ongoing studies (registered trials) (N = 16), 69% included at least one measure of utilization, 75% of an outcome, 50% of appropriateness, 19% of cost, 50% patient-reported, 13% provider-reported, and 6% patient-provider interaction. Of published studies, 34% included at least one measure of an unintended consequence as compared to 63% of ongoing studies.
Conclusions and relevance: Most published studies focused on reductions in utilization rather than on clinically meaningful measures (e.g., improvements in appropriateness, patient-reported outcomes) or unintended consequences. Investigators should systematically incorporate more clinically meaningful measures into their study designs, and sponsors should develop standardized guidance for the evaluation of interventions to reduce low-value care.
Keywords: interventions; low-value care; measures.
Conflict of interest statement
The authors declare that they do not have a conflict of interest.
Figures

Similar articles
-
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article.
-
The future of Cochrane Neonatal.Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
-
Interventions for interpersonal communication about end of life care between health practitioners and affected people.Cochrane Database Syst Rev. 2022 Jul 8;7(7):CD013116. doi: 10.1002/14651858.CD013116.pub2. Cochrane Database Syst Rev. 2022. PMID: 35802350 Free PMC article. Review.
-
Behavioural modification interventions for medically unexplained symptoms in primary care: systematic reviews and economic evaluation.Health Technol Assess. 2020 Sep;24(46):1-490. doi: 10.3310/hta24460. Health Technol Assess. 2020. PMID: 32975190 Free PMC article.
-
Measures implemented in the school setting to contain the COVID-19 pandemic.Cochrane Database Syst Rev. 2022 Jan 17;1(1):CD015029. doi: 10.1002/14651858.CD015029. Cochrane Database Syst Rev. 2022. Update in: Cochrane Database Syst Rev. 2024 May 2;5:CD015029. doi: 10.1002/14651858.CD015029.pub2. PMID: 35037252 Free PMC article. Updated. Review.
Cited by
-
Updating a Claims-Based Measure of Low-Value Services Applicable to Medicare Fee-for-Service Beneficiaries.J Gen Intern Med. 2022 Oct;37(13):3453-3461. doi: 10.1007/s11606-022-07654-7. Epub 2022 Jun 6. J Gen Intern Med. 2022. PMID: 35668238 Free PMC article. No abstract available.
-
A call to integrate health equity into learning health system research training.Learn Health Syst. 2022 Jul 24;6(4):e10330. doi: 10.1002/lrh2.10330. eCollection 2022 Oct. Learn Health Syst. 2022. PMID: 36263258 Free PMC article.
-
Impacts of COVID-19 on Appropriate Use of Screening Colonoscopy in a Large Integrated Healthcare Delivery System.J Gen Intern Med. 2023 Aug;38(11):2577-2583. doi: 10.1007/s11606-023-08233-0. Epub 2023 May 25. J Gen Intern Med. 2023. PMID: 37231209 Free PMC article.
-
De-implementing low-value care in endocrinology.Endocrine. 2021 Aug;73(2):292-300. doi: 10.1007/s12020-021-02732-y. Epub 2021 May 11. Endocrine. 2021. PMID: 33977312 Free PMC article. Review.
-
The Future of the Patient-Centered Outcomes Research Institute (PCORI).J Gen Intern Med. 2019 Nov;34(11):2291-2292. doi: 10.1007/s11606-019-05324-9. J Gen Intern Med. 2019. PMID: 31529376 Free PMC article. No abstract available.
References
-
- Institute of Medicine . Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: The National Academies Press; 2001. - PubMed
-
- American Board of Internal Medicine. Choosing Wisely: An Initiative of the ABIM Foundation. Available at: http://www.choosingwisely.org [Accessed February 12, 2019].
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources