Published: June 2024

Last updated: June 2024

Time and Cost Savings of Machine Learning and Artificial Intelligence in Systematic Reviews: A Case Study

INTRODUCTION: Conducting a systematic review (SR) of clinical trials is labor-intensive and expensive. However, existing open-source content can be used to develop custom machine learning tools suited to the workflow of individual organizations. This case study details the potential of a bespoke tool developed by York Health Economics Consortium (YHEC) for reducing the time and cost involved in producing an SR.

METHODS: RESbot is a flexible, stand-alone machine learning tool created using an extensively tested open-source dataset developed by Cochrane. The tool identifies randomized controlled trials (RCTs) from a large corpus of records. It has a user interface and inputs/outputs to fit into the company’s existing workflow at any stage. RESbot has two settings. The “sensitive” setting identifies a higher number of possible RCTs with a lower risk of missing eligible studies, while the “precise” setting is more focused. For both settings, we estimated the reduction in resources required for record screening in two examples of RCT-only reviews.

RESULTS: Scoping searches in MEDLINE were conducted for SRs of RCTs in femoropopliteal artery diseases (FAD) and postpartum depression (PD). The results were run through RESbot. For the FAD SR, 1,444 references were retrieved, with the sensitive and precise RESbot settings reducing the record set by 38 percent and 64 percent, respectively. For the PD SR, a record set of 2,153 records was reduced by 25 percent and 41 percent, respectively. Resource savings offered by RESbot vary depending on subject but may reduce the time taken to screen records by up to 64 percent, with a subsequent reduction in cost to the organization commissioning the SR.

CONCLUSIONS: The use of bespoke machine learning tools in SR production has the potential to reduce the time and staff costs involved in producing a review. This case study tested the effect on a small number of records, but for larger reviews retrieving tens of thousands of records, reductions in time and costs can be very significant.

You may also be interested in

Peer-reviewed publication

The Economic and Clinical Impact of an AI-Assisted Tool for Colonoscopy to Support Diagnosis of Colorectal Cancer in Symptomatic Patients in England

YHEC authors: Luc Curtis-Gretton, Angel Varghese, Karina Watts, Hayden Holmes
Publication date: November 2026
Publishers: Springer Nature Link
Journal: BMC Digital Health

Abstract

BACKGROUND: Colorectal cancer (CRC) remains a leading cause of cancer-related mortality in the UK. Early detection and removal of adenomatous polyps are essential to improving outcomes. Artificial intelligence-assisted colonoscopy tools,...

Peer-reviewed publication

Cost-Effectiveness of Transcatheter Aortic Valve Implantation for Asymptomatic Severe Aortic Stenosis in the Kingdom of Saudi Arabia

YHEC authors: Madison Montgomery, Heather Davies, Lucy Hillcoat
Publication date: October 2026
Journal: Frontiers in Cardiovascular Medicine

Abstract

INTRODUCTION: Aortic stenosis (AS) is defined as the narrowing of the aortic valve. The benefits of implementing early aortic valve replacement (AVR), while the AS is asymptomatic, have been demonstrated...

Peer-reviewed publication

What is the Role of Multidisciplinary Methods to Support Environmental Sustainability in Health Technology Assessment?

YHEC authors: Melissa Pegg, Emma Bishop, Karina Watts
Publication date: October 2026
Publishers: HTAi
Journal: International Journal of Technology Assessment in Healthcare

Abstract

Healthcare contributes up to 8.5 percent of global carbon emissions, amongst other environmental impacts including intensive water consumption, plastics in our environment and pharmaceutical associated pollution. Healthcare supply chains are...