Toggle Main Menu Toggle Search

Open Access padlockePrints

Concerns of AI use in evidence synthesis based practices: collective views from the community

Lookup NU author(s): Hannah O'KeefeORCiD, Claire EastaughORCiD, Jen Taylor, Dr Chris MarshallORCiD, Dr Fiona Campbell

Downloads


Licence

This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).


Abstract

© The Author(s) 2026. Background: The use of artificial intelligence (AI) in research has become one of the most hotly debated topics. This is particularly true for the field of evidence synthesis where automation through AI may lead to substantial time and resource savings. Many researchers see the potential benefits of using AI technologies, yet there is hesitation around embedding AI in practice. We explored the concerns of those working in the field of evidence synthesis through a series of online and in-person events. Methods: Data collection was conducted across two in-person and 2 online events: the Evidence Synthesis Hackathon (ESH) 2024, the Community, Opportunities, Research and Experience Information Retrieval (CORE) Forum, a Systematic Review Conversations (SRC) online seminar, and an online Horizon Scanning (HS) Survey. Inductive and deductive coding was utilised to synthesis data into broad themes and subthemes, independently for each event. A vote counting and ranking approach was used to triangulate data across events to capture convergent and divergent themes between participant groups. Results: Across the four events we acquired a total of 248 data points (from 80 respondents) and responses were broadly similar across cohorts. Through synthesis and triangulation, we identified 10 overarching themes. The most prominent themes were knowledge and skills, and data management, respectively. Skills loss, skills gap and job loss were highlighted within the knowledge and skills theme. Bias, confidentiality and reliability were prominent for data management. Lower ranking concerns included environment, economics, AI market and costs. Conclusions: These are valid apprehensions faced by researchers across the field of evidence synthesis and should be considered in the broader discussion of AI. Development of rigorous methodologies and guidance may help to overcome these issues by facilitating responsible and transparent use of AI.


Publication metadata

Author(s): O'Keefe H, Eastaugh C, Yarar F, Taylor J, Marshall C, Campbell F

Publication type: Article

Publication status: Published

Journal: BMC Medical Research Methodology

Year: 2026

Volume: 26

Online publication date: 28/03/2026

Acceptance date: 23/03/2026

Date deposited: 26/05/2026

ISSN (electronic): 1471-2288

Publisher: BioMed Central Ltd

URL: https://doi.org/10.1186/s12874-026-02844-x

DOI: 10.1186/s12874-026-02844-x

Data Access Statement: The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

PubMed id: 41896751


Altmetrics

Altmetrics provided by Altmetric


Funding

Funder referenceFunder name
HSRIC-2016-10009National Institute for Health Research (NIHR)

Share