ePrints

Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions

Lookup NU author(s): Professor Clare BambraORCiD

Downloads

• Published version [.pdf]

Licence

This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).

Abstract

Objective: We appraised the reporting of intervention implementation in studies included in systematic reviews of organisational-level workplace interventions. Implementation is taken to include such factors as intervention setting, resources, planning, collaborations, delivery and macro-level socio-economic contexts. Understanding how implementation affects intervention outcomes may help prevent erroneous conclusions and misleading assumptions about generalisability, but implementation must be adequately reported if it is to be taken into account. Design: Data on implementation was obtained from four systematic reviews of complex interventions in workplace settings. Implementation was appraised using a specially-developed checklist, and by means of an unstructured reading of the text. Results: We identified and appraised 103 studies evaluating 4 types of organisational-level workplace intervention (employee participation, changing job tasks, shift changes and compressed working weeks). Many studies referred to implementation but reporting was generally poor and anecdotal in form. This poor quality of reporting did not vary greatly by type or date of publication. A minority of studies described how implementation may have influenced outcomes. These descriptions were more usefully explored through an unstructured reading of the text, rather than by means of the checklist. Conclusions: Evaluations of complex interventions should include more detailed reporting of implementation and consider how to measure quality of implementation. Our checklist helped us explore the poor reporting of implementation in a more systematic fashion. In terms of interpreting study findings and their transferability, the more qualitative appraisals however appeared to offer greater potential for exploring how implementation may influence the findings of specific evaluations. Implementation appraisal techniques for systematic reviews of complex interventions require further development and testing.

Publication metadata

Author(s): Egan M, Bambra C, Petticrew M, Whitehead M

Publication type: Article

Publication status: Published

Journal: Journal of Epidemiology & Community Health

Year: 2009

Volume: 63

Issue: 1

Pages: 4-11

Print publication date: 01/01/2009

Online publication date: 16/12/2008

Date deposited: 04/02/2017

ISSN (print): 0143-005X

ISSN (electronic): 1470-2738

Publisher: BMJ Group

URL: http://dx.doi.org/10.1136/jech.2007.071233

DOI: 10.1136/jech.2007.071233

Altmetrics

Share