Toggle Main Menu Toggle Search

Open Access padlockePrints

Bias in meta-analysis due to outcome variable selection within studies

Lookup NU author(s): Dr Jane Hutton


Full text for this publication is not currently held within this repository. Alternative links are provided below where available.


Although bias in meta-analysis arising from selective publication has been studied, within-study selection has received little attention. Chronic diseases often have several possible outcome variables. Methods based on the size of the effect allow results from studies with different outcomes to be combined. However, the possibility of selective reporting of outcomes must be considered. The effect of selective reporting on estimates of the size of the effect and significance levels is presented, and sensitivity analyses are suggested. Substantial publication bias could arise from multiple testing of outcomes in a study, followed by selective reporting. Two meta-analyses, on anthelminth therapy and a treatment for incontinence, are reassessed allowing for within-study selection, as it is clear that more outcomes had been measured than were reported. The sensitivity analyses show that the robustness of the anthelminth results is dependent on what assumption one makes about the reporting strategy for the largest trial. The possible influence of correlation between within-child measurements was such that the conclusions could easily be reversed. The effect of a mild assumption on within-trial selection alone could alter general recommendations about the treatment for incontinence.

Publication metadata

Author(s): Hutton JL, Williamson PR

Publication type: Article

Publication status: Published

Journal: Journal of the Royal Statistical Society. Series C: Applied Statistics

Year: 2000

Volume: 49

Issue: 3

Pages: 359-370

Print publication date: 01/01/2000

ISSN (print): 0035-9254

ISSN (electronic): 1467-9876

Publisher: Wiley-Blackwell Publishing Ltd.


DOI: 10.1111/1467-9876.00197


Altmetrics provided by Altmetric