Skip to main content
Download PDF

Volume 12 Supplement 1

Clinical Trials Methodology Conference 2011

  • Poster presentation
  • Open access
  • Published:

Individual participant data meta-analyses compared with meta-analyses based on aggregate data

Trials volume 12, Article number: A57 (2011) Cite this article

Background

Meta-analysis based on individual participant data (IPD) is widely accepted as the most reliable approach and has been described as the ‘gold standard‘ for systematic reviews. An IPD approach often allows more powerful, consistent and thorough analyses but does require additional resources compared with meta-analyses based on aggregate data (AD). Several empirical comparisons of IPD with AD meta-analyses have been published, some of which show that IPD meta-analyses can differ in important ways from meta-analyses based on AD. For example, the importance of including as much follow-up as possible on all randomised participants and data from all relevant trials was shown in separate empirical comparisons [1–3] whilst Duchateau [4] found substantial differences between IPD and literature-based AD meta-analyses, mainly due to different approaches to analysis. An unpublished review [5] summarised results from across 25 studies, showing that for two thirds of the comparisons AD estimated effect sizes with less precision and tended to overestimate the IPD effect but differences were small in most comparisons.

Objectives

We have undertaken a Cochrane systematic review of empirical studies that compared IPD and AD meta-analysis to explore key reasons for the differences.

Methods

The Cochrane Methodology Register, CENTRAL, MEDLINE and EMBASE were searched using a predefined set of search terms. Studies that report an empirical comparison of IPD meta-analysis against AD meta-analysis of randomised trials were assessed for inclusion, by two reviewers independently. Data were extracted by two reviewers independently and stored in a central database.

Results

Over forty empirical studies have satisfied the inclusion criteria for this review. Estimates of effect size and precision obtained from IPD and AD will be compared and differences will be discussed. Results will help inform the ongoing debate about whether, and when IPD may be most valuable.

References

  1. Stewart LA, Parmar MKB: Meta-analysis of the literature or of individual patient data: is there a difference?. Lancet. 1993, 341: 418-22. 10.1016/0140-6736(93)93004-K.

    Article  CAS  PubMed  Google Scholar 

  2. Clarke M, Stewart L: Individual patient data or published meta-analysis: a systematic review. Second International Conference Scientific Basis of Health Services & Fifth Annual Cochrane Colloquium. 1997, a94-

    Google Scholar 

  3. Williamson PR, Marson AG, Tudur C, Hutton JL, Chadwick DW: Individual patient data meta-analysis of randomized anti-epileptic drug monotherapy trials. Journal of Evaluation in Clinical Practice. 2000, 6: 205-14. 10.1046/j.1365-2753.2000.00236.x.

    Article  CAS  PubMed  Google Scholar 

  4. Moniem Mukhtar A: Incorporation of heterogeneity in meta-analysis of randomised controlled trials. PhD thesis. 2008

    Google Scholar 

  5. Duchateau L, Pignon JP, Bijnens L, Bertin S, Bourhis J, Sylvester R: Individual patient- versus literature-based meta-analysis of survival data: time to event and event rate at a particular time can make a difference, an example based on head and neck cancer. Controlled Clinical Trials. 2001, 22: 538-547. 10.1016/S0197-2456(01)00152-0.

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. North West Hub for Trials Methodology Research, University of Liverpool, UK

    Catrin Tudur Smith, James Oyee & Paula Williamson

  2. Department of Medicine, University of Perugia, Perugia, Italy

    Maura Marcucci

  3. Departments of Epidemiology, Biostatistics & HTA and Operating Rooms, UMC St Radboud, The Netherlands

    Maroeska Rovers

  4. Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, ON, Canada

    Alfonso Iorio

  5. Public Health, Epidemiology and Biostatistics, University of Birmingham, UK

    Richard Riley

  6. All-Ireland Hub for Trials Methodology Research, Queen’s University Belfast, UK

    Mike Clarke

Authors
  1. Catrin Tudur Smith
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. James Oyee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Maura Marcucci
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Maroeska Rovers
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Alfonso Iorio
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Richard Riley
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Paula Williamson
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Mike Clarke
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Smith, C.T., Oyee, J., Marcucci, M. et al. Individual participant data meta-analyses compared with meta-analyses based on aggregate data. Trials 12 (Suppl 1), A57 (2011). https://0-doi-org.brum.beds.ac.uk/10.1186/1745-6215-12-S1-A57

Download citation

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1745-6215-12-S1-A57

Keywords

Trials

ISSN: 1745-6215