Skip to main content
  • Poster presentation
  • Open access
  • Published:

Treatment effect bias in randomised controlled trials using surrogate outcomes: a preliminary cohort study analysis

Background

Ideally, decisions on the value of health technologies should be based on evidence from well-conducted clinical trials that assess clinically important final patient-relevant outcomes, such as mortality or impaired quality of life. Pressure to reduce the delay in the availability of technologies to patients has led to an increased reliance on the use of surrogate outcomes [1]. A key tenant of surrogate outcomes is unbiased quantification of the predictive treatment effect on the final patient-relevant clinical outcomes. This study compares the treatment outcome of trials that use a surrogate versus a final patient-relevant primary outcome.

Materials and methods

We searched for all randomized controlled trials (RCTs) published in JAMA, NEJM, Lancet, BMJ, PLoS Medicine and Annals of Internal Medicine in 2005 and 2006 [2]. We distinguished between trials that used a surrogate or a patient-relevant primary outcome. An outcome was defined as a surrogate if it did not directly measure “how a patient feels, functions, or survives” [3] or was judged to be a substitute and predictive of a final outcome [1]. We excluded non-RCTs, composite (of both surrogate and final) outcomes, economic evaluations and non-interventional technologies. Surrogate and final outcome trials were matched on patient population, intervention, journal and year of publication. In this preliminary analysis we compare the two groups of trials based on the statistical significance and direction of their outcome results.

Results

Of the 639 citations identified by our searches, we included 138 trials that used a primary surrogate outcome (‘surrogate trials’) and 132 trials that used a final patient-relevant outcomes (‘final trials’). Table 1 summarises the trial characteristics used for matching. Other trial characteristics also appeared to be well balanced except for the length of follow-up (i.e. more studies with follow up <30 days and >1 year for final trials).

Table 1 Characteristics of included surrogate and final trials.
Table 2 Comparison of outcome results.

Conclusions

This preliminary analysis supports our initial hypothesis that the use of surrogate outcomes is more likely to lead statistically significant treatment effects than patient-relevant primary outcomes. We are currently undertaking additional analysis using actual effect sizes in meta-analytic/meta-regression framework. These results have important implications for payers faced with making coverage decisions on the effectiveness and cost-effectiveness of new treatments based on surrogate rather than final clinical trials data.

References

  1. Elston J, Taylor RS: Use of surrogate outcomes in cost-effectiveness models: A review of United Kingdom health technology assessment reports. Int J Technol Assess Health Care. 2009, 25: 6-13. 10.1017/S0266462309090023.

    Article  PubMed  Google Scholar 

  2. la Cour JL, Brok J, Gøtzsche PC: Inconsistent reporting of surrogate outcomes in randomised clinical trials: cohort study. BMJ. 2010, 341: c3653-10.1136/bmj.c3653.

    Article  PubMed Central  PubMed  Google Scholar 

  3. Temple RJ: A regulatory authority’s opinion about surrogate endpoints. Clinical Measurement in Drug Evaluation. Edited by: Nimmo WS, Tucker GT. 1995, New York: John Wiley and Sons Inc, 3-22.

    Google Scholar 

Download references

Acknowledgements

We thank Toby Pavey for the assistance in data checking and professor Peter Gøtzsche and co-authors who kindly provided access to the data files of their study.

Ciani O. is currently in receipt of a Peninsula College of Medicine and Dentistry PhD studentship.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Oriana Ciani.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Ciani, O., Taylor, R.S. Treatment effect bias in randomised controlled trials using surrogate outcomes: a preliminary cohort study analysis. Trials 12 (Suppl 1), A73 (2011). https://0-doi-org.brum.beds.ac.uk/10.1186/1745-6215-12-S1-A73

Download citation

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1745-6215-12-S1-A73

Keywords