Skip to main content

Advertisement

Treatment effect bias in randomised controlled trials using surrogate outcomes: a preliminary cohort study analysis

Article metrics

Background

Ideally, decisions on the value of health technologies should be based on evidence from well-conducted clinical trials that assess clinically important final patient-relevant outcomes, such as mortality or impaired quality of life. Pressure to reduce the delay in the availability of technologies to patients has led to an increased reliance on the use of surrogate outcomes [1]. A key tenant of surrogate outcomes is unbiased quantification of the predictive treatment effect on the final patient-relevant clinical outcomes. This study compares the treatment outcome of trials that use a surrogate versus a final patient-relevant primary outcome.

Materials and methods

We searched for all randomized controlled trials (RCTs) published in JAMA, NEJM, Lancet, BMJ, PLoS Medicine and Annals of Internal Medicine in 2005 and 2006 [2]. We distinguished between trials that used a surrogate or a patient-relevant primary outcome. An outcome was defined as a surrogate if it did not directly measure “how a patient feels, functions, or survives” [3] or was judged to be a substitute and predictive of a final outcome [1]. We excluded non-RCTs, composite (of both surrogate and final) outcomes, economic evaluations and non-interventional technologies. Surrogate and final outcome trials were matched on patient population, intervention, journal and year of publication. In this preliminary analysis we compare the two groups of trials based on the statistical significance and direction of their outcome results.

Results

Of the 639 citations identified by our searches, we included 138 trials that used a primary surrogate outcome (‘surrogate trials’) and 132 trials that used a final patient-relevant outcomes (‘final trials’). Table 1 summarises the trial characteristics used for matching. Other trial characteristics also appeared to be well balanced except for the length of follow-up (i.e. more studies with follow up <30 days and >1 year for final trials).

Table 1 Characteristics of included surrogate and final trials.
Table 2 Comparison of outcome results.

Conclusions

This preliminary analysis supports our initial hypothesis that the use of surrogate outcomes is more likely to lead statistically significant treatment effects than patient-relevant primary outcomes. We are currently undertaking additional analysis using actual effect sizes in meta-analytic/meta-regression framework. These results have important implications for payers faced with making coverage decisions on the effectiveness and cost-effectiveness of new treatments based on surrogate rather than final clinical trials data.

References

  1. 1.

    Elston J, Taylor RS: Use of surrogate outcomes in cost-effectiveness models: A review of United Kingdom health technology assessment reports. Int J Technol Assess Health Care. 2009, 25: 6-13. 10.1017/S0266462309090023.

  2. 2.

    la Cour JL, Brok J, Gøtzsche PC: Inconsistent reporting of surrogate outcomes in randomised clinical trials: cohort study. BMJ. 2010, 341: c3653-10.1136/bmj.c3653.

  3. 3.

    Temple RJ: A regulatory authority’s opinion about surrogate endpoints. Clinical Measurement in Drug Evaluation. Edited by: Nimmo WS, Tucker GT. 1995, New York: John Wiley and Sons Inc, 3-22.

Download references

Acknowledgements

We thank Toby Pavey for the assistance in data checking and professor Peter Gøtzsche and co-authors who kindly provided access to the data files of their study.

Ciani O. is currently in receipt of a Peninsula College of Medicine and Dentistry PhD studentship.

Author information

Correspondence to Oriana Ciani.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Ciani, O., Taylor, R.S. Treatment effect bias in randomised controlled trials using surrogate outcomes: a preliminary cohort study analysis. Trials 12, A73 (2011) doi:10.1186/1745-6215-12-S1-A73

Download citation

Keywords

  • Treatment Effect
  • Economic Evaluation
  • Final Outcome
  • Clinical Trial Data
  • Significant Treatment Effect

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.