Skip to main content


Core outcome set development: the effect of Delphi panel composition and feedback on prioritisation of outcomes

Article metrics

  • 885 Accesses

  • 4 Citations

Delphi methods are common in the development of core sets with panels including patients and healthcare professionals (HCPs) as important key stakeholders. Individuals are provided with feedback between survey rounds but methods for considering different stakeholders' views are lacking. This study explored the influence of randomised stakeholder feedback on responses.

In a survey to develop a core set for oesophageal cancer surgery, 185 patients and 126 HCPs rated 67 items on a scale of 1: not essential to 9: absolutely essential (Round 1). Feedback on each item was provided in Round 2 with participants randomly allocated to 1) patients receiving own-group feedback, 2) patients receiving both patient and HCP feedback, 3) HCPs receiving both patient and HCP feedback and 4) HCPs receiving own-group feedback. "Important" items were defined using a predetermined cut-off (rated 7-9 by >70% of participants). Ratings were summarised as mean scores and differences between randomised groups compared.

147 patients and 107 HCPs completed Round 2. Patients receiving only own-group feedback rated more items as important (Group 1: 20 important items versus Group 2: 18 important items). However, HCPs receiving both-group feedback rated more items as important (Group 3: 21 important items versus Group 4: 16 important items). For individual items, the difference in mean scores between randomised groups was small, although there was a trend for HCPs ratings to be influenced by patient feedback.

Evidence suggests panel composition and the feedback provided may influence results. Researchers should carefully consider these methodological factors when designing a Delphi study.

Author information

Correspondence to Rhiannon Macefield.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Macefield, R., Blencowe, N., Brookes, S. et al. Core outcome set development: the effect of Delphi panel composition and feedback on prioritisation of outcomes. Trials 14, P77 (2013) doi:10.1186/1745-6215-14-S1-P77

Download citation


  • Oesophageal Cancer
  • Randomise Group
  • Delphi Method
  • Delphi Study
  • Core Outcome


By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.