Skip to main content

Advertisement

Identifying the participant characteristics that predict recruitment and retention of participants to randomised controlled trials involving children: a systematic review

Article metrics

Abstract

Background

Randomised controlled trials (RCTs) are recommended as the ‘gold standard’ in evaluating health care interventions. The conduct of RCTs is often impacted by difficulties surrounding recruitment and retention of participants in both adult and child populations. Factors influencing recruitment and retention of children to RCTs can be more complex than in adults. There is little synthesised evidence of what influences participation in research involving parents and children.

Aim

To identify predictors of recruitment and retention in RCTs involving children.

Methods

A systematic review of RCTs was conducted to synthesise the available evidence. An electronic search strategy was applied to four databases and restricted to English language publications. Quantitative studies reporting participant predictors of recruitment and retention in RCTs involving children aged 0–12 were identified. Data was extracted and synthesised narratively. Quality assessment of articles was conducted using a structured tool developed from two existing quality evaluation checklists.

Results

Twenty-eight studies were included in the review. Of the 154 participant factors reported, 66 were found to be significant predictors of recruitment and retention in at least one study. These were classified as parent, child, family and neighbourhood characteristics. Parent characteristics (e.g. ethnicity, age, education, socioeconomic status (SES)) were the most commonly reported predictors of participation for both recruitment and retention. Being young, less educated, of an ethnic minority and having low SES appear to be barriers to participation in RCTs although there was little agreement between studies. When analysed according to setting and severity of the child’s illness there appeared to be little variation between groups. The quality of the studies varied. Articles adhered well to reporting guidelines around provision of a scientific rationale for the study and background information as well as displaying good internal consistency of results. However, few studies discussed the external validity of the results or provided recommendations for future research.

Conclusion

Parent characteristics may predict participation of children and their families to RCTs; however, there was a lack of consensus. Whilst sociodemographic variables may be useful in identifying which groups are least likely to participate they do not provide insight into the processes and barriers to participation for children and families. Further studies that explore variables that can be influenced are warranted. Reporting of studies in this field need greater clarity as well as agreed definitions of what is meant by retention.

Background

Randomised controlled trials (RCTs) are generally recognised as the ‘gold standard’ in evaluating the effectiveness of health care interventions [1]. However, the reliability of results can be compromised when non-random subsets of participants who enrol or remain on a study are significantly different from those who choose not to take part or subsequently drop out [2].

Difficulties surrounding the recruitment and retention of participants in RCTs are well documented [3], and many clinical trials are stopped or extended due to issues surrounding recruitment and retention [4]. A review of RCTs based on recruitment methods carried out in 2006 reported that up to 60 % of RCTs either fail to meet their recruitment targets or request extensions due to delayed recruitment [5]. Similarly, reviews of UK-based trials have found that less than 31 % of publicly funded trials in the UK achieved their original recruitment target between 2002 and 2008 [3].

Previous studies have suggested that a greater understanding of who is more likely to decline trial participation could help to identify factors that are amenable to change and provide solutions for improving recruitment and retention [6]. Furthermore, findings from studies that successfully predict which participants are less likely to participate could also be used to develop screening tools enabling researchers to provide additional support to target populations [7].

Whilst participation in RCTs in adult populations is known to be influenced by the characteristics and beliefs of the participant and their families, in child-focussed studies where the child is old enough to assent to their participation, more complex factors are involved. Parent, family and child characteristics can be important in determining whether the family choose to participate. Decision-making on behalf of a child is recognised to be a different experience to the adult making a decision for themselves [8, 9]. Thus, trials involving children and families can potentially have a greater number of complexities influencing recruitment and retention than adult populations [7]. Research into the reasons for participation and non-participation in child-focussed RCTs therefore warrants investigation separate to adult populations. Despite this, the majority of studies into recruitment and retention in RCTs are focussed on adult populations [10, 11].

It is commonly accepted that ethnic minority, lower socioeconomic status (SES), low income or poorly educated groups are less likely to take part in research and are, therefore, traditionally underrepresented [1215]. These assumptions appear to be based on common findings from the analysis of single trial datasets. The literature suggests that whilst many individual studies have analysed data on participants who chose to participate against those who did not from within their own sample, very few studies have synthesised data from a range of trial datasets.

A previous systematic review of predictors to participation in cancer clinical trials, found that older age, lower SES and ethnic minority status most commonly predicted non-participation in the 65 studies included [16]. This review included four articles on adolescents or children, all finding that parental influence was an important factor. There is, however, a lack of evidence synthesis in this area regarding a wider range of types of clinical trials. The main aim of this systematic review was to identify the predictors of recruitment and retention in a range of types of RCTs involving children.

This review will be reported in line with the PRISMA guidelines for the reporting of systematic reviews [17] (see Additional file 1).

Methods

Search strategy and data extraction

An electronic search was carried out in MEDLINE, PsychINFO, CINAHL and the Cochrane Library (see Additional file 2). Citation searching of all ‘included’ and ‘unclear’ papers put forward after the title and abstract screening phase was conducted using the Web of Knowledge. In addition the reference section of each of the aforementioned papers was searched for further papers to include in the review. One reviewer (LR) screened titles and abstracts of all retrieved articles against the inclusion and exclusion criteria. Articles that were classified as ‘include’ or ‘unclear’ were carried forward to the next stage of screening where full-text papers were obtained. If it was evident that papers did not meet the inclusion criteria they were classified as ‘exclude’ and full-text articles were not obtained. Any uncertainties were classified as ‘unclear’ to avoid bias due to one author screening at this stage. Full-text screening was conducted by LR against the inclusion and exclusion criteria. ‘Unclear’ papers were independently reviewed by PA after the full-text screening phase. Data extraction was undertaken independently by two reviewers (LR and PA). Due to the diversity of studies and outcomes included in the articles within this review, a traditional quality assessment tool was difficult to adapt to the assessment of studies; therefore, a tool was specifically developed for this review (Additional file 2), adapted from two existing checklists [18, 19]. Each item on the 14-point checklist was scored 0–2 (0 = inadequate description, 1 = fair description, 2 = adequate description). Each paper was then given a percentage quality score (based on points attained out of total points available). The use of a 3-point rating scale was based on methods used in similar studies [16, 20].

Study selection

Quantitative, peer-reviewed, English language studies were included if they investigated for empirical predictors of recruitment and/or retention of children to RCTs. For the purpose of this review children were defined as 0 years (birth) to 12 years (study intervention finishes before the child’s 13th birthday), this avoided possible confounding factors associated with children starting high school and, therefore, having more control over their own decision to take part [21]. For the purpose of this review, recruitment was defined as being randomised onto a study and, therefore, the participant had enrolled. Papers comparing participants who were randomised with those who chose not to be randomised were eligible for inclusion in the review. Retention was defined as a measure of whether participants remained in the study for final outcome assessment. Papers were eligible for inclusion if they had a clear definition of participants who withdrew (e.g. were withdrawn due to protocol non-compliance or chose to withdraw) and compared the characteristics of these participants to participants who remained in the study (did not withdraw or were not withdrawn from the study due to protocol non-compliance). Hypothetical trials, qualitative studies and articles without a clear definition of recruitment or retention, e.g. papers that measured engagement/participation were excluded from this review. No other exclusion criteria were applied.

Studies were categorised into medical (i.e. involving patients, or children who had received a diagnosis) or non-medical (i.e. children who were otherwise classified as healthy, including those who had been identified as ‘at risk’).

Statistical analysis

The most frequently reported variables across the included studies were considered for meta-analysis using adjusted odds ratios of recruitment and/or retention as the outcome variables. Unfortunately, due to the heterogeneity in scales and measures it was not possible to conduct a meta-analysis on any of the sociodemographic variables identified in this review.

Results

Description of included studies

A flow diagram of the screening process is presented in Fig. 1. The database search, full-paper reference and citation searches of included papers resulted in 2275 papers, 590 of which were duplicates. One thousand five hundred and three papers were excluded through screening of titles and abstracts; full-paper articles were obtained for the 75 ‘include’ and 105 ‘unclear’ for full-paper screening. The most frequent reason for exclusion after full-text screening was the study design not being an RCT and/or the intervention did not focus on children aged 0–12 years.

Fig. 1
figure1

Flow diagram of phases of systematic review

Twenty-eight studies met the inclusion criteria [2249]. This gave a total of 12,504 participants being assessed for factors predictive of their participation across the 28 RCTs. Eleven studies were specifically concerned with prediction of recruitment of participants to RCTs. Eleven studies focussed on retention of participants and six studies examined predictors of both recruitment and retention to an RCT.

Of the 28 included studies, 23 RCTs were randomised at an individual level (including one crossover trial) and the remaining five studies were cluster trials. The articles reported on recruitment and retention in numerous settings including home visits, university clinics, hospitals and schools. Twelve of the studies were community-based, 11 were located in a health setting and three were carried out between community and healthcare settings (with information on setting unavailable for two studies).

The majority of articles were conducted in the US and published in 2000 or later, only four studies were published prior to this. The RCTs covered a wide range of medical conditions differing in severity from children with cystic fibrosis [36] to a nutrition-focussed prevention programme for first-time mothers [30]. Twelve studies were classified as medical in their focus, whilst the remaining 16 fell into the non-medical category. The study characteristics are summarised in Table 1.

Table 1 Summary of study characteristics

Predictor variables

A total of 155 participant factors were analysed across the 28 papers; there was considerable variation between articles in the variables that were tested for their significance to predict recruitment and retention. Most papers included an analysis of sociodemographic variables alongside treatment/condition-specific variables. Whilst the majority of studies included condition-specific (e.g. asthma severity [48], parent stress [24]) predictors of participation in their analysis, the variation in measures used was considerable, even for studies within the same field. Heterogeneity, therefore, precluded any meta-analysis.

Participant factors were classified into four categories: (1) parent characteristics, (2) child characteristics, (3) family characteristics, and (4) neighbourhood characteristics. Of the 155 variables reported, 45 parent, 19 child, 4 family and 2 neighbourhood variables were found to be significant predictors of recruitment and retention to RCTs involving children and families in at least one study. Nine parent, two child, two family and two neighbourhood characteristics were recurrent across the included papers and were analysed. The 15 recurrent predictors are presented in Table 2 (recruitment-focussed studies) and Table 3 (retention-focussed studies) and will be discussed hereon.

Table 2 Recruitment studies – summary of predictors
Table 3 Retention studies – summary of predictors

Parent characteristics

Parent characteristics were the most common factors assessed for significance to predict recruitment and retention in RCTs; 88 parent-related predictors were included in the analyses. Nine parent characteristics were frequently assessed across the 28 studies; these were ethnicity (n = 17 studies), parent education (n = 16 studies), parent age (n = 16 studies), income (n = 10 studies), SES and parental depression (n = 9 studies), single parent status (n = 8 studies), marital status (n = 6 studies) and employment (n = 5 studies).

Ethnicity

Ethnicity was found to be a significant predictor of recruitment in six of the 12 studies where this variable was included. Ethnic minorities were less likely to enrol in five of the six studies that found it to be a significant predictor [23, 25, 31, 36, 49]. Constantine et al. [26] reported that ‘Blacks and Hispanics’ were more likely to enrol than ‘Whites and Others’ in their home visits for a low-birth-weight children trial based in the US. This finding, however, appears to represent confound due to the offer of free, long-term medical follow-up in a population that were less likely to have guaranteed care [26]. Six studies analysed ethnicity but did not find it to be a significant predictor. The majority of recruitment studies that found ethnicity to be a significant predictor were non-medical, only one of the six studies was in a medical intervention. Two of the studies were community-based, two were in a health-care setting and two were delivered across both settings.

Ethnicity was analysed in eight retention studies; for example, in one of the included studies Winslow et al. [47] reported that ethnic minorities were more likely to remain in their mixed setting (health- and community-based) parenting intervention for divorced mothers and Ramos-Gomez et al. [42] reported that Mexican Americans were more likely to remain on their practice-based dental prevention trial than other Hispanic or non-Hispanic populations. Six other studies found that ethnicity was not a significant predictor of retention in their samples.

Education

A measure of parent/caregiver education was included in seven of the recruitment trials and was found to be a significant predictor in four of these studies. Whilst the studies measured different levels of education including college [25], high school [28], university [30] and tertiary education [39] all four articles report that recruitment was predicted by higher educational attainment of parents. Two of the four studies were community-based non-medical interventions; the other two were a community-based medical and a health setting-based non-medical intervention, respectively.

Education was the most frequently examined variable in relation to retention; however, retention was only reported to be significantly impacted by higher levels of education in 6 of the 13 retention articles [26, 30, 33, 45, 47, 48]. Studies that found education to be a significant predictor of retention showed no preference for setting; however, four of the studies were non-medical interventions and two were medical.

Socioeconomic status

Indicators of SES varied, with no common measure being used between studies. Lower SES predicted non-participation of families in four of the five recruitment studies [23, 31, 35, 49], all of these were non-medical intervention RCTs, one being based in a health setting. Only one trial did not find SES to be a significant predictor of recruitment, this was of a medical intervention tested in a health care setting.

Two studies [22, 32] both found that low SES predicted drop out from their studies, two other studies found SES to be a non-significant predictor of retention. All four studies that reported SES were medical intervention studies, three were conducted in a health care setting, one setting was unclear.

Income

Some studies reported parent’s ‘income’ in the place of SES; one study [31] reported both as separate variables. Eisner and Meidert [31] found that children from dual-earner families were less likely to enrol to their trial whereas mother’s income was positively correlated with enrolment in the Winslow et al. [47] parenting intervention for divorced families. Both studies were non-medical interventions, the former was based in a health care setting with the latter being split between a health setting and the participant’s home. Three trials found that income had no impact on enrolment.

Similarly, three retention studies that investigated parent income found that higher household income parents were more likely to remain participants on their RCTs; however, a further four studies found that this was not a significant predictor of retention. There appeared to be no relationship between significance of income and setting or intervention type.

Age

Six studies analysed the impact of parent age on recruitment; three of the studies found that older parents were more likely to enrol. Three studies (all community-based) concluded that parent age had no impact on recruitment.

Twelve studies investigated parent age in relation to retention of participants; the majority found this to be a non-significant predictor of drop out; however, in the five studies that reported age as significant predictor, older parents were more likely to remain on the trial; these studies showed no predilection to setting or health status.

Other parent characteristics

Parental depression was investigated in relation to recruitment in four studies, with two finding that higher levels of depression correlated with an increased likelihood of enrolment; whereas two studies found that depression had no impact on recruitment rates. Five studies analysed parental depression in relation to retention, Moser et al. [41] concluded that parents with higher levels of depression were more likely to drop out of their trial regarding infants at risk of cardiopulmonary arrest; similarly, parents who showed higher levels of depression were more likely to withdraw from a trial delivering parent-child interaction therapy [46]. However, a further three studies found no relationship between depression and retention.

The impact of being a single parent was investigated in relation to recruitment in two parent training intervention trials; whilst Cunningham et al. [28] found that single parents were less likely to enrol, Heinrichs et al. [35] reported that it increased the likelihood of enrolment. Three studies found no impact on recruitment. Only one [43] of the three studies that measured retention of participants found that single mothers were more likely to drop out of the research.

One study into recruitment found that mothers who were married were more likely to enrol in a community-based, infant-feeding intervention trial, but that marital status had no impact on retention of their participants [30]. Similarly, one retention-focussed study found that parents in partnered relationships were significantly more likely to drop out of the prevention programme trial than parents who were married, single or foster parents [34]. Conversely, two non-community-based recruitment studies and three retention studies found marital status to have no impact on retention.

The final predictor commonly tested across studies was parent employment. Employment status was examined in two recruitment and four retention studies but was not found to be a significant predictor on the recruitment or retention of the RCT participants.

Child characteristics

Child characteristics were less frequently reported for significance than their parents’; 56 variables were analysed across the studies; however, the majority of these variables were condition-specific and, therefore, found only in a small number of studies. The two most frequently tested variables were child age (n = 7 studies) and child gender (n = 10 studies).

Child age

Age of the child was examined in three recruitment studies but found to have no impact on rates of enrolment. Younger children were significantly more likely to drop out of the sample of 5–9 year-old children enrolled onto a behavioural parent-training programme [33]; the same was true in a sample of children and parents enrolled onto a home visit programme [43]. However, child age had no impact on retention of participants in two other studies in the review.

Child gender

Parents of boys were more likely to enrol onto parenting courses in one study [28] but had no impact on recruitment in the other studies that analysed the variable. Firestone and Witt [33] found that girls were more likely to withdraw from their hospital-based trial with hyperactive children, whereas Roggman et al. [43] found that boys were more likely to drop out of their home visit programme early. Two trials found that child gender had no impact on retention of participants.

Family characteristics

Analysis of family variables was also less common; the two commonly assessed factors were number of children in the family/home (n = 3 studies) and number of people in the family (n = 4 studies). Only one study that investigated characteristics of the family found an impact: Katz et al. [37] found that mothers with more children were more likely to drop out than mothers with fewer children.

Neighbourhood characteristics

Whilst identified as a separate category, neighbourhood factors were only investigated in two of the included studies. Eisner and Meidert [31] found that a greater density of neighbourhood networks predicted recruitment; however, theirs was the only study to investigate this variable. Similarly, neighbourhood high school drop out was a significant predictor of recruitment in the one study that analysed it.

Quality assessment

Results of the quality assessment of the 28 studies are presented in Table 4. The quality of papers ranged from 89 to 46 %. Whilst the majority of papers gave a detailed background and scientific rationale, fewer papers outlined clear objectives and hypotheses for the research (n = 11 included a hypothesis).

Table 4 Quality assessment of articles (adapted from Durant [19] and von Elm et al. [18])

Most papers gave sufficient detail on the trial from which data originated to understand the study design, populations and settings; however, two of the studies [45, 46] did not include sufficient detail for the reader to understand the nature of the trial. Similarly, three of the 26 studies did not detail the intervention, including length of exposure to the intervention. All of the studies were judged to have provided an objective account, with sufficient detail and explanation of the method of analysis and results for the reader to have a sound understanding and judge the results for themselves. None of the included studies raised concern regarding the internal consistency of the findings. It was felt that three of the included studies [23, 35, 36] did not present findings in clear tables. Heinrichs et al. [35] conducted logistic regression including a number of sociodemographic variables and parent/family characteristics but did not present the results. Similarly, Baker et al. [23] conducted statistical analysis including chi-square tests, t tests and logistic regression analysis; however, results of tests are only reported in free text and are difficult to comprehend as a consequence. In some instances it was difficult to extract results including one [26] that only reported significant predictors and did not present results for non-significant predictors; similarly, Aylward [22] did not report results of the statistical analysis for the full range of predictors. This made it difficult to compile results during data extraction as it was not clear whether predictors not reported were not statistically significant or were not included in the testing. In six of the 26 studies the authors provided no detail on whether it was necessary to control for confounding variables during analysis. In such cases, studies were scored ‘0’. Only seven of the studies gave detailed recommendations for future research, whilst only six of the 28 included studies discussed the external validity of their findings.

Discussion

This systematic review of 28 RCTs has identified several significant predictors of recruitment and retention for children and their families. A wide range of parent, child, family and neighbourhood factors have been identified to predict recruitment and retention; of the 154 variables included in analyses, 66 were found to be significant in at least one study. Parent characteristics were the most commonly assessed characteristics. Given their involvement in the decision-making and informed consent process in this age group, this finding was to be expected.

Parental ethnicity was a commonly reported predictor of recruitment and retention in the RCTs, and supports findings from a previous review focussed on adult RCT recruitment and retention where ethnic minority groups were found to be less likely to agree to participate in trials [16]. The literature reports specific reasons for ethnic minorities being excluded from research as mistrust due to events in history [5052], language needs or discrimination [23], suspicion of intervention providers and perceived racism and stigmatisation [47]. Efforts to address the inclusion of minority groups in RCTs is evident in US policy, where, since the introduction of the National Institute of Health Revitalisation Act in 1993, increased efforts have been employed to involve minorities in research including ethnic minority populations [16, 53]. These measures prevent unequal distributions of the risks and benefits of trial participation, whilst also ensuring that findings are relevant to underrepresented populations [16]. The findings of this review could indicate that such measures are still required for research involving families and children as ethnic minorities appear to be less likely to enrol in RCTs than non-minority ethnic groups. However, whilst ethnicity was a significant predictor in six recruitment studies, a further seven investigated ethnicity but did not find an association and it is, therefore, not possible to generalise this finding to all RCTs.

The relationship between SES and ethnicity, within both adult and child populations, is widely accepted to be closely correlated; with arguments put forward that they should no longer be seen as discrete variables because ethnicity interacts with, and is confounded by, social class or SES [54]. Most of the studies included in this review acknowledge the difficulties in separating SES and ethnicity. Whilst some identified the confounding effect of the two variables, not all studies evidenced that this was controlled for during analysis and it is, therefore, possible that there is shared variance in the predictive value of the interaction between two factors in the same study. The context of the study should also be considered when interpreting the results on the impact of ethnicity and SES on recruitment and retention. Ethnicity represents a complex issue relating to a range of particular cultural values and perspectives, which will be confounded by the country in which the RCT was conducted. Further research to identify particular groups at risk of non-participation within specific contexts would, therefore, be warranted.

Within this review four of the five recruitment studies and two of the four retention studies that investigated SES as a variable, identified lower SES as a significant predictor of participation in RCTs. Many authors outside of this review have suggested why minority SES status predicts non-participation in research studies. Explanations focus on the demands placed on families in lower SES categories and their having less time to devote to research given that they are struggling with immediate problems such as childcare and insufficient financial support [55], lack of time or family commitments [23], and fewer resources for daycare and transport [50]. Parents facing these challenges may have different priorities to families with fewer challenges and may be deterred from participating as a result. Families with higher levels of stress due to factors such as access to childcare, low income and single parent status are more at risk of lack of regular routine, interfering with participation of regular trial appointments, as was observed in the Roggman et al. [43] home visit programme. Non-participation of these groups could lead to non-representative results and recommendations for family interventions that are unsuitable for low SES groups, and strategies to facilitate participation are, therefore, required.

Parent income was analysed in ten studies within this review; however, only one of these also had a separate measure of SES [31]. SES is commonly a combined measure of income, education and occupation and the results for income and SES are, therefore, likely to be linked. In this review, higher income seemed to predict participation in some studies and, therefore, fits with the SES trend discussed above. The studies hypothesised that low-income families are more likely to face the problems linked to SES, i.e. problems with childcare, lack of transportation, less regular work schedules [47] and more challenges than affluent families [45]. In contrast, employment, commonly used in SES calculation, showed no impact on recruitment or retention in any of the five studies that analysed it.

Higher level of parental education was also found to be positively correlated with increased recruitment and retention in 11 studies. Explanations for this finding from within this review suggest that parents with less education may have a lack of interest due to non-comprehension of the goals and how research is conducted [39]. Other researchers [47] argue that higher-educated parents may value education and research more, and their occupations may allow greater flexibility and control over their work schedules to attend appointments than employed parents with lower educational attainment. Similarly, a qualitative vaccine research study found that parents’ decision-making was impacted by how much experience a parent has in science and medicine, and therefore those with experience of research through education would be more likely to take part [56]. Studies have also suggested that less educated parents may not fully understand the altruistic value of research [57] and are, therefore, less likely to take part if they do not perceive it to be relevant to them.

Evidence from the trials included in this review suggests that older parents are more likely to enrol and remain on trials with their children. The specific reason for age being a predictor of participation is less well documented than the other variables and would, therefore, warrant further investigation in future studies. The impact of being a younger parent was investigated in one study that suggested that the older parents in a behaviour study may have tried everything else and, therefore, saw more value in remaining in the research or were ‘desperate’ for help [33]. The other three retention studies that found this predictor significant provided little explanation for the finding; however, reasons could be linked to different priorities between younger and older parents or that being younger, with lower income or being a single parent is indicative of higher levels of stress and differing priorities because of this [43].

The findings on parental depression were less conclusive, with conflicting results between studies. Similarly, the impact of marital status and single parenthood were difficult to interpret due to contradictory effects and non-significant results. Despite the relative lack of involvement from children in the decision-making process at this age, child characteristics were also frequently tested for their ability to predict recruitment and retention. The majority of child variables were condition-specific clinical variables; however, age and gender were common across a range of studies and allowed some comparison. The relatively small number of studies and disagreement between studies also made it difficult to draw conclusions on the impact of these variables.

An original objective of this review was to investigate the impact of study setting and child health-status. The relatively low number of studies that analysed each variable, and the presence of non-significant findings made it difficult to draw firm conclusions on these study-level variables and would warrant further investigation in future research.

Implications for future research

The quality assessment highlighted differences in reporting standards across studies that predict recruitment and retention of participants in RCTs. How results were reported differed across studies, with some studies excluding non-significant predictors from their results and other ambiguous exclusions making results difficult to draw conclusions from. Additionally, 17 different definitions of ‘retention’ were identified across the studies. The findings of this study highlight the need for standardised reporting for future studies that report predictors of recruitment and retention. Research in this area would benefit from agreed common predictors and standardised variables (relevant to their field), as well as clearer definitions of recruitment and retention. Standardised definitions and consistency in reporting would allow ease of comparison between studies.

This study suggests that the groups commonly identified as at risk of poor recruitment and retention in RCTs involving children are analogous with studies aimed at adults. Several recruitment and retention strategies have been identified as successful in systematic reviews; however, the focus has been on adult populations [15, 5860] or disease-specific areas of children’s research [61, 62]. Such techniques may be transferrable to child-focussed RCTs; however, research into transferability and effectiveness within specific health areas would be warranted.

Limitations

One limitation is the wide range of studies compared. Whilst also being a strength of the review, the broad number of health topics, settings and intervention types could limit the validity of findings due to the range of possible confounding factors. Whilst effort was made to compare commonly used predictors across the studies to ensure consistency and comparability, there was variation within these due to the measures, data collection methods and analysis not being consistent across the 28 included papers. Most notably indicators and analysis of SES varied, with some studies using parent income as an indicator of SES whilst other studies treated this as a discrete variable. As addressed previously, whilst SES was controlled as a confounding variable in some analyses, this was not true in all papers. The authors recognise that SES may be confounded by other variables, for example parent’s education and income, but a discussion of the impact is outside the scope of this article.

The method used for quality assessments of the included studies is not standardised due to the lack of suitable tool availability. The STROBE checklist from which part of the tool was adapted is not recommended for use as a quality assessment tool but was deemed suitable due to the lack of an alternative.

A further drawback, which highlights a wider issue within this field, is the origin of studies, predominantly based in the US, Canada and Europe. Whilst geographical setting was not an exclusion criteria, this review did not identify any studies from lower-income countries. The validity of findings to non-Caucasian dominated populations is, therefore, confined by this limitation. Similarly, the exclusion of non-English language papers could also limit the findings of this study. However, no full-text articles were excluded for this reason and the impact is, therefore, minimal.

Conclusion

This review found that the commonly assessed predictors of recruitment and retention can be categorised into parent characteristics, child characteristics, family characteristics and neighbourhood characteristics. The most commonly assessed variables were related to the parent. It would appear that younger, less educated parents from ethnic minorities and low SES groups are least likely to participate in RCTs; however, these variables were also found to be non-significant predictors in multiple studies in this review. There is no conclusive evidence to suggest that any one parent, child, family or neighbourhood characteristic can be used to predict recruitment or retention of children and their families to all RCTs. The predictors should, therefore, be treated with caution.

Similarly, the review has identified some predictors that are more commonly significant in different settings and health statuses; however, the presence of similar non-significant findings prevent clear conclusions from being drawn.

The common variables discussed within this review are difficult for the researcher to influence, and there is little in the way of understanding on how recruitment and retention strategies can be applied to the groups that are most at risk of non-participation, particularly as the majority of work in this field has been conducted in adults and the applicability of strategies with children and families is under explored. Further research into the actual barriers and processes would, therefore, be beneficial alongside investigation into what recruitment and retention strategies are most effective in this population. Qualitative methods could be utilised for an in-depth exploration of the barriers and facilitators with existing trial populations. Further investigation into study level variables would provide further insight into the impact of study setting and health status/intervention type on the predictors of recruitment and retention.

Reporting of studies in this field would benefit from greater clarity as well as agreed definitions of what is meant by retention.

Abbreviations

RCT, randomised controlled trial; SES, socioeconomic status

References

  1. 1.

    Akobeng A. Understanding randomised controlled trials. Arch Dis Child. 2005;90(8):840–4.

  2. 2.

    Karlson CW, Rapoff MA. Attrition in randomized controlled trials for pediatric chronic conditions. J Pediatr Psychol. 2009;34(7):782–93.

  3. 3.

    McDonald AM, Knight RC, Campbell MK, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7(1):9.

  4. 4.

    Tooher RL, Middleton PF, Crowther CA. A thematic analysis of factors influencing recruitment to maternal and perinatal trials. BMC Pregnancy Childbirth. 2008;8(100967799):36.

  5. 5.

    Watson JM, Torgerson DJ. Increasing recruitment to randomised trials: a review of randomised controlled trials. BMC Med Res Methodol. 2006;6:34.

  6. 6.

    Brintnall-Karabelas J, Sung S, Cadman ME, Squires C, Whorton K. Improving recruitment in clinical trials: why eligible participants decline. J Empir Res Hum Res Ethics. 2011;6(1):69.

  7. 7.

    Driscoll K, Killian M, Johnson S, Silverstein J, Deeb L. Predictors of study completion and withdrawal in a randomized clinical trial of a pediatric diabetes adherence intervention. Contemp Clin Trials. 2009;30(101242342):212–20.

  8. 8.

    Shilling V, Young B. How do parents experience being asked to enter a child in a randomised controlled trial? BMC Med Ethics. 2009;10(1):1.

  9. 9.

    Caldwell PH, Butow PN, Craig JC. Parents’ attitudes to children’s participation in randomized controlled trials. J Pediatr. 2003;142(5):554–9.

  10. 10.

    Eiser C, Davies H, Jenney M, Glaser A. Mothers’ attitudes to the randomized controlled trial (RCT): the case of acute lymphoblastic leukaemia (ALL) in children. Child Care Health Dev. 2005;31(5):517–23.

  11. 11.

    Shilling V, Williamson PR, Hickey H, Sowden E, Beresford MW, Smyth RL, et al. Communication about children's clinical trials as observed and experienced: qualitative study of parents and practitioners. PLoS One. 2011;6(7):e21604.

  12. 12.

    Gul RB, Ali PA. Clinical trials: the challenge of recruitment and retention of participants. J Clin Nurs. 2010;19(1–2):227–33.

  13. 13.

    Cox K, McGarry J. Why patients don’t take part in cancer clinical trials: an overview of the literature. Eur J Cancer Care (Engl). 2003;12(2):114–22.

  14. 14.

    Patel MX, Doku V, Tennakoon L. Challenges in recruitment of research participants. Adv Psychiatr Treat. 2003;9(3):229–38.

  15. 15.

    Davis LL, Broome ME, Cox RP. Maximizing retention in community-based clinical trials. J Nurs Scholarsh. 2002;34(1):47–53.

  16. 16.

    Ford JG, Howerton MW, Lai GY, et al. Barriers to recruiting underrepresented populations to cancer clinical trials: a systematic review. Cancer. 2008;112(2):228–42.

  17. 17.

    Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9.

  18. 18.

    von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Prev Med. 2007;45(4):247–51.

  19. 19.

    Durant RH. Checklist for the evaluation of research articles. J Adolesc Health. 1994;15(1):4–8.

  20. 20.

    Thomas B, Ciliska D, Dobbins M, Micucci S. A process for systematically reviewing the literature: providing the research evidence for public health nursing interventions. Worldviews Evid-Based Nurs. 2004;1(3):176–84.

  21. 21.

    Mann L, Harmoni R, Power C. Adolescent decision-making: the development of competence. J Adolesc. 1989;12(3):265–78.

  22. 22.

    Aylward PH, Hatcher RP, Stripp B, Gustafson NF, Leavitt LA. Who goes and who stays: subject loss in a multicenter, longitudinal follow-up study. J Dev Behav Pediatr. 1985;6(1):3–8.

  23. 23.

    Baker CN, Arnold DH, Meagher S. Enrollment and attendance in a parent training prevention program for conduct problems. Prev Sci. 2011;12(2):126–38.

  24. 24.

    Boggs SR, Eyberg SM, Edwards DL, Rayfield A, Jacobs J, Bagner D, et al. Outcomes of parent-child interaction therapy: a comparison of treatment completers and study dropouts one to three years later. Child Family Behav Ther. 2004;26(4):1–22.

  25. 25.

    Byrnes H, Miller B, Aalborg A, Keagy C. The relationship between neighborhood characteristics and recruitment into adolescent family-based substance use prevention programs. J Behav Health Serv Res. 2012;39(2):174–89.

  26. 26.

    Constantine WL, Haynes CW, Spiker D, Kendall-Tackett K, Constantine NA. Recruitment and retention in a clinical trial for low birth weight, premature infants. J Dev Behav Pediatr. 1993;14:1–7.

  27. 27.

    Cunningham CE, Bremner R, Boyle M. Large group community based parenting programs for families of preschoolers at risk for disruptive behaviour disorders: utilization, cost effectiveness, and outcome. J Child Psychol Psychiatry. 1995;36(7):1141–59.

  28. 28.

    Cunningham CE, Boyle M, Offord D, Racine Y, Hundert J, Secord M, et al. Tri-ministry study: correlates of school-based parenting course utilization. J Consult Clin Psychol. 2000;68(5):928.

  29. 29.

    Damashek A, Doughty D, Ware L, Silovsky J. Predictors of client engagement and attrition in home-based child maltreatment prevention services. Child Maltreat. 2011;16(dw4, 9602869):9–20.

  30. 30.

    Daniels LA, Wilson JL, Mallan KM, Mihrshahi S, Perry R, Nicholson JM, et al. Recruiting and engaging new mothers in nutrition research studies: lessons from the Australian NOURISH randomised controlled trial. Int J Behav Nutr Phys Act. 2012;9:129.

  31. 31.

    Eisner M, Meidert U. Stages of parental engagement in a universal parent training program. J Prim Prev. 2011;32(2):83–93.

  32. 32.

    Fernandez MA, Eyberg SM. Predicting treatment and follow-up attrition in parent-child interaction therapy. J Abnorm Child Psycho. 2009;37(0364547, h33):431–41.

  33. 33.

    Firestone P, Witt JE. Characteristics of families completing and prematurely discontinuing a behavioral parent-training program. J Pediatr Psychol. 1982;7(2):209–22.

  34. 34.

    Gross D, Julion W, Fogg L. What motivates participation and dropout among low income urban families of color in a prevention intervention?*. Fam Relat. 2001;50(3):246–54.

  35. 35.

    Heinrichs N, Bertram H, Kuschel A, Hahlweg K. Parent recruitment and retention in a universal prevention program for child behavior and emotional problems: barriers to research and program participation. Prev Sci. 2005;6(4):275–86.

  36. 36.

    Ireys H, DeVet K, Chernoff R. Who joins a preventive intervention? How risk status predicts enrollment. 2001, 29(Achenbach, TM. (1991). Manual for the child behavior checklist/4–18 and 1991 profile. Burlington, VT: University of Vermont Department of Psychiatry.):417–427.

  37. 37.

    Katz KS, El-Mohandes PA, Johnson DM, Jarrett PM, Rose A, Cober M. Retention of low income mothers in a parenting intervention study. J Community Health. 2001;26:203–18.

  38. 38.

    Medical Research Council Multicentre Otitis Media Study Group. Surgery for persistent otitis media with effusion: generalizability of results from the UK trial (TARGET). Trial of Alternative Regimens in Glue Ear Treatment. Clin Otolaryngol Allied Sci. 2001;26:417–24.

  39. 39.

    Mihrshahi S, Vukasin N, Forbes S, et al. Are you busy for the next 5 years? Recruitment in the Childhood Asthma Prevention Study (CAPS). Respirology. 2002;7(2):147–51.

  40. 40.

    Miller GE, Prinz RJ. Engagement of families in treatment for childhood conduct problems. Behav Ther. 2003;34(4):517–34.

  41. 41.

    Moser DK, Dracup K, Doering LV. Factors differentiating dropouts from completers in a longitudinal, multicenter clinical trial. Nurs Res. 2000;49:109–16.

  42. 42.

    Ramos-Gomez F, Chung LH, Gonzalez Beristain R, Santo W, Jue B, Weintraub J, et al. Recruiting and retaining pregnant women from a community health center at the US-Mexico border for the Mothers and Youth Access clinical trial. Clin Trials. 2008;5(4):336–46.

  43. 43.

    Roggman LA, Cook GA, Peterson CA, Raikes HH. Who drops out of early head start home visiting programs? Early Educ Dev. 2008;19(4):574–99.

  44. 44.

    Van Den Akker EH, Rovers MM, Van Staaij BK, Hoes AW, Schilder AG. Representativeness of trial populations: an example from a trial of adenotonsillectomy in children. Acta Otolaryngol. 2003;123(2):297–301.

  45. 45.

    Wagner M, Spiker D, Linn MI, Hernandez F. Dimensions of parental engagement in home visiting programs exploratory study. Topics Early Childhood Spec Educ. 2003;23(4):171–87.

  46. 46.

    Werba BE, Eyberg SM, Boggs SR, Algina J. Predicting outcome in parent-child interaction therapy: success and attrition. Behav Modif. 2006;30(5):618–46.

  47. 47.

    Winslow EB, Bonds D, Wolchik S, Sandler I, Braver S. Predictors of enrollment and retention in a preventive parenting intervention for divorced families. J Prim Prev. 2009;30(8213457):151–72.

  48. 48.

    Zebracki K, Drotar D, Kirchner H, Schluchter M, Redline S, Kercsmar C, et al. Predicting attrition in a pediatric asthma intervention study. J Pediatr Psychol. 2003;28(8):519–28.

  49. 49.

    Vermaire JH, van Loveren C, Hoogstraten J. Non-participation in a randomized controlled trial: the effect on clinical and non-clinical variables. Caries Res. 2011;45(3):269–74.

  50. 50.

    Janson SL, Alioto ME, Boushey HA. Attrition and retention of ethnically diverse subjects in a multicenter randomized controlled research trial. Control Clin Trials. 2001;22(6):S236–43.

  51. 51.

    Corbie‐Smith G, Thomas SB, Williams MV, Moody‐Ayers S. Attitudes and beliefs of African Americans toward participation in medical research. J Gen Intern Med. 1999;14(9):537–46.

  52. 52.

    Hussain‐Gambles M, Atkin K, Leese B. Why ethnic minority groups are under-represented in clinical trials: a review of the literature. Health Soc Care Community. 2004;12(5):382–8.

  53. 53.

    Baquet CR, Commiskey P, Daniel Mullins C, Mishra SI. Recruitment and participation in clinical trials: socio-demographic, rural/urban, and health care access predictors. Cancer Detect Prev. 2006;30(1):24–33.

  54. 54.

    Committee on Pediatric Research. Race/ethnicity, gender, socioeconomic status—research exploring their effects on child health: a subject review. Pediatrics. 2000;105(6):1349–51.

  55. 55.

    Garvey C, Julion W, Fogg L, Kratovil A, Gross D. Measuring participation in a prevention trial with parents of young children. Res Nurs Health. 2006;29(3):212–22.

  56. 56.

    Chantler TE, Lees A, Moxon ER, Mant D, Pollard AJ, Fiztpatrick R. The role familiarity with science and medicine plays in parents’ decision making about enrolling a child in vaccine research. Qual Health Res. 2007;17(3):311–22.

  57. 57.

    Sullivan J. Subject recruitment and retention: barriers to success. 2004.

  58. 58.

    Brueton V, Tierney J, Stenning S, Nazareth I, Meredith S, Harding S, Rait G. Strategies to reduce attrition in randomised trials. Trials. 2011;12(Suppl 1):A128.

  59. 59.

    Robinson KA, Dennison CR, Wayman DM, Pronovost PJ, Needham DM. Systematic review identifies number of strategies important for retaining study participants. J Clin Epidemiol. 2007;60(8):757. e751-757. e719.

  60. 60.

    Booker CL, Harding S, Benzeval M. A systematic review of the effect of retention methods in population-based cohort studies. BMC Public Health. 2011;11:249.

  61. 61.

    Cui Z, Seburg EM, Sherwood NE, Faith MS, Ward DS. Recruitment and retention in obesity prevention and treatment trials targeting minority or low-income children: a review of the clinical trials registration database. Trials. 2015;16(1):564.

  62. 62.

    Schoeppe S, Oliver M, Badland HM, Burke M, Duncan MJ. Recruitment and retention of children in behavioral health risk factor studies: REACH strategies. Int J Behav Med. 2014;21(5):794–803.

Download references

Acknowledgements

No authors received specific funding for this work.

Authors’ contributions

LR: conception, data extraction, analysis, and writing of the manuscript. PA: conception, data extraction, and critical revision of the manuscript. MC, RH and GB: interpretation of data and critical revision of the manuscript. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Author information

Correspondence to Louise Robinson.

Additional files

Additional file 1:

PRISMA checklist - recommended items to address in a systematic review. (DOC 63 kb)

Additional file 2:

Search terms and strategy – systematic review database search terms and search strategy. (DOCX 15 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Robinson, L., Adair, P., Coffey, M. et al. Identifying the participant characteristics that predict recruitment and retention of participants to randomised controlled trials involving children: a systematic review. Trials 17, 294 (2016) doi:10.1186/s13063-016-1415-0

Download citation

Keywords

  • Recruitment
  • Retention
  • Randomised controlled trial

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.