Skip to main content

Aggregated n-of-1 trials of central nervous system stimulants versus placebo for paediatric traumatic brain injury – a pilot study

Abstract

Background

In 2006 there were 432,700 people in Australia who had acquired brain injury (ABI) with some limitation of activities; 90% of these were traumatic brain injuries (TBIs) and nearly a third sustained injury below age 15 years. One to four years post injury, 20% to 46% of children with traumatic brain injury (TBI) have clinically significant disorders of attention. There is controversy as to whether central nervous system (CNS) stimulants can be an effective method of treating these.

Objectives were to determine the efficacy of CNS stimulants for children with TBI, and to calculate the sample size for a larger trial using the Conners’ 3 Parent Rating Scales Score as the primary endpoint.

Methods

Pilot series of aggregated prospective randomised, double-blind, n-of-1 trials of stimulant versus placebo within individual patients. Setting: tertiary children’s public hospital. Participants: ten children aged 6 to 16 years more than 12 months post TBI with attention, concentration and behavioral difficulties on stimulants. Interventions: Three cycles of methylphenidate or dexamphetamine orally at doses titrated by physician compared to placebo. Main Outcome Measures: Conners 3 Parent (Conners 3-P) and Teacher (Conners 3-T) Rating Scales (Global Index), Behaviour Rating Inventory of Executive Function (BRIEF) and Eyberg Child Behaviour Inventory (ECBI).

Results

Five of ten patients completed the study. Data from 18 completed cycles from seven patients were analysed. The posterior mean difference between stimulant and placebo scores for the Conners 3-PS (Global Index) was 2.3 (SD 6.2; 95% credible region -1.0 to 6.1; posterior probability that this mean difference was greater than zero was 0.92), and for the Conners 3-T (Global Index) the posterior mean difference was 5.9 (SD 4.5; 95% credible region -3.1 to 14.9; posterior probability 0.93). Posterior mean differences suggest improvement in behaviour and executive function and a decrease in number and intensity of child behaviour problems when taking stimulants compared to placebo. Taken together these data are suggestive of a small benefit at group level.

Conclusions

In this pilot study, there was sufficient evidence that stimulants may be useful in management of behavioral and cognitive sequelae following TBI, to warrant a larger trial.

Trial registration

he trial was registered with the Australian and New Zealand Clinical Trials Registry: registration number ACTRN12609000873224.

Peer Review reports

Background

In 2006 there were 432,700 people in Australia who had acquired brain injury (ABI) with some limitation of activities; 90% of these were traumatic brain injuries (TBIs) and nearly a third sustained injury below age 15 years [1]. One of the most common sequelae of brain injury is difficulties with attention, concentration and self-regulation [2, 3]. One to four years post injury, 20% to 46% of children with TBI have clinically significant disorders of attention [4, 5]. This has been compared to developmental forms of Attention Deficit Hyperactivity Disorder (ADHD). The term 'secondary ADHD’ was introduced by Gerring et al. [6] to describe significant difficulties with concentration, impulse control and hyperactivity that occur following brain injury, rather than from developmental causes. It has been noted that in those with ABI the pathophysiology is likely to be very different to primary ADHD, and that hyperactivity may be generally less severe [6], with the inattentive subtype predominating in at least the first two years post injury [7, 8]. Another study found that children with TBI and ADHD had worse performance compared with the TBI-only group, on measures of attention, executive functioning, and memory. In children with severe TBI, the behavioral diagnosis of ADHD was associated with more difficulty in attention, executive functioning, and memory. Additionally, greater deficits in memory skills were found in the secondary ADHD group compared with children with premorbid ADHD that persisted after injury [9].

Despite a good body of evidence delineating the sequelae of TBI, there are few validated interventions to remediate cognitive deficits in children following TBI [9]. While central nervous system (CNS) stimulant medication is generally a well-accepted treatment for developmental ADHD, there is controversy as to whether stimulant medication can be an effective method of treating acquired attention deficits. While some studies have reported a positive effect of stimulant medication on attention, concentration and impulsivity post injury (Bakker and Waugh, unpublished data; [10, 11]) and particularly in those with pre-injury ADHD [12], others have reported a null result [13]. However, there are a limited number of studies on the efficacy of CNS stimulants on children following TBI, with a range of methodological issues that may impact on outcomes, including designs varying from case studies to randomised controlled trials (RCTs), limited sample sizes, and variable times since injury, ages at injury, type and doses of stimulant medication, type of data collected (retrospective versus prospective), and qualitative versus quantitative outcome measurement. Two main early studies found contradictory results regarding the efficacy of methylphenidate in treating children with acquired attentional disorders secondary to brain injury. The first was a double-blind, placebo-controlled, cross-over trial in 14 children with varying degrees of head injury. Differences between drug and placebo groups uniformly achieved statistical significance [14]. The second was a double-blind, placebo-controlled, cross-over trial conducted in ten paediatric subjects with TBI ranging from mild to severe. No significant differences between methylphenidate and placebo were found on measures assessing behavior, attention, memory, and processing speed [13]. A 2004 systematic review of stimulant effectiveness in treating attention-deficit/hyperactivity disorder secondary to traumatic brain injury (ADHD/TBI) found that methylphenidate (MPH) effects on behavior (hyperactivity, impulsivity) were evident but were not as robust as those typically observed with MPH in primary ADHD. The effect of MPH on cognition was less apparent. More favorable outcome was associated with initiation of treatment soon after head injury (although this factor was not systematically studied), and trials with relatively long durations [15]. They concluded that there is need for rigorous treatment outcome research among representative samples of ADHD/TBI individuals. A recent systematic review [10] assessed sixteen studies examining the effectiveness of stimulants following paediatric ABI, and concluded that teams treating paediatric ABI need to assess for the presence of inattention and consider the use of stimulants with individualised n-of-1 monitored trials, as stimulants have been used in children with impaired attention and hyperactivity following acquired brain injury (ABI) with positive results.

Bakker and Waugh completed a double-blind placebo-controlled randomised trial of stimulant medication in 21 children with TBI [16, 17] at The Children’s Hospital at Westmead. Of 21 children, 43% of the sample had a positive response to either dexamphetamine (DEX) or methylphenidate (MPH), with 6/10 responding positively to DEX. Most studies describe the use of MPH; [814, 18, 19]. However, other CNS stimulants, such as DEX, may be effective as children may have a differential response [12]. Given contradictory literature findings, and indications of the potential efficacy for individuals, the need for objective measurement on a case by case basis is clear.

n-of-1 trials

n-of-1 trials are multiple-cycle, double-blind, placebo-controlled cross-over trials using standardised measures of effect, with randomisation order independently generated for each patient. They provide the strongest evidence possible about treatment efficacy in an individual patient [20]. This may be particularly important in the ABI population, as there may be positive effects for some individuals ('responders’) as opposed to others ('non-responders’); [11, 13, 16].

The number of children available for many trials is generally smaller than for adult RCTs, making it difficult to achieve a sample with adequate power when undertaking conventional parallel arm RCTs. Aggregated n-of-1 trials are ideally suited to paediatric populations, as the sample size required to achieve adequate power is considerably less [21]. Additionally, individual responses are available for feedback to participants and their carers [21]. As no previous n-of-1 trials have been conducted in this area, this reported series of n-of-1 trials significantly enhances paediatric community rehabilitation knowledge and practice.

Objectives were 1) to determine the efficacy of central nervous system stimulants for children with traumatic brain injury and 2) to determine the effect size using the Conners’ 3 Parent Rating Scales Score as the primary endpoint in this pilot study. This would later be used to calculate the sample size for a larger trial. The main hypothesis was that stimulant therapy compared to placebo would significantly improve attention and concentration, and executive dysfunction including disorders of behavioural and emotional regulation, in children with TBI.

Method

Study design

The full protocol can be accessed at [http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pmc/articles/PMC3668233/].

A summary of the protocol follows.

Each child completed three pairs of one-week treatment periods (placebo versus stimulant medication), making a total of six weeks. To account for 'wash out’, no measure of efficacy was taken on the first two days of each seven-day period. The order of drugs in each cycle was determined by computer-generated random allocation, blinded to clinician, parent, teacher and patient. A computer generated randomisation schedule (random number sequence) created by the study statistician and held by the site pharmacies (and not accessible to investigators) predetermined the order of medication (stimulant (MPH or DEX) or placebo) in each cycle. A Research Assistant enroled participants, and the hospital clinical trials pharmacist sequentially assigned participants to random allocation sequences. Within each pair, the sequence was randomly allocated. For example, an actual sequence was (drug, placebo), (drug, placebo), (placebo, drug). At the end of the trial, the order of medications was unmasked, and compared with the parent and teachers’ observations of the child’s behaviour.

Outcome measures

The investigators selected the following outcome measures:

Primary

  • Conners’ 3 Parent Rating Scales

Secondary

  • Conners’ 3 Teacher Rating Scales

  • Behaviour Rating Inventory of Executive Function (BRIEF - Parent/Teacher/Self-Report)

  • Eyberg Child Behaviour Inventory (ECBI)

Participants

Participants in the study were purposefully sampled children who fitted the inclusion criteria and who were known to the Queensland Paediatric Rehabilitation Service, Brisbane. Australia (tertiary children’s public hospital).

Inclusion criteria

  1. 1.

    Between 6 and 16 years old.

  2. 2.

    Clinical diagnosis of moderate to severe traumatic brain injury, with severity based on duration of loss of consciousness, initial Glasgow Coma Scale (GCS) Score at presentation to the treating hospital, and duration of post-traumatic amnesia (PTA). Moderate TBI was defined as loss of consciousness for 30 to 60 minutes, or GCS 9 to 12, or PTA from one day to one week; and severe TBI was defined as loss of consciousness for greater than 60 minutes, or PTA greater than one week, or GCS less than 9.

  3. 3.

    At least 12 months post injury.

  4. 4.

    Clinically significant attention/concentration disorder or executive dysfunction including disorders of behavioural or emotional regulation that may respond to stimulants.

  5. 5.

    At least two people (parent or other person and teacher) available to monitor the child’s symptoms.

Exclusion criteria

  1. 1.

    Uncontrolled seizure disorder, moderate to severe hypertension, clinically significant anxiety, motor tics, Tourette syndrome, suspected or proven cardiac conduction problems, idiosyncratic reaction to sympathomimetic amines, history of drug abuse (including high caffeine beverages and appetite suppressants).

  2. 2.

    Parents not able to fill out forms in English.

  3. 3.

    Child’s school unwilling to participate.

Measures

  1. A.

    Baseline: age, gender, type and duration of symptoms, reason for referral, time post injury, presence or absence of ADHD (DSM-IV criteria) [22], demographics, and details of previous stimulant therapy.

  2. B.

    Weekly post randomisation: parents, teachers and capable children over 12 completed a weekly diary, including the following measures:

    1. 1.

      Conners’ 3 Rating Scales for Parent and Teacher [23]. These are well-known valid and reliable scales [24] for measuring ADHD symptoms, in children aged 3 to 18 years of age. Subscales include inattention, hyperactivity/impulsivity, learning, executive functioning, aggression and peer relations, as well as subscales mapping onto DSM-IV criteria for ADHD (inattentive), ADHD (hyperactive-impulsive), ADHD combined, Conduct Disorder, and Oppositional-Defiant Disorder. Means and standard deviations for the global index vary dependent on age (for 6 year-olds the mean is 5.15 with a standard deviation of 3.97; means for 17 to 18 year-olds are 3.90 with a standard deviation of 4.00). The Global Index subscale was used for monitoring change in severity of behavioural symptoms over time. For teachers, the possible score ranges from 0 to 30. Raw scores are usually converted to T-scores or percentile scores relative to normative data. T-scores above 60 (percentiles above 84) are considered clinically significant.

    2. 2.

      Behaviour Rating Inventory of Executive Function (BRIEF - Parent/Teacher/Self-Report); [25]. This assesses executive function behaviors of school-age children in the home and school environments (parent and teacher versions). The Global Executive Composite was analysed. The Global Executive Composite (GEC) is an overarching summary score that incorporates all of the BRIEF clinical scales. The possible range of scores for teachers is 0 to 24. It has satisfactory reliability and validity [25].

    3. 3.

      Eyberg Child Behaviour Inventory (ECBI) [26]. This parent-rated scale measures two outcomes: Total Intensity scores and Total Problems scores. The intensity score is the total frequency of occurrence for the 36 behaviours and the problem score is the total number of behaviours for which the response is 'yes’. Both scales of the ECBI are continuous such that higher scores on the scale indicate a greater level of conduct-disordered behaviour and greater impact on the parent. There are two clinical cut-off scores: 127 on intensity (maximum = 252) and 11 on problem (maximum score = 36). Reliability and validity of this measure have been well-established [27, 28].

  3. C.

    Post trial: post trial medication management plan.

Medication

Prior to the study, if not already stabilised on stimulant medication, the child was stabilised on an individualised oral dose of MPH or DEX. This was done to account for the wide variation in clinical dose required by children using stimulants and to identify significant side effects. If the child was not already stabilised on methylphenidate or dexamphetamine, prior to the trial commencement they were stabilised on an appropriate individualised dose. They were stable on this dose for approximately two weeks prior to commencement of the trial, unless already on stimulant medication prior to recruitment. The appropriate dose was one that provided a clinical improvement in target behaviours, and was well-tolerated with minimal side-effects, up to the maximal recommended dose stated by the product information. If unacceptable side effects occurred while taking one of the stimulants, the trial was offered using the other medication.

Children already on long-acting MPH and those judged likely to benefit from this were offered long-acting MPH trials at their clinician’s discretion. Other children were offered trials of short-acting MPH, or DEX, twice daily.

Stimulant and placebo were provided as identical opaque capsules, using encapsulation of either MPH or DEX powder, or over-encapsulation of the active whole tablet for long-acting MPH where the pharmacodynamics would not be altered by this. The pharmacy produced 3 × 1 week’s supply of each, packaged into Webster packs as per the computer generated randomisation order.

Procedure

The University of Queensland Medical Research Ethics Committee and the Royal Children’s Hospital and Health Service District Human Research Ethics Committee, Queensland Health gave approval for this research study. Approval was obtained from Education Regulatory Authorities in Queensland (Queensland Government Department of Education and Training, and Catholic Education Archdiocese of Brisbane). Fully informed consent from parent and teacher (and assent for children over 12) was obtained.

Hospital clinicians determined subject eligibility, titrated stimulant medications and completed pre-trial (baseline) assessments. Parent/guardians provided consent forms, information sheets and questionnaires to schools for a teacher to complete weekly measures. Children then completed three pairs of one week treatment periods (placebo versus stimulant medication). All data were returned to research staff who provided a report to the treating doctor to discuss with the family.

Statistical analysis

Three types of Bayesian results will be presented here: (i) the mean of the posterior distribution of the mean difference between placebo and stimulant scores, which gives the best estimate of the overall effect size difference between treatments; (ii) the associated 95% credible region, which give intervals of uncertainty (in this case the 2.5 and 97.5 percentile) of the posterior distributions used in (i); and (iii) the posterior probability of the mean difference that stimulant scores were better than placebo scores, which describes the likelihood that the patients will favour the active treatment in future cycles. While seemingly analogous to confidence intervals in frequentist statistics [29], Bayesian credible regions have quite different interpretations and do not always coincide with confidence intervals as they incorporate problem-specific contextual information from the prior distribution and treat nuisance parameters radically differently [29]. However, like confidence intervals, a credible region that does not include the null value provides stronger evidence for the estimate in question than a credible region that includes the null value. Raw scores for the 18 cycles from the seven patients who completed at least one cycle were included in the statistical analyses.

Means, standard deviations (SDs) and ranges were calculated for stimulant and placebo periods. Replicating the technique described by Zucker et al. [29], hierarchical Bayesian random effects models were used to combine the n-of-1 studies to obtain estimates of treatment effectiveness for the group. Non-informative prior distributions were employed and inverse χ 2 distributions (with the number of degrees of freedom given by the harmonic mean of the individual sample sizes) were used to give increased weight to within-patient heterogeneity estimates from patients with larger number of available measurements. Estimates of mean treatment difference, 95% credible regions (95% CRs), and posterior probabilities were determined. An important difference between treatment means was defined to occur if the 95% CR did not include the null value. Numerical results from the hierarchical Bayesian models were derived from computer simulation in WinBUGS [30]. Simulations of size N = 50,000 were run in five parallel chains after a burn-in period of 5,000 iterations. Convergence in the final samples was checked using visual plots of simulation histories and the modified Gelman-Rubin statistic [31].

The trial was to be stopped if the Data Safety Monitoring Board recommended stoppage due to safety concerns.

Results

Ten patients commenced n-of-1 studies over the 2009 school year, and five completed all three treatment cycles; see Figure 1. Data were available for eighteen completed treatment cycles from seven patients. The demographic and injury characteristics of the participants are presented in Table 1. GCS at the time of injury ranged from 3 to 15 (those with GCS ≤ 12 were thought to meet criteria for moderate or severe TBI based on duration of post-traumatic amnesia). Seven patients trialled MPH (two of these slow release), one DEX, and for two this information is unknown. Of the five who did not complete the trial, three withdrew before commencing. Of these, two were under guardianship of the Department of Community Services, which withdrew consent. One changed stimulant after consenting to the trial and therefore did not take trial medication. One participant withdrew at end of week 3 as they were confident which period was active and decided they would prefer to be on this medication for their school examinations. One withdrew toward the end of the study, with no reason given. Figure 1 shows the participant flow diagram of the study. The pilot ended after the target of ten patients was reached.

Figure 1
figure 1

Patient flow chart. (a) Five eligible patients did not enrol because teacher consent was not obtained. (b) Two patients withdrew before commencing; they were under guardianship of the Department of Community Services, which withdrew consent. A third patient changed stimulant after consenting to the trial and therefore did not take trial medication. (c) One patient decided to withdraw at end of week 3 as they were confident which period was active and decided they would prefer to be on medication for exams. (d) A fifth participant withdrew toward the end of the study (after week 4), however the reason is uncertain.

Table 1 Demographic and injury characteristics of participants

There was considerable individual variation in results. Since the aim of the full study is to determine the group effect of stimulants on attention, hyperactivity and executive function in children with TBI, this report will describe aggregated findings, as described by Zucker and colleagues [29]. These are shown in Figure 2 and Table 2. Heterogeneity was not assessed between participants, due to the small participant numbers.

Figure 2
figure 2

Overall posterior population estimates of the mean difference between stimulant and placebo score (square) together with associated 95% credible region (line) for each study instrument. Placebo minus stimulant scores are shown. Lower scores indicate less disturbance of behaviour. Scores above zero favour stimulants and below zero favour placebo. Crossing the line means a result is non-significant.

Table 2 Number of completed cycles, global means (SD) and range of stimulant and placebo scores, and overall posterior population estimates of the mean difference between stimulant and placebo scores together with the posterior probabilities that the stimulant scores are better than the placebo scores for each study instrument

Conners’ 3 Rating Scale

The posterior probabilities that the mean difference between stimulant scores and placebo scores was greater than zero were 0.92 for parents and 0.93 for teachers for the Global Index, indicating a trend towards active medication improving behaviour compared to placebo. For the Global Index, there was a small difference between all placebo and all stimulant treatments, more marked for teachers’ scores (posterior mean difference 5.9 (SD 4.5), 95% credible region -3.1 to 14.9, possible score 0 to 30) than parents’ scores (posterior mean difference 2.3 (SD 6.2), 95% credible region -1.0 to 6.1). Raw scores rather than adjusted scores were used for reasons explained in the discussion.

Executive function

Teacher-reported executive function (measured by the BRIEF) showed an improvement on active medication compared to placebo across all cycles (posterior mean difference 20.7 (SD 23.2); possible range 0 to 24; 95% credible region -25.2 to 67.2). Correspondingly, the posterior probability of the overall mean difference that stimulant scores were better than placebo scores was 0.86 for teachers, somewhat higher than 0.76 for parents, where the posterior mean difference was 10.8 (SD 17.5 (95% credible region -23.5 to 46.7).

Eyberg Child Behaviour Inventory

Parent-reported number of child behaviour problems and teacher rated intensity of child behaviour problems showed improvement on stimulant treatment compared with placebo treatment; posterior mean difference 2.8 (SD 4.8; 95% credible region -6.8 to 12.3) and 24.8 (SD 32.7; 95% credible region -40.6 to 90) respectively, and posterior probability of the overall mean difference that stimulant scores are better than placebo scores WAS 0.75 and 0.83, respectively. There was very little difference between stimulants and placebo in the intensity of child behaviour problems in parent reports; posterior mean difference 2.9 (SD 13.7; 95% credible region -19.7 to 36.6), posterior probability of the overall mean difference that stimulant scores are better than placebo scores WAS 0.49.

Although all these posterior mean differences showed a positive trend in favour of stimulants, all 95% credible regions included the null value, indicating a non-significant effect.

Discussion

Strengths and limitations

This pilot project assessed the effect of psychostimulants on attention, hyperactivity and higher cerebral functions of children with traumatic brain injuries. While stimulants are approved for children with ADHD, the children in this study had symptoms consistent with ADHD due to trauma. A larger trial is required to assess the efficacy of stimulants on this group of children.

There were several methodological issues. The first is that we elected to treat children with TBI displaying symptoms similar to ADHD, with stimulants. Those without those symptoms were not considered: therefore this pilot was conducted on a sub-population of children with TBI. We recognize that this method does introduce a selection bias by selecting those who appeared to derive benefit. However, in any trial, it would be unethical to offer participation where there is little likelihood of benefit. The results of this pilot and the subsequent larger trial can only be generalised to those children who have an apparent pre-trial clinical effect from stimulant medication.

Secondly, previous experience with conducting a trial of stimulants where there was a pre-trial titration with fixed doses of stimulants to find the dose with the best apparent effect, showed that large numbers of children were randomized but withdrew, due to the length of the pre-trial titration [21]. Further, several participants withdrew because their parents were concerned that their children would be receiving placebo.

It was considered that the best option was to find a dose of stimulants in each individual that appeared to produce positive behavioural results and was well tolerated, until a ceiling dose was reached. We believe this approach is valid, in the same way that some RCTs have an escalating scale of doses until either an effective dose is reached or the maximum dose for the study has been achieved. The trial is thus comparing a clinically effective dose with placebo in each child.

Thirdly, there are no validated scales that measure hyperactivity in brain injured children. The Conners’ 3 Rating Scales are designed for non-brain injured children. Given that current regulations for the prescription of stimulant medications in Australia require a diagnosis of ADHD, this is the only feasible scale. However normative scales have yet to be created for this population. Most participants scored above the 97th percentile on normative data for children without TBI for the behaviours tested for in both placebo and stimulant cycles, that is, the very worst end of the scale for the performance of non-brain injured children. There is a reasonable spread of raw scores that map to these high percentiles, and a differential between raw scores is possible and was in fact observed between stimulants and placebo. Therefore raw scores are reported here, and differences between trial arms calculated in terms of changes in these. This will be explored more thoroughly in the analysis of the full trial. The full trial, currently underway, involves two other sites, and will recruit 42 children over two years.

Finally, we conducted the trial with either MPH or DEX, depending on patient and parent preference. Clinically, the two medications are interchangeable. Those children already on slow-release preparations of MPH did the trial on this medication, as the half-life of the MPH released is identical to immediate release preparations.

An evidence-based review conducted by the McMaster University Evidence-Based Practice Center Group studied 23 articles on specific drug-to-drug comparisons [32]. These included eight studies comparing MPH and DEX. Also included were studies comparing different formulations of the same drug. Three studies compared regular and sustained-release formulations of MPH, and one study compared different isomers of MPH (L-MPH versus D-MPH). Finally, one study compared DEX and levoamphetamine. The stimulant-stimulant comparisons documented few, if any, differences between MPH and DEX. The studies comparing different formulations of the same drug revealed no significant formulation effects.

With any crossover trial, the possibility of carryover effects needs to be considered. Swanson and Volkow [33] investigated the pharmacological properties of MPH and reported uptake and clearance times of oral short-acting MPH from the brain using Positron Emission Tomography studies. Uptake time orally is approximately 20 minutes and the clearance time is approximately 90 to 120 minutes. Regardless of dose, the time to maximum concentration (Tmax) is reported as 1.5 to 2 hours and t1/2 between 2 and 3 hours. The maximum behavioural effects (reductions in overactivity, impulsivity and inattention) occur about 1 to 2 hours after oral doses, and the effects dissipate significantly after 2 hours (3 to 4 hours after each immediate release dose). Due to the small number of available data, we did not conduct any formal 'carry-over’ checks/analyses - and instead were guided by pharmacological and biological considerations. As such, data taken on the first two days of each seven-day period were omitted from the analyses to allow for washout. Informal graphical checks by day were drawn to visually ascertain patterns or trends in the data beyond variability. None were seen. If carry-over effects do exist, then the treatment effect estimates might be underestimated, as these effects would spill into the placebo results. The randomisation of treatments within cycles would reduce this effect, should it exist. In a larger confirmatory trial, formalised checks would need to be conducted.

There are some obvious limitations of this pilot study. The sample size is small and the completion rate was only 50%. Thus, individual scores are highly influential and there is reduced power to find important overall differences that may exist. Secondly, the distribution of the mean differences was assumed to be normal. No evidence existed to challenge this assumption and, invoking the central limit theorem, it is likely that this assumption is not unreasonable. In the larger trial this will be formally tested. Thirdly, those children who had negative responses or adverse events during pre-trial titration are not included in the analysis. Finally, one child withdrew because of correctly perceived success of the treatment. Because he/she did not complete all treatment cycles, there was relatively less data for this 'success’ and thus more associated individual variability, which may have biased results towards the 'null’ difference between treatments.

Recruitment was impacted by a substantial percentage of potentially eligible children (estimated to be 17% of those screened) who were involved with the Department of Child Safety, which did not give consent for those children to participate. These were different to the five eligible patients (described in Figure 2), who did not enrol because teacher consent was not obtained. Research staff endeavoured to work with department staff to encourage participation by children involved with the department. However, permission to participate was denied in all cases even though this study was evaluating the medication that the child was already taking, not introducing any new treatments.

Though there were five withdrawals, not unusual in this population [34], enough cycles (18) were completed to allow Bayesian analysis of the aggregated completed cycles.

The n-of-1 trial design has several strengths [35]. n-of-1 studies provide the strongest evidence possible of the effect of a medicine on an individual. A report is provided to patients and clinicians on the efficacy of the treatment for the individual immediately after the trial is concluded. This is not possible in a standard RCT. In addition, every participant receives both the active and placebo treatments, thus making participation more attractive than in an RCT where there is a chance of being randomised to the placebo arm of the trial. Finally, because the same person contributes multiple data points to both the active and placebo arms of the trial, the sample is perfectly matched. The sample size required to complete the trial is considerably smaller than a standard RCT, thus allowing credible data to be collected in small populations where a standard RCT is virtually impossible to conduct.

Finally, if a participant leaves the trial early, completed cycles can contribute to the final analysis. This is in contrast to an RCT, where the data from people leaving the trial before completion are lost.

Validated ratings of concentration, executive functioning and behaviour were used in this pilot study, and a strength of this study is that ratings were obtained from both parents and class teachers. Given that neuropsychological assessments are time-consuming and therefore expensive, validated ratings of concentration, executive functioning and behavior are a practical method of measuring outcomes, as well as directly obtaining data on a child’s functioning as opposed to underlying impairments.

There was a greater difference between scores on stimulant medication compared to placebo for teachers compared to parents. A similar pattern was found by Bakker and Waugh [16, 17], although by contrast, in the current study teachers were blinded. A possible explanation for this trend may be that a child’s difficulties with concentration and self-regulation are more evident in the school setting where the child is expected to be able to concentrate and regulate their behaviour for extended periods of time, where difficulties may not be as evident at home where formal learning is not expected and the child’s difficulties with regulation and concentration may not impact overly on their free play.

Hierarchical Bayesian analysis

Hierarchical Bayesian models have been advocated for the analysis of n-of-1 trial data, especially when both patient-specific and population estimates are desired [30, 36, 37]. Detailed accounts of these models for normal [30] and binary [37] outcome data have been previously described. Advantages of this approach include the ability to embody prior information, coherently update this prior information with the availability of new empirical information, provide patient-specific and population probabilistic results, allow covariate and participant subgroup structures, accommodate the natural hierarchies and clusters within patient groups, and easily handle unbalanced data [36]. Exploiting these properties and the sequential nature of n-of-1 trials, the population effect size can be given by the posterior distributions of the aggregated n-of-1 trials. The addition of new trials will update and refine this posterior distribution; in a similar manner to how evidence is accumulated between studies with meta-analyses.

Conclusions

The results of this pilot and the subsequent larger trial can only be generalized to those children who have an apparent pre-trial clinical effect from stimulant medication. The major issues affecting generalisability here are those who are eligible but [1] do not participate and [2] those who withdraw before completing any cycles. If these participants are importantly different from those who complete at least one cycle, then inherent biases will result. However, missing data not at random will have relatively little impact on those who complete at least one cycle - because of the hierarchical structure of the analysis, where individual effect sizes are estimates, and their distribution falls under an overall mean distribution. The impact is also minimised by the cross-over benefit of patients being their own controls, over all known and unknown confounders.

In this pilot study, there was sufficient evidence to proceed to a formal series of aggregated n-of-1 trials. Stimulants appeared to produce a small effect on behaviour and executive function for children with TBI on the Global Index on the Conners’ 3 Rating Scales (both parent and teacher) and for the Global Executive Composite on the BRIEF. However, for the latter, the parent ratings varied substantially and, with such small sample sizes, estimates may have been unduly influenced by one or two aberrant scores. This assumption is supported by a suggestion that parent-reported number of child behaviour problems and teacher rated intensity of child behaviour problems showed improvement on stimulants compared to placebo treatment for the ECBI. A larger sample size will provide stronger evidence. A formal series of aggregated n-of-1 trials is currently being conducted.

Abbreviations

ABI:

Acquired brain injury

ACTRN:

Australian and New Zealand Clinical Trials Registry

ADHD:

Attention deficit hyperactivity disorder

BRIEF:

Behaviour Rating Inventory of Executive Function

CNS:

Central nervous system

CRs:

Credible regions

DEX:

Dexamphetamine

DSM-IV:

Diagnostic and Statistical Manual of Mental Disorders 4th edition

ECBI:

Eyberg Child Behaviour Inventory

GCS:

Glasgow Coma Scale

GEC:

Global Executive Composite

MPH:

Methylphenidate

PTA:

Post-traumatic amnesia

RCT:

Randomized controlled trial

SD:

Standard deviation

TBI:

Traumatic brain injury

References

  1. Australian Government: Australian Institute of Health and Welfare. Disability in Australia: acquired brain injury. Bulletin 55 December 2007

  2. Catroppa C, Anderson VA, Morse SA, Haritou F, Rosenfeld JV: Children’s attentional skills five years post-TBI. J Pediatr Psychol. 2007, 32 (3): 354-369. Epub 2006 Jul 13

    Article  PubMed  Google Scholar 

  3. Yeates KO, Armstrong K, Janusz J: Long-term attention problems in children with traumatic brain injury. J Am Acad Child Adolesc Psychiatry. 2005, 44 (6): 574-584. 10.1097/01.chi.0000159947.50523.64.

    Article  PubMed  Google Scholar 

  4. Max JE, Schachar RJ, Levin HS: Predictors of secondary attention-deficit/hyperactivity disorder in children and adolescents 6 to 24 months after traumatic brain injury. J Am Acad Child Adolesc Psychiatry. 2005, 44 (10): 1041-1049. 10.1097/01.chi.0000173292.05817.f8.

    Article  PubMed  Google Scholar 

  5. Max JE, Schachar RJ, Levin HS, Ewing-Cobbs L, Chapman SB, Dennis M, Saunders A, Landis J: Predictors of attention-deficit/hyperactivity disorder within six months after pediatric traumatic brain injury. J Am Acad Child Adolesc Psychiatry. 2005, 44 (10): 1032-1040. 10.1097/01.chi.0000173293.05817.b1.

    Article  PubMed  Google Scholar 

  6. Gerring JP, Brady KD, Chen A, Vasa R, Grados M, Bandeen-Roche KJ, Bryan RN, Denckla MB: Premorbid prevalence of ADHD and development of secondary ADHD after closed head injury. J Am Acad Child Adolesc Psychiatry. 1998, 37 (6): 647-654. 10.1097/00004583-199806000-00015.

    Article  CAS  PubMed  Google Scholar 

  7. Catroppa C, Anderson V: Traumatic brain injury in childhood: rehabilitation considerations. Dev Neurorehab. 2009, 12 (1): 53-61. 10.1080/17518420802634476.

    Article  Google Scholar 

  8. Clarke E, Baker B, Gardner M, Pompa J, Tait F: Effectiveness of stimulant drug treatment for attention problems: a look at head injured children. School Psychol Int. 1990, 11: 227-10.1177/0143034390113010.

    Article  Google Scholar 

  9. Slomine BS, Salorio CF, Grados MA, Vasa RA, Christensen JR, Gerring J: Differences in attention, executive functioning, and memory in children with and without ADHD after severe traumatic brain injury. J Int Neuropsychol Soc. 2005, 11 (5): 645-653.

    Article  PubMed  Google Scholar 

  10. Harvey D, Morrall M, Neilly E, Murdoch-Eaton E: Should stimulants be administered to manage difficulties with attention, hyperactivity and impulsivity following paediatric acquired brain injury?. Arch Dis Child. 2012, 97: 755-758. 10.1136/archdischild-2012-302250. doi: 10.1136/archdischild-2012-302250

    Article  PubMed  Google Scholar 

  11. Gualtieri CT, Evans RW: Stimulant treatment for the neurobehavioural sequelae of traumatic brain injury. Brain Inj. 1988, 2: 273-290. 10.3109/02699058809150898.

    Article  CAS  PubMed  Google Scholar 

  12. Levin H, Hanten G, Max J, Li X, Swank P, Ewing-Cobbs L, Dennis M, Menefee DS, Schachar R: Symptoms of attention-deficit/hyperactivity disorder following traumatic brain injury in children. J Dev Behav Pediatr. 2007, 28 (2): 108-118. 10.1097/01.DBP.0000267559.26576.cd.

    Article  PubMed  Google Scholar 

  13. Williams SE, Ris MD, Ayyangar R: Recovery in pediatric brain injury: is psychostimulant medication beneficial?. J Head Trauma Rehab. 1998, 13: 73-81. 10.1097/00001199-199806000-00007.

    Article  CAS  Google Scholar 

  14. Mahalick DM, Carmel PW, Greenberg JP: Psychopharmacologic treatment of acquired attention disorders in children with brain injury. Pedia Neurosurg. 1998, 29: 121-126. 10.1159/000028705.

    Article  CAS  Google Scholar 

  15. Jin C, Schachar R: Methylphenidate treatment of attention-deficit/hyperactivity disorder secondary to traumatic brain injury: a critical appraisal of treatment studies. CNS Spectr. 2004, 9: 217-226.

    PubMed  Google Scholar 

  16. Bakker K, Waugh MC: Stimulant use in paediatric acquired brain injury: evaluation of a protocol. Brain Impairment. 2000, 1: 29-36. 10.1375/brim.1.1.29.

    Article  Google Scholar 

  17. Bakker K, Waugh MC: Efficacy of stimulant medication in paediatric acquired brain injury. Final Report - 2008. [http://www.maa.nsw.gov.au/default.aspx?MenuID=374]. Motor Accidents Authority, Accessed 16 August 2011

  18. Hornyak JE, Nelson VS, Hurvitz EA: The use of methylphenidate in pediatric traumatic brain injury. Pedia Rehab. 1997, 1: 15-17.

    Article  CAS  Google Scholar 

  19. Whyte J, Hart T, Schuster K, Fleming M, Polansky M, Coslett HB: Effects of methylphenidate on attentional function after traumatic brain injury. A randomised, placebo-controlled trial. Am J Phys Med Rehabil. 1997, 76 (6): 440-450. 10.1097/00002060-199711000-00002.

    Article  CAS  PubMed  Google Scholar 

  20. Guyatt GH, Haynes RB, Jaeschke RZ, Cook DJ, Green L, Naylor CD: Users’ Guides to the medical literature: XXV. Evidence-based medicine: principles for applying the users’ guides to patient care. Evidence-based medicine working group. JAMA. 2000, 284 (10): 1290-1296. 10.1001/jama.284.10.1290. PubMed PMID: 10979117. Epub 2000/09/09

    Article  CAS  PubMed  Google Scholar 

  21. Nikles CJ, Mitchell GK, Del Mar CB: Long-term changes in management following n-of-1 trials of stimulants in attention-deficit/hyperactivity disorder. Eur J Clin Pharmacol. 2007, 63 (11): 985-989. 10.1007/s00228-007-0361-x. Epub 2007 Aug 16

    Article  CAS  PubMed  Google Scholar 

  22. American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders. 1994, Arlington, Virginia: American Psychiatric Association, 4

    Google Scholar 

  23. Conners CK: Connors Third Edition. 2008, Toronto, Ontario: Multi-Health Systems

    Google Scholar 

  24. Conners CK, Sitarenios G, Parker JDA, Epstein JN: Revision and restandardisation of the Conners Teacher Rating Scale (CTRS-R): factor structure, reliability, and criterion validity. J Abnorm Child Psychol. 1998, 26: 279-291. 10.1023/A:1022606501530.

    Article  CAS  PubMed  Google Scholar 

  25. Gioia GA, Isquith PK, Guy SC: Behavior rating inventory of executive function. Child Neuropsychol. 2000, 6 (3): 235-238. 10.1076/chin.6.3.235.3152.

    Article  CAS  PubMed  Google Scholar 

  26. Eyberg S, Pincus D: Eyberg Child Behavior Inventory and Sutter-Eyberg Student Behavior Inventory - Revised. 1999, Odessa, FL: Psychological Assessment Resources

    Google Scholar 

  27. Boggs S, Eyberg S, Reynolds L: Concurrent validity of the Eyberg child behaviour inventory. J Clin Child Psych. 1990, 19 (1): 75-78.

    Article  Google Scholar 

  28. Eyberg SM, Ross A: Assessment of child behavior problems: The validation of a new inventory. J Clin Child Psychol. 1978, 113-116.

    Google Scholar 

  29. Zucker DR, Schmid CH, McIntosh MW: Combining single patient (N-of-1) trials to estimate population treatment effects and to evaluate individual patient responses to treatment. J Clin Epidemiol. 1997, 50: 401-410. 10.1016/S0895-4356(96)00429-5.

    Article  CAS  PubMed  Google Scholar 

  30. Lunn DJ, Thomas A, Best N, Spiegelhalter D: WinBUGS - a Bayesian modelling framework: concepts, structure, and extensibility. Stat Comput. 2000, 10: 325-337. 10.1023/A:1008929526011.

    Article  Google Scholar 

  31. Brooks SP, Gelman A: Alternative methods for monitoring convergence of iterative simulations. J Comput Graph Stat. 1998, 7: 434-455.

    Google Scholar 

  32. Brown RT, Amler RW, Freeman WS, Perrin JM, Stein MT, Feldman HM, Pierce K, Wolraich ML, American Academy of Pediatrics Committee on Quality Improvement; American Academy of Pediatrics Subcommittee on Attention-Deficit/Hyperactivity Disorder: Treatment of attention-deficit/hyperactivity disorder: overview of the evidence. Pediatrics. 2005, 115 (6): e749-e757. 10.1542/peds.2004-2560.

    Article  PubMed  Google Scholar 

  33. Swanson JM, Volkow ND: Serum and brain concentrations of methylphenidate: implications for use and abuse. Neurosci Biobehav Rev. 2003, 27: 615-621. 10.1016/j.neubiorev.2003.08.013.

    Article  CAS  PubMed  Google Scholar 

  34. Nikles CJ, Mitchell GK, Del Mar CB, Clavarino AM, McNairn N: An n-of-1 trial service in clinical practice: testing the effectiveness of stimulants for attention-deficit/hyperactivity disorder. Pediatrics. 2006, 117 (6): 2040-2046. 10.1542/peds.2005-1328.

    Article  PubMed  Google Scholar 

  35. Nikles J, Mitchell GK, Schluter P, Good P, Hardy J, Rowett D, Shelby-James T, Vohra S, Currow D: Aggregating single patient (n-of-1) trials in populations where recruitment and retention is difficult: the case of palliative care. J Clin Epidemiol. 2011, 64: 471-480. 10.1016/j.jclinepi.2010.05.009.

    Article  PubMed  Google Scholar 

  36. Lee PM: Bayesian Statistics: an Introduction. 1997, London: Arnold, 2

    Google Scholar 

  37. Schluter PJ, Ware RS: Single patient (n-of-1) trials with binary treatment preference. Stat Med. 2005, 24: 2625-2636. 10.1002/sim.2132.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

We thank Ms Carla Rogers, Ms Anne Bucetti and Mr Peter Mulvey, Research Assistants, for help with data collection. Funding was provided by the Royal Children’s Hospital Foundation (Research project seed research, new investigator) and the Motor Accident Insurance Commission of Queensland. Jane Nikles was funded by an NHMRC post-doctoral research fellowship 401780.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Catherine J Nikles.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

LM: clinical input into original grant application and protocol, recruitment and clinical supervision of patients on trial, drafting of manuscript. GM: clinical input into protocol, drafting of manuscript. SC: coordination of trial, analysis of data, input into manuscript drafting. JN: wrote original grant application andprovided input into protocol, drafting and finalisation of manuscript. AE: clinical input into protocol, recruitment and clinical supervision of patients on trial, drafting of manuscript. MCW: clinical input into protocol, recruitment and clinical supervision of patients on trial, drafting of manuscript. HS: wrote protocol, input into manuscript draft. PS: statistical input into protocol, wrote statistical sections of manuscript. OL: clinical input into protocol, recruitment and clinical supervision of patients on trial, drafting of manuscript. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Nikles, C.J., McKinlay, L., Mitchell, G.K. et al. Aggregated n-of-1 trials of central nervous system stimulants versus placebo for paediatric traumatic brain injury – a pilot study. Trials 15, 54 (2014). https://0-doi-org.brum.beds.ac.uk/10.1186/1745-6215-15-54

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1745-6215-15-54

Keywords