- Study protocol
- Open Access
- Open Peer Review
Out & Online; effectiveness of a tailored online multi-symptom mental health and wellbeing program for same-sex attracted young adults: study protocol for a randomised controlled trial
Trials volume 15, Article number: 504 (2014)
Same-sex attracted young adults have been found to experience higher rates of mental health problems and greater difficulties in accessing specialist mental health care services compared to their heterosexual peers. Internet-based mental health interventions have the potential to be more engaging and accessible to young adults compared to those delivered face-to-face. However, they are rarely inclusive of lesbian women and gay men. Thus, the current study aims to evaluate the effectiveness of an online mental health and wellbeing program, Out & Online (http://www.outandonline.org.au), in comparison to a wait-list control group, for reducing anxiety and depressive symptoms in same-sex attracted young adults aged between 18 and 25 years.
We are recruiting, through media and community organisations, 200 same-sex attracted young adults with anxiety and/or depressive symptoms and mild to moderate psychological distress (Kessler-10 score between 16 to 21). Participants will be randomly allocated to the intervention (the online program) or the wait-list control group based on a permuted blocked randomisation method to allow for stratification by gender. Participants in the intervention group will receive a tailored program for up to three types of mental health difficulties simultaneously. The primary outcome of anxiety and/or depressive symptoms, and secondary outcomes related to psychological distress, wellbeing and health behaviour will be measured at pre-intervention (0 week), post-intervention (8 weeks) and at a 3-month follow-up (20 weeks).
This online mental health and wellbeing program will be one of the first online interventions to be designed specifically to be relevant for same-sex attracted individuals. If the program is found to be effective it will improve access to specialist same-sex attracted-relevant mental health services for young adults and will facilitate wellbeing outcomes for these individuals. This program will also be a significant development in the delivery of tailored interventions that target multiple types of mental health conditions simultaneously.
Australian New Zealand Clinical Trials Registry: ACTRN12611000700932. Date registered: 7 July 2011.
Poor mental health has been identified as a key issue for same-sex attracted young adults (SSAYA). Research indicates that SSAYA are twice as likely to attempt suicide as peers with opposite-sex attractions [1–4], 3.5 times more likely to engage in self-harm and 5 times more likely to report suicidal ideation than their heterosexual peers . SSAYA also experience more depressive symptoms compared with heterosexual youth [3, 6–10]. In addition, 9% of SSAYA have been found to meet criteria for the diagnosis of posttraumatic stress disorder (PTSD) , and social anxiety has been identified as a potential mental health problem among SSAYA as they learn to fear and avoid social situations .
The prevalence of mental health problems among SSAYA has been strongly linked to the experience of homophobia [13–15]. Homophobic attitudes give rise to prejudice, victimisation, physical and verbal abuse, harassment, and rejection of SSAYA within their home , school environment [17–19] and the wider community [11, 15]. These discriminatory behaviours result in stigmatisation, alienation and isolation among SSAYA, which, in turn, is related to depression, PTSD, social anxiety disorder (SAD) and suicidal ideation [20, 21]. In addition, the mental health of SSAYA can be influenced by internalised homophobia [14, 22], which refers to the extent that a same-sex attracted individual has internalised society's negative perceptions of homosexuality . It has been proposed that internalised homophobia is experienced to varying degrees by almost all SSAYA raised in a society where heterosexuality is the sexual norm . Internalising homophobic attitudes can lead to diminished self-concept and self-esteem . Further, models of identity development propose that the adoption of a positive identity depends upon resolving internalised homophobia [25, 26].
In addition to higher rates of mental health problems compared to heterosexual youth and young adults, SSAYA also face greater barriers to accessing help such as feeling that mental health care services marginalise them by assuming heterosexuality and do not adequately assist them to address challenges unique to being same-sex attracted such as stigma and 'coming out' . These barriers are intensified for SSAYA living in rural or regional areas where they have less access to relevant information, resources, support and services than their city peers. Evidence indicates that rural SSAYA attempt suicide six times more often than the population average  and experience higher levels of homophobia than their city peers . Indeed, research with same-sex attracted adults living in rural areas indicates that most do not disclose their sexual orientation, that non-disclosure exacerbates social isolation, and that those who do disclose are vulnerable to homophobic responses from workers in the health care system .
The role of the Internet for the delivery of mental health care
Given the difficulties that ‘at-risk’ SSAYA perceive in accessing mental health care services, particularly in rural and regional areas, the Internet may be an ideal way to deliver mental health interventions to this population . The Internet has the potential to overcome a number of the structural and attitudinal barriers that often avert efforts to seek help, especially within rural and regional areas, including stigma, a shortage of trained health professionals and geographic and social isolation [32–35]. Previous research with adults, including young adults and those in rural and regional areas, has indicated that delivering interventions via the Internet provides flexibility, anonymity, and enhanced accessibility [36, 37]. Moreover, a web-based intervention is likely to be more engaging for young people who are early adopters of new technology . Most young people, including those from disadvantaged backgrounds, have access to an Internet-enabled computer, with approximately 95% of 15 to 25-year-olds using the Internet .
Numerous Internet-based mental health interventions targeting young people have been developed and evaluated; for examples, see references [40–44]. These findings support the development and provision of Internet-based mental health programs for education about, and prevention and treatment of, a number of psychological symptoms and conditions experienced by young people . In particular, online delivery of cognitive behaviour therapy (CBT) has been found to be effective in reducing symptoms of anxiety and depression .
Despite the evidence for online interventions and their potential for assisting SSAYA with mental health difficulties the majority are not specifically relevant to the needs of same-sex attracted individuals. In a review of 24 web- and mobile phone-based online interventions, Rozbroj et al.  concluded that online interventions seldom addressed the stressors faced by same-sex attracted individuals and contained content assuming or suggesting users were heterosexual.
Online multi-symptom mental health and wellbeing program development
Given the need for online interventions relevant to SSAYA we developed an online CBT intervention (the Out & Online program, http://www.outandonline.org.au) designed to reduce anxiety and depressive symptoms and enhance wellbeing in SSAYA aged 18 to 25 years. The program was made relevant to SSAYA by using inclusive language and content (for example, pictures and videos depicting people in same-sex relationships), applying some of the strategies to stressors unique to being same-sex attracted (for example, 'coming out', feeing accepted by heterosexual peers and enhancing self-esteem and self-acceptance in the face of homophobia and internalised homophobia), and providing information on support services specialising in supporting same-sex attracted individuals.
The present study aims to evaluate via a randomised controlled trial (RCT) the Out & Online program in SSAYA aged between 18 and 25 years recruited via media and community organisations. The program will deliver symptom-relevant material across up to three different types of mental health difficulties (out of generalised anxiety, social anxiety, posttraumatic stress, obsessions and/or compulsions, panic and depressive symptoms) so as to present individual users with a customised mental health early intervention that respects their individuality, and acknowledges the reality and frequency of comorbid symptomatology.
The primary aim of the study was to examine the effectiveness of the Out & Online program for reducing anxiety and depressive symptoms and improving wellbeing. It was anticipated that additional benefits participants might gain from the program would include reduced internalised homophobia, more positive attitudes towards seeking help, greater sense of control over their health and greater satisfaction with their lives.
This study will evaluate the intervention using an RCT. Participants meeting inclusion criteria and who have provided informed consent to participate will be randomly allocated to receive the intervention immediately or after a 20-week waiting period. Primary and secondary outcomes will be assessed via online surveys obtained from participants at pre-intervention (week 0), while completing the online program (weeks 2, 4 and 6), post-intervention (week 8) and 3-month follow-up (week 20). Figure 1 shows a flow chart of participant involvement in the RCT.
We will recruit participants through Australian organisations that work with SSAYA, mental health organisations, advertising via social, online and news media, and information sessions to community groups (including support groups for SSAYA, health professionals that work with SSAYA).
Inclusion criteria are: Australian resident, aged between 18 and 25 years, same-sex attracted (self-identify as gay, lesbian or bisexual), access to the Internet, mild to moderate psychological distress (Kessler-10 score between 16 and 21) and having depressive and/or anxiety symptoms (being eligible to receive tailored content for at least one anxiety or depressive symptom).
To inform the development of the program, focus groups were conducted with SSAYA (aged 18 to 25 years) who discussed their experiences regarding their sexual orientation, their mental health needs and their preferences for support services. These data, along with expert review, informed the modification of existing online CBT-based prevention and treatment programs of the National eTherapy Centre. The program content was adapted to be suitable for integrated multiple symptom treatment. In addition, content was personalised for SSAYA, by using inclusive language and content (for example, use of pictures and videos depicting people in same-sex relationships), providing examples of stressors, unhelpful thoughts and beliefs and unhelpful behaviours unique to challenges associated with being same-sex attracted (for example, 'coming out', feeling accepted by heterosexual peers, fear of being assaulted for being gay), providing information on services specialising in supporting same same-sex attracted individuals, providing information on how self-esteem can be affected by being same-sex attracted (for example, through homophobia and internalised homophobia) and strategies to strengthen self-esteem and self-acceptance. Further refinement of the program was undertaken following usability testing, whereby SSAYA reviewed specific modules within the program and made recommendations for amendments to content. This feedback was incorporated where appropriate.
The Out & Online program was developed as a standalone resource that should complement face-to-face therapy, but in itself does not require the involvement of a health professional. The program contains seven brief modules containing mental health and wellbeing information and exercises based on CBT principles. The modules contain generic information and information and exercises specific for the symptoms participants endorse in an online assessment at pre-intervention, which screens for generalised anxiety, obsessions and compulsions, posttraumatic stress, specific fear, social anxiety and depressive symptoms. Some program content is also tailored for gender. It is recommended to participants that they spend an hour a week over eight weeks reading through the online modules and practising offline exercises. An eighth module on prevention and help for suicidal thoughts is accessible to all participants at all times.
Wait-list control group
The intervention is being compared to a wait-list control group so that participants in this group have the opportunity to complete the program. Participants in the wait-list control group will receive access to the intervention program after a 20-week delay. They are able to access any other mental health and wellbeing services during this time.
An automated computerised randomisation system will generate random sequences for group allocation. This will be based on a permuted blocked (block size = 10) randomisation method to allow for stratification by gender, ensuring that equal gender numbers are allocated to each of the two conditions. Trial enrolment, randomisation and assignment to intervention will all be automated and will not require any human input.
Administration of assessments
Upon registering on the Out & Online website participants will complete baseline assessments (week 0). Automated Email prompts will be sent to participants asking them to complete online assessments at 8 and 20 weeks post-randomisation. In addition, while completing the online program, participants will be prompted by automated Email to complete a survey at weeks 2, 4 and 6 of the 8 week program. Table 1 shows the schedule of assessments for each time point.
The primary outcomes being assessed are reduction in anxiety and/or depressive symptoms. Validated questionnaires will be used to measure generalised anxiety (Generalised Anxiety Disorder 7 ), panic (Panic Disorder Severity Scale ), obsessions and compulsions (Obsessive-Compulsive Inventory-Revised ), social anxiety (Social Phobia Inventory ), posttraumatic stress (Posttraumatic Stress Disorder Checklist-Civilian Version ), specific fear (the Fear Questionnaire ) and depressive symptoms (Patient Health Questionnaire-9 ). These measures are also being used to determine whether participants are eligible to receive specific symptom content in their tailored online program.
In addition, an online screening device (eScreener) was developed in 2011 to measure anxiety and depressive symptoms. This eScreener will be compared against the validated questionnaires in order to develop a shorter means of determining symptom content for the online program. Once the eScreener is validated future entry to the program will first involve an assessment of psychological distress (with the Kessler-10 scale; K10 [53, 54]), with alternate referral recommendations with people with little or very high distress, and then administration of the eScreener as the sole means of determining symptom relevant content.
As each participant will receive a different number (between one and three) and combination of symptom content (out of generalised anxiety, panic, social anxiety, obsessions/compulsions, specific fear and depressive symptoms), the K10 [53, 54] will be used as a secondary outcome to evaluate progress at fortnightly intervals during the intervention, and at pre- and post-intervention. As research has revealed a strong association between K10 scores and a current Composite International Diagnostic Interview diagnosis of anxiety and affective disorders , this short scale is appropriate for the fortnightly progress evaluations and it will allow us to examine the influence of different program lengths and types on the main outcomes of interest.
Additional secondary outcomes will include life satisfaction (Satisfaction With Life Scale ), wellbeing (Mental Health Continuum Short Form ), internalised homophobia (Internalised Homophobia Scale-Revised ), help-seeking attitudes (Attitudes Toward Seeking Professional Psychological Help Scale ) and locus of control (Multidimensional Health Locus of Control Scales-Form C ). Demographic and background information will be collected at pre-intervention. Participants in the intervention group will also complete a program evaluation survey, which will include standard items regarding satisfaction with the online intervention.
Participants will have the option to 'opt-out' of the trial by clicking on a link on the website or automated Email and those that do this will be invited to complete a Departure Questionnaire which captures reason for opting out of the study.
It is hypothesised that at the post-intervention (week 8) and follow-up (week 20) assessment stages, participants assigned to access the intervention immediately will have fewer anxiety and depressive symptoms than those assigned to the wait-list control group.
In addition, it is hypothesised that at post-intervention and follow-up participants allocated to the intervention group will have less psychological distress, reduced internalised homophobia, greater life satisfaction, wellbeing, greater perception of control over their health, and more positive help-seeking attitudes than participants in the wait-list control group.
All scales used in the analysis will be validated using confirmatory factor analysis and reliability analyses. The intervention and wait-list control group will then be compared in terms of baseline measures for symptoms, health behaviour and wellbeing as well as possible confounds such as accessibility/remoteness and gender. Two multi-level modelling analyses will then be conducted. In the first analysis, the intervention and control group will be compared in relation to pre, post and follow-up changes for symptoms, health behaviour and wellbeing. In this analysis, significance levels will be adjusted to reflect the multiple primary outcome measures. In the second multi-level analysis only the intervention group will be considered, with fortnightly changes in the K10 compared in terms of the specific symptom-based programs that were completed by each participant during the previous fortnight (or previously in their intervention).
Sample size and power calculations
GPower  analysis indicates that to detect a small to medium effect size (f (V) test = .15) with power of at least .80 and an alpha level of .05, a sample size of 38 participants per condition is sufficient, assuming that all these participants complete all questionnaires. Because drop-out rates at follow-up stage have been reported as high as 70%  in trials of Internet-based mental health interventions, it is proposed that a total of 200 young people be recruited initially.
Ethical approval and trial registration
The proposed study will be conducted in accordance with the ethical guidelines outlined in the National Statement on Ethical Conduct in Human Research . Ethical approval for this study was granted by the Human Research Ethics Committees of Swinburne University of Technology (SUHREC Project 2011/109) and Federation University Australia (B11-077) in June 2011. The trial has been registered with the Australian New Zealand Clinical Trial Registry since 7 July 2011: ACTRN12611000700932.
This paper describes the study protocol for the development and evaluation of a mental health prevention program for SSAYA. Despite having a higher incidence of mental health problems than adults 25 years of age or over , only 1 in 4 young people with mental health problems receive professional help and there is a shortage of trained health professionals available to help them . If successful, this online intervention will represent a significant step forward in terms of prevention and early intervention of mental health problems in SSAYA, and addressing barriers associated with stigma and geographic, social and financial isolation. The anticipated strengths and potential limitations of this study are detailed below.
The proposed program is unique and sophisticated, not only in targeting the mental health needs of SSAYA but in tailoring the program content to gender and symptom profile. The personalisation of this program and online nature may help to make it more attractive and engaging for young people than traditional face-to-face alternatives. Moreover, the integrated nature of the intervention enables the simultaneous treatment of multiple mental health symptoms within one program. This is a unique feature of the program, streamlining health care for the young person, as well as acknowledging the uniqueness of each user. This is expected to be a particularly important outcome for SSAYA in rural or regional areas. We expect the findings will enhance our understanding of the impact of internalised homophobia on recovery-related outcomes. We also anticipate that the use of the control condition will enable greater insight into the unique contribution of this program compared to standard mental health and wellbeing services available to SSAYA.
Despite these strengths, three potential limitations of this study design should be acknowledged. Firstly, each participant with a different set of symptoms identified at pre-intervention assessment will get different intervention content due to their receiving content for a different number and combination of types of symptoms when they do the Out & Online program. The main comparison with the wait-list control group cannot take these different interventions into account but follow-up statistical analyses will target the efficacy of interventions for each symptom type in isolation and in combination with other symptom types using regression analyses.
Secondly, participant drop-out is a potential challenge, particularly given the self-help nature of the intervention . To enhance motivation, the program modules are deliberately brief and incorporate interactive exercises, videos, audios, pictures and downloadable tip sheets. Contact details are provided on the website in case of questions or technical details. To encourage survey completion automated Emails are sent to participants and they are required to complete the K10 every 2 weeks while in the program in order to regain access to content. Sample size and power calculations have taken into account potential attrition and a conservative intention-to-treat analysis will be complimented with a longitudinal multi-level analysis to ameliorate the effects of drop-out at follow-up.
A third potential limitation is that the intervention is being compared to a wait-list control group, whereby participants will be able to access alternate evidence-based mental health services, including CBT. Information will be collected from participants about mental health service usage and the potential impact of this on outcomes will be statically controlled for.
In summary, SSAYA are at greater risk of poor mental health outcomes compared to their heterosexual peers. The provision of a preventive online mental health and wellbeing program, tailored to the gender and symptoms of the participant, may provide a cost-effective, anonymous and flexible medium for improving mental health outcomes for these individuals.
Recruitment began on 23 July 2014 and will continue until February 2015.
JA is a health psychologist and research fellow at the National eTherapy Centre, Swinburne University of Technology. BK is a clinical psychologist, Professor of Psychology and eHealth at Federation University Australia, a Visiting Fellow at the ANU and an Adjunct Professor at Swinburne University of Technology. SM is a psychologist, Professor of Psychology and Head of Psychology at Federation University Australia. DA is a clinical psychologist and Associate Professor of Psychology at Deakin University. MM is a clinical psychologist and lecturer in psychology at Federation University Australia. DM is a statistician and Associate Professor in Statistics, Data Science and Epidemiology at Swinburne University of Technology. BM is a provisional psychologist, research assistant and PhD (clinical psychology) candidate at Swinburne University of Technology.
Cognitive behaviour therapy
Posttraumatic stress disorder
Randomised controlled trial
Social anxiety disorder
Same-sex attracted young adults.
Burton CM, Marshal MP, Chisolm DJ, Sucato GS, Friedman MS: Sexual minority related victimization as a mediator of mental health disparities in sexual minority youth: a longitudinal analysis. J Youth Adolesc. 2013, 42: 394-402. 10.1007/s10964-012-9901-5.
Marshal MP, Dietz LJ, Friedman MS, Stall R, Smith HA, McGinley J, Thoma BC, Murray PJ, D'Augelli AR, Brent DA: Suicidality and depression disparities between sexual minority and heterosexual youth: a meta-analytic review. J Adolesc Health. 2011, 49: 115-123. 10.1016/j.jadohealth.2011.02.005.
Russell ST, Joyner K: Adolescent sexual orientation and suicide risk: evidence from a national study. Am J Public Health. 2001, 91: 1276-1281. 10.2105/AJPH.91.8.1276.
Wichstrøm L, Hegna K: Sexual orientation and suicide attempt: a longitudinal study of the general Norwegian adolescent population. J Abnorm Psychol. 2003, 112: 144-151.
Almeida J, Johnson RM, Corliss HL, Molnar BE, Azrael D: Emotional distress among LGBT youth: the influence of perceived discrimination based on sexual orientation. J Youth Adolesc. 2009, 38: 1001-1014. 10.1007/s10964-009-9397-9.
Bos HMW, Sandfort TGM, de Bruyn EH, Hakvoort EM: Same-sex attraction, social relationships, psychosocial functioning, and school performance in early adolescence. Dev Psychol. 2008, 44: 59-68.
Galliher RV, Rostosky SS, Hughes HK: School belonging, self-esteem, and depressive symptoms in adolescents: an examination of sex, sexual attraction status, and urbanicity. J Youth Adolesc. 2004, 33: 235-245.
Hatzenbuehler ML, McLaughlin KA, Xuan Z: Social networks and risk for depressive symptoms in a national sample of sexual minority youth. Soc Sci Med. 2012, 75: 1184-1191. 10.1016/j.socscimed.2012.05.030.
King M, Semlyen J, Tai SS, Killaspy H, Osborn D, Popelyuk D, Nazareth I: A systematic review of mental disorder, suicide, and deliberate self harm in lesbian, gay and bisexual people. BMC Psychiatry. 2008, 8: 70-10.1186/1471-244X-8-70.
Williams T, Connolly J, Pepler D, Craig W: Peer victimization, social support, and psychosocial adjustment of sexual minority adolescents. J Youth Adolesc. 2005, 34: 471-482. 10.1007/s10964-005-7264-x.
D’Augelli AR, Grossman AH, Starks MT: Childhood gender atypicality, victimization, and PTSD among lesbian, gay, and bisexual youth. J Interpers Violence. 2006, 21: 1462-1482. 10.1177/0886260506293482.
Safren SA, Pantalone DW: Social anxiety and barriers to resilience among lesbian, gay, and bisexual adolescents. Contemporary perspectives on lesbian, gay, and bisexual psychology. Sexual Orientation and Mental Health: Examining Identity and Development in Lesbian, Gay, and Bisexual People. Contemporary Perspectives on Lesbian, Gay, and Bisexual Psychology. Edited by: Omoto AM, Kurtzman HS. 2006, Washington, DC: American Psychological Association, 55-71.
Lewis R, Derlega V, Griffen J, Krowinski A: Stressors for gay men and lesbians: life stress, gay-related stress, stigma consciousness, and depressive symptoms. J Soc Clin Psychol. 2003, 22: 716-729. 10.1521/jscp.22.6.716.22932.
Szymanski DM, Chung YB, Balsam KF: Psychosocial correlates of internalized homophobia in lesbians. Measurement Eval Counsel Dev. 2001, 34: 27-38.
Huebner D, Rebchook G, Kegeles S: Experiences of harassment, discrimination, and physical violence among young gay and bisexual men. Am J Public Health. 2004, 94: 1200-1203. 10.2105/AJPH.94.7.1200.
Balsam K, Rothblum E, Beauchaine T: Victimization over the lifespan: a comparison of lesbian, gay, bisexual, and heterosexual siblings. J Consult Clin Psychol. 2005, 73: 477-487.
Elze DE: Gay, lesbian and bisexual youths’ perceptions of their high school environments and comfort in school. Child Sch. 2003, 25: 225-239. 10.1093/cs/25.4.225.
Kosciw JG, Greytak EA, Bartkiewicz MJ, Boesen MJ, Palmer NA: The 2011 National School Climate Survey: The Experiences of Lesbian, Gay, Bisexual and Transgender Youth in Our Nation's Schools. 2012, New York: The Gay, Lesbian and Straight Education Network
Van Wormer K, McKinney R: What schools can do to help gay/lesbian/bisexual youth: a harm reduction approach. Adolescence. 2003, 38: 409-420.
Gonsiorek JC: Mental health issues of gay and lesbian adolescents. Psychological Perspectives on Lesbian and Gay Male Experiences. Edited by: Garnets D, Kimmel DC. 1993, New York: Columbia University Press, 469-485.
Olson ED, King CA: Gay and lesbian self-identification: a response to Rotheram-Borus and Fernandez. Suicide Life Threat Behav. 1995, 25: 35-39.
Igartua KJ: Internalized homophobia: a factor in depression, anxiety and suicide in the gay and lesbian population. Can J Commun Ment Health. 2003, 22: 15-30. 10.7870/cjcmh-2003-0011.
Shidlo A: Internalized homophobia: conceptual and empirical issues in measurement. Lesbian and Gay Psychology: Theory Research and Clinical Application. Edited by: Greene B, Herek GM. 1994, Thousand Oaks, CA: Sage, 176-205.
Newcomb ME, Mustanski B: Internalized homophobia and internalizing mental health problems: a meta-analytic review. Clin Psychol Rev. 2010, 30: 1019-1029. 10.1016/j.cpr.2010.07.003.
Cass VC: Homosexual identity formation: a theoretical model. J Homosex. 1979, 4: 219-235. 10.1300/J082v04n03_01.
Troiden R: Becoming homosexual: a model of gay identity acquisition. Psychiatry. 1979, 42: 362-373.
Rozbroj T, Lyons A, Pitts M, Mitchell A, Christensen H: Assessing the applicability of E-therapies for depression, anxiety, and other mood disorders among lesbians and gay men: analysis of 24 web-and mobile phone-based self-help interventions. J Med Internet Res. 2014, 16 (7): e166-10.2196/jmir.3529.
Quinn K: Rural suicide and same-sex attracted youth: issues, interventions and implications for rural counsellors. Rural Remote Health. 2003, 3: 222-
Leonard W: Health and Sexual Diversity: A Health and Wellbeing Plan for Gay, Lesbian, Bisexual, Transgender and Intersex (GLBTI) Victorians. 2003, Melbourne, Australia: Department of Human Services
Willing CE, Salvador M, Kano M: Pragmatic help seeking: how sexual and gender minority groups access mental health care in a rural state. Psychiatr Serv. 2006, 57: 871-874. 10.1176/ps.2006.57.6.871.
Griffiths KM, Christensen H: Internet‒based mental health programs: a powerful tool in the rural medical kit. Aust J Rural Health. 2007, 15: 81-87. 10.1111/j.1440-1584.2007.00859.x.
Klein B, Mitchell J, Abbott J, Shandley K, Austin D, Gilson K, Kiropoulos L, Cannard G, Redman T: A therapist-assisted cognitive behavior therapy internet intervention for posttraumatic stress disorder: pre-, post- and 3-month follow-up results from an open trial. J Anxiety Disord. 2010, 24: 635-644. 10.1016/j.janxdis.2010.04.005.
Lau MA: Problems and potential in rolling out low intensity CBT interventions in rural communities. Oxford Guide to Low Intensity CBT Interventions. Edited by: Bennett-Levy J, Richards DA, Farrand P, Christensen H, Griffiths KM, Kavanagh DJ, Klein B, Lau MA, Proudfoot J, Ritterband L, White J, Williams C. 2010, Oxford: Oxford University Press, 559-565.
Kiropoulos LA, Klein B, Austin DW, Gilson K, Pier C, Mitchell J, Ciechomski L: Is internet-based CBT for panic disorder and agoraphobia as effective as face-to-face CBT?. J Anxiety Disord. 2008, 22: 1273-1284. 10.1016/j.janxdis.2008.01.008.
Klein B, Cook S: Preferences for e-mental health services amongst an online Australian sample. J Appl Psychol. 2010, 6: 27-38.
Griffiths KM, Farrer L, Christensen H: The efficacy of internet interventions for depression and anxiety disorders: a review of randomised controlled trials. Med J Aust. 2010, 192: S4-
Lintvedt OK, Griffiths KM, Sørensen K, Østvik AR, Wang CE, Eisemann M, Waterloo K: Evaluating the effectiveness and efficacy of unguided internet‒based self‒help intervention for the prevention of depression: a randomized controlled trial. Clin Psychol Psychother. 2013, 20: 10-27. 10.1002/cpp.770.
Australian Bureau of Statistics: Australian Social Trends June 2011: Children of the Digital Revolution; catalogue number 4102.0. 2011, Canberra: ABS
Australian Bureau of Statistics: Household Use of Information Technology, Australia, 2012-2013, catalogue number 8146.0. 2014, Canberra: ABS
Marks IM, Cavanagh K, Gega L: Hands on Help: Computer-aided Psychotherapy. 2007, Florence, NY: Taylor and Francis
Shandley K, Austin D, Klein B, Kyrios M: An evaluation of ‘Reach Out Central’: an online therapeutic gaming program for supporting the mental health of young people. Health Educ Res. 2010, 25: 563-574. 10.1093/her/cyq002.
Gerrits RS, van der Zanden RAP, Visscher RFM, Conijin BP: Master your mood online: a preventative chat group intervention for adolescents. Aust e-J Adv Mental Health. 2007, 6: 6-16.
Van Voorhees BW, Fogel J, Pomper BE, Marko M, Reid N, Watson N, Larson J, Bradford N, Fagan B, Zuckerman S, Wiedmann P, Domanico R: Adolescent dose and ratings of an internet-based depression prevention program: a randomized trial of primary care physician advice versus a motivational interview. J Cogn Behav Psychother. 2009, 9: 1-19.
Clarke G, Kelleher C, Hornbrook M, DeBar L, Dickerson J, Gullion C: Randomized effectiveness trial of an internet, purse self-help, cognitive behavioral intervention for depressive symptoms in young adults. Cognit Behav Ther. 2009, 38: 222-234. 10.1080/16506070802675353.
Calear AL, Christensen H: Review of internet-based prevention and treatment programs for anxiety and depression in children and adolescents. Med J Aust. 2010, 192: S12-
Spitzer RL, Kroenke K, Williams JB, Lowe B: A brief measure for assessing Generalized Anxiety Disorder: The GAD-7. Arch Intern Med. 2006, 166: 1092-1097. 10.1001/archinte.166.10.1092.
Shear MK, Brown TA, Barlow DH, Money R, Sholomskas DE, Woods SW, Gorman JM, Papp LA: Multicenter collaborative panic disorder severity scale. Am J Psychiatr. 1997, 154: 1571-1575. 10.1176/ajp.154.11.1571.
Foa EB, Huppert JD, Leiberg S, Langner R, Kichic R, Hajcak G, Salkovskis PM: The Obsessive-Compulsive Inventory: development and validation of a short version. (Psychol Assess. 2002, 14: 485-496.
Weisler RH, Foa E, Connor KM, Davidson JRT, Churchill E, Sherwood A: Psychometric properties of the Social Phobia Inventory (SPIN). Br J Psychiatr. 2000, 176: 379-386. 10.1192/bjp.176.4.379.
Weathers FW, Keane TM, Davidson JR: Clinician-administered PTSD Scale: a review of the first ten years of research. Depress Anxiety. 2001, 13: 132-156. 10.1002/da.1029.
Marks IM, Mathews AM: Brief standard self-rating for phobic patients. Behav Res Ther. 1979, 17: 263-267. 10.1016/0005-7967(79)90041-X.
Pitzer RL, Kroenke K, Williams JBW: Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. JAMA. 1999, 282: 1737-1744. 10.1001/jama.282.18.1737.
Kessler RC, Barker PR, Colpe LJ, Esptein JF, Gfroerer JC, Hiripi E, Howes MJ, Normand S-L,T, Manderscheid RW, Walters EE, Zaslavsky AM: Screening for serious mental illness in the general population. Arch Gen Psychiatr. 2003, 60: 184-189. 10.1001/archpsyc.60.2.184.
Furukawa TA, Kessler RC, Slade T, Andrews G: The performance of the K6 and K10 screening scales for psychological distress in the Australian National Survey of Mental Health and Well-Being. Ir J Psychol Med. 2003, 33: 357-362. 10.1017/S0033291702006700.
Diener E, Emmons RA, Larsen R, Griffin S: The Satisfaction with Life Scale. J Pers Soc Psychol. 1985, 57: 1069-1081.
Keyes CLM: The subjective well-being of America’s youth: toward a comprehensive assessment. Adolesc Fam Health. 2005, 4: 3-11.
Herek GM, Gillis JR, Cogan JC: Internalized stigma among sexual minority adults: insights from a social psychological perspective. J Couns Psychol. 2009, 56: 32-43.
Fischer EH, Farina A: Attitudes toward seeking professional psychological help: a shortened form and considerations for research. J Coll Stud Dev. 1995, 36: 368-373.
Wallston KA, Stein MJ, Smith CA: Form C of MHLC scales: a condition-specific measure of locus of control. J Pers Assess. 1994, 63: 534-553. 10.1207/s15327752jpa6303_10.
Faul F, Erfelder E, Lang A-G, Buchner A: G*Power 3: a flexible statistical power analysis program for the social, behavioural and biomedical sciences. Behav Res Meth. 2007, 39: 175-191. 10.3758/BF03193146.
Abbott J, Klein B, Hamilton C, Rosenthal A: The impact of online resilience training for sales managers on wellbeing and work performance. J Appl Psychol. 2009, 5: 89-95. 10.7790/ejap.v5i1.145.
National Statement on Ethical Conduct in Human Research (2007-updated December 2013): The National Health and Medical Research Council, the Australian Research Council and the Australian Vice-Chancellors’ Committee. 2013, Canberra: Commonwealth of Australia
Sawyer MG, Arney FM, Baghurst PA, Clark JJ, Graetz BW, Kosky RJ, Nurcombe B, Patton GC, Prior MR, Raphael B, Rey J, Whaites LC, Zubrick SR: The Mental Health of Young People in Australia. 2000, Canberra, Australia: Commonwealth Department of Health and Aged Care
Wojtowicz M, Day V, McGrath PJ: Predictors of participant retention in a guided online self-help program for university students: prospective cohort study. J Med Internet Res. 2013, 15 (5): e96-10.2196/jmir.2323.
Acknowledgements and Funding
This study is primarily funded by beyondblue Victorian Centre of Excellence in Depression, Anxiety and Related Disorders, with some additional funding from the National eTherapy Centre, Swinburne University of Technology.
We thank the following people who contributed to program development: Ms Gemma DeMarco, Jacqueline Baulch, Amy Williamson, Eric O, Shane Byron, Andrew Smith, Claire Young, Lucian Chaffey, and Robert Shaw. Prof Michael Kyrios contributed as an investigator to the protocol that was submitted to and funded by beyondblue.
We wish to thank Triforce Australia, Plain Black Corporation, Framework Media and Lucian Chaffey for contributing to website development and video production.
We are grateful to Chantal Nagib and Alan Woodward from Lifeline Australia for providing expert review of the suicide prevention content and contributing to the protocol development. We thank the people who took part in the usability testing of the program.
The author(s) declare that they have no competing interests.
BK, SM, DA, JA, MM and DM are principal investigators for the project. BK conceptualised the program, trial design and eScreener, with contributions from SM, DA, JA, MM and DM. The program content was developed by JA, BK and research assistants by adapting existing program content on the Anxiety Online platform (now on the Mental Health Online platform) and the content was reviewed by SM, DA and MM. JA, BK, SM and BM wrote the manuscript, with significant contributions and revisions from DA, MM and DM. BM assisted with finalising program content and is assisting JA to coordinate recruitment for the RCT. All authors discussed, revised and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Abbott, J.M., Klein, B., McLaren, S. et al. Out & Online; effectiveness of a tailored online multi-symptom mental health and wellbeing program for same-sex attracted young adults: study protocol for a randomised controlled trial. Trials 15, 504 (2014) doi:10.1186/1745-6215-15-504
- eMental health
- Same-sex attraction
- Young adults
- Sexual orientation
- Mental health
- Randomised controlled trial
- Cognitive behaviour therapy