Skip to main content

Potential mental health-related harms associated with the universal screening of anxiety and depressive symptoms in Australian secondary schools

Abstract

Background

Anxiety and depressive disorders typically emerge in adolescence and can be chronic and disabling if not identified and treated early. School-based universal mental health screening may identify young people in need of mental health support and facilitate access to treatment. However, few studies have assessed the potential harms of this approach. This paper examines some of the potential mental health-related harms associated with the universal screening of anxiety and depression administered in Australian secondary schools.

Methods

A total of 1802 adolescent students from 22 secondary schools in New South Wales, Australia, were cluster randomised (at the school level) to receive either an intensive screening procedure (intervention) or a light touch screening procedure (control). Participants in the intensive screening condition received supervised self-report web-based screening questionnaires for anxiety, depression and suicidality with the follow-up care matched to their symptom severity. Participants in the light touch condition received unsupervised web-based screening for anxiety and depression only, followed by generalised advice on help-seeking. No other care was provided in this condition. Study outcomes included the increased risk of anxiety, depression, psychological distress, decreased risk of help-seeking, increased risk of mental health stigma, determined from measures assessed at baseline, 6 weeks post-baseline, and 12 weeks post-baseline. Differences between groups were analysed using mixed effect models.

Results

Participants in the intensive screening group were not adversely affected when compared to the light touch screening condition across a range of potential harms. Rather, participants in the intensive screening group were found to have a decreased risk of inhibited help-seeking behaviour compared to the light touch screening condition.

Conclusions

The intensive screening procedure did not appear to adversely impact adolescents’ mental health relative to the light touch procedure. Future studies should examine other school-based approaches that may be more effective and efficient than universal screening for reducing mental health burden among students.

Trial registration Australian and New Zealand Clinical Trials Registry (ACTRN12618001539224) https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=375821.

Introduction

Anxiety and depressive disorders can be chronic and disabling if not identified and treated early in the course of illness [21]. Universal mental health screening of adolescents has emerged as one potential method of the timely identification of young people in need of mental healthcare and support. By using validated questionnaires, screening can identify adolescents who may (a) have an increased risk of these illnesses or are experiencing subsyndromal symptoms so that preventive action can be taken, or (b) have undiagnosed, clinically significant levels of illness so that treatment can be administered. Using screening to triage adolescents into appropriate treatments may help to reduce symptoms and accelerate recovery, leading to improved future health outcomes [38]. There has been growing calls internationally for the broader uptake of mental health screening in settings where young people frequent, including health services and schools [16, 19, 48]. In 2016, the U.S. Preventive Services Task Force (USPSTF) recommended screening for major depressive disorder in adolescents aged 12 to 18 years [38] and recently [46] expanded this advice to include the screening for anxiety [45]. In Australia, the Federal government also recently invested over $10 million Australian dollars in a universal mental health and wellbeing screening tool for schools [9]. Conversely, the Royal Australian College of General Practitioners do not recommend routine screening for depression in adolescents in primary care [31]. While evidence-based practice calls for high quality evidence, a major challenge for policy makers in this domain is the limited informativeness of past trials for determining the potential harms of mental health screening in adolescents.

There is limited evidence from RCTs on the overall benefits of mental health screening programs in improving health outcomes, and an even greater gap in understanding the potential harms related to the screening process. The USPSTF recommendations were based on a review of 80 studies that evaluated the benefits or harms of screening for depression, anxiety, and suicide risk compared to ‘no screening’ or ‘usual care’. The evidence considered by the USPSTF primarily focused on the benefits and harms of exposing youth to anxiety and depression treatments and the accuracy of screening questionnaires, rather than the harms associated with other aspects of the screening processes such as the level of supervision, support, and intervention offered to participating youth [49]. Two systematic reviews Williams et al. [50] and Roseman et al. [36]) found no RCTs examining the effects of depression screening on outcomes for children and adolescents. This lack of evidence was further confirmed in a later review by Anderson et al. [2], who found only one RCT examining the utility of universal screening programs for youth mental health. Some recent RCTs have examined various screening approaches in schools, with mixed findings [14, 20, 27, 37]. Sekhar et al. [37] found that adolescents who underwent universal screening for depression at school were 5.9 times more likely to be detected, 3.3 times more likely to confirm the need for treatment, and 2.1 times more likely to start, when compared to targeted screening [14, 20, 27, 37]. This is consistent with Husky et al. [14], who also found that universal screening in schools led to a significantly greater proportion of youth being identified and referred to services than targeted screening. In a large, multi-site trial across six middle schools in the United States, Makover et al. [20] showed that universal screening was an effective method of detecting students who would benefit from a targeted depression intervention. In Australia, O'Dea et al. [27] found that a web-based screening platform with stepped-care interventions for depression and anxiety significantly improved adolescents’ likelihood of seeking help, but had no effect on their depressive symptoms. However, none of these studies explicitly examined the potential harms that may be associated with screening processes in adolescents.

When undertaken without adequate supervision and support, universal screening for depression and anxiety may induce distress through emotional activation and increased self-awareness of negative symptoms [35, 39]. Inaccurate screening results may fail to identify all those in need or may lead to unnecessary intervention and overtreatment, wasted time and resources, victimisation, stigma, isolation, shame, and negative stereotyping [2, 10, 35, 41]. Although universal mental health screening in schools is generally supported by parents and teachers [23, 28, 40], one in 10 parents have reported perceived harms due to lack of trained staff, and potential discomfort and stigmatisation of the student [40]. School counsellors have also reported specific concerns about parental agreement, students’ readiness for follow-up, and adequate resourcing of counsellors to care for all students in need [6, 26, 28]. These concerns have were validated in Sekhar and colleagues [37] large (n > 12 k) school-based screening trial for depression, which found that the primary reason for failure of treatment initiation among students was lack of parent or individual consent. Screening may provide schools with important data on the need for mental health programs and help to guide decision-makers in selecting and targeting such programs. For example, a US County Schools Mental Health Coalition uses the prevalence of positive cases identified through screening to determine whether universal (prevalence rate > 20%) or selective programs (prevalence rate < 15%) are required [32]. However, the level of potential harm associated with different screening procedures and components remains unclear. A growing number of research trials have shown that some school-based mental health programs do result in iatrogenic effects [4, 12, 22]. As school-based screening programs are resource intensive, in terms of time, personnel, infrastructure, equipment and training [13, 41], it is important for schools to carefully consider the suitability of these activities, to ensure that limited resources are being used effectively and efficiently to maximize benefits for students. It is vital for researchers and service designers to explicitly examine the potential harms of school-based screening with student mental health outcomes of paramount importance.

Objectives of the current paper

This paper explores some of the potential mental health-related harms associated with the universal screening of anxiety and depression administered in Australian secondary schools as part of a cluster RCT that examined the effectiveness of a digital mental health service for improving adolescents’ help-seeking [25, 27, 29]. This paper presents a secondary data analysis of this recent RCT as its design presents a unique opportunity to compare whether a more intensive screening procedure for anxiety and depression is associated with greater risk of potential mental health-related harms when compared to a control condition that involved a light touch screening procedure (see Fig. 1). For example, schools have mandatory reporting procedures that are initiated when a person reports suicidality. As a result, the use of this additional measure may lead unintended harm to students by initiating this process.

Fig. 1
figure 1

Brief overview of screening procedures examined in current study

In contrast to past work, this paper explicitly defines and measures student-level harms that are relevant to decision-makers wishing to compare school-based screening processes. In the current paper, the potential mental health-related harms examined were:

  1. (i)

    The increased risk of anxiety and depressive symptoms and psychological distress;

  2. (ii)

    The increased risk of deterioration in help-seeking and daily functioning;

  3. (iii)

    The increased risk of mental health stigma.

Hypotheses were framed in terms of the more intensive screening procedure (i.e., intervention condition) being no worse than the light touch screening procedure (i.e., control condition) and inferences were primarily based on point estimates and confidence intervals rather than significance to determine the risk of harms [11, 44]. Based on previous findings [3, 35, 41], it was hypothesised that students who received the more intensive screening procedure would show no increase in risk of harm compared to students who received the ‘light touch’ procedure. These findings sought to provide the first evidence from an RCT on the potential mental health-related harms of universal screening and subsequent intervention for symptoms of anxiety and depression in the secondary school setting.

Method

Design

This paper is a secondary analysis of a two-arm 12 week cluster RCT. The trial was undertaken between February and December 2018 in secondary schools in New South Wales, Australia. Schools were the clusters and individual students were the participants [25, 27]. The full trial protocol [25] and primary outcomes [27] have been published elsewhere. All mental health-related harms examined in this paper pertain to the individual participant level.

Participants

Secondary school adolescents (age range: 11–19 years) from grades (7–12) who attended participating schools were eligible to take part. A total of 1098 students from 12 schools were allocated to the control condition and 704 students from 10 schools were allocated to the intervention (CONSORT chart provided in Additional file 1: Fig. S1). Participation was voluntary and parents/guardians who did not wish for their child to take part were instructed to notify the school or research team prior to the baseline assessment. Students provided informed online consent during the baseline assessment in the presence of the research team and a school representative.

Screening procedures

Intensive screening procedure (Intervention condition)

As outlined in Fig. 1 and described in Additional file 1 the intensive screening procedure offered schools a comprehensive approach to universal screening, intervention and monitoring for anxiety and depression. Students in this condition completed the self-report screening measures for generalised anxiety and depressive symptoms using a web-based service platform called ‘Smooth Sailing’. This screening procedure involved an additional depressive symptom scale (Patient Health Questionnaire—9—Adolescent version, PHQ-9; [17], which included one item to assess students’ suicidality (i.e., thoughts of death and/or self-harm). Upon completion of the self-report screeners, the service then automatically recommended students complete activities that were matched to their symptom severity. The recommended activities were displayed to students on a personalised dashboard within the Smooth Sailing platform, which also provided generalised feedback on symptom severity. Using the thresholds of the GAD-7 and PHQ-9 screeners, students with ‘nil’ to ‘mild’ symptoms were recommended to complete a series of interactive, online, self-directed psycho-education modules that were hosted within the web-based platform. Students with ‘mild’ to ‘moderate’ symptoms were recommended to complete MoodGYM or BRAVE Online (two online, evidence-based, self-directed cognitive behavioural therapy programs for depression and anxiety in youth). Students with ‘moderately severe’ to ‘severe’ symptoms or who reported suicidality received an in-person follow-up with a school counsellor within 48 h. After 6 weeks, students repeated the mental health screening, and the level of intervention was then ‘stepped up’ in response to students’ deterioration. In this condition, all three screening sessions were conducted in the presence of a researcher, teacher, and school counsellor. The school counsellor was required to be onsite for 2 days after the screening sessions to ensure all students in need were attended to. School counsellors were given access to a purpose-built, secure online platform that enabled them to log in to identify and monitor the identified students. School counsellors were also provided with a list of local mental health service and supports that they could refer students to. The research team contacted all participating school counsellors after 48 h of the screening sessions to ensure all follow-ups had been conducted.

Light touch screening procedure (Control condition)

Students in this condition completed the screening measures using an identical web-based platform to the screening procedure 1; however, the PHQ-9 scale (which included the measure on suicidality) was not administered. Upon completion of the screening measures, students in this condition were not given access to any of the additional processes or components (i.e., symptom feedback, psycho-education modules, online cognitive behavioural therapy program, follow-ups with the school counsellor). Instead, all students were displayed information on a range of different youth mental health services and support (including in-person, web-based and telephone services). This information was also provided to students as a one-page printed handout. In this arm, the screening procedure was conducted in the presence of a researcher and schoolteacher. The school counsellor was required to be onsite only on the day of screening but did not attend the screening sessions. No additional contact was made with the schools after each screening session. No limitations were placed on these students’ mental healthcare activities, practices, or help-seeking during the study period.

Measures of mental health-related harms

Depressive symptoms

Depressive symptoms were measured using the Centre for Epidemiologic Studies Depression Scale—Child version (CES-DC) [34]. This 20-item self-report scale was administered at baseline and 12 weeks post-baseline. Item scores were summed, with higher scores indicative of greater depressive symptoms. For the sample included in this paper, participants’ total scores ranged from 0 to 60 and Cronbach’s alpha was 0.93. For this paper, total scores ≥ 16 were classified as clinically meaningful cases and ‘new’ cases were participants who emerged as a case only at week 12.

Anxiety symptoms

Anxiety symptoms were measured using the Generalised Anxiety Disorder Questionnaire (GAD-7) [42]. This 7-item self-report scale was administered at baseline and 12 weeks post-baseline. Item scores were summed, with higher scores indicative of greater anxiety with the following score descriptors: ‘nil to mild’ (0–9), ‘moderate’ (10–14), or ‘moderately severe to severe’ (≥ 15). For the sample included in this paper, participants’ total scores ranged from 0 to 21 and the Cronbach’s alpha was 0.89. For this paper, total scores ≥ 10 were classified as clinically meaningful cases and ‘new’ cases were participants who emerged as a case only at week 12.

Psychological distress

Psychological distress was measured using the Distress Questionnaire-5 (DQ5) [5]. This 5-item self-report scale was administered at baseline and 12 weeks post-baseline. Item scores were summed, with higher scores indicative of greater psychological distress. For the sample included in this paper, total scores ranged from 5 to 25 and the Cronbach’s alpha was 0.88. For this paper, total scores ≥ 14 were classified as clinically meaningful cases [5] and ‘new’ cases were participants who emerged as a case only at week 12.

Help-seeking intentions and behaviour

The General Help-Seeking Questionnaire (GHSQ) [51] was used to measure participants’ intentions to seek help for general mental health problems. This was administered at baseline and 12 weeks post-baseline. Using a 5-point Likert scale, participants were asked to rate how likely they were to seek help from 13 sources when having a tough time with their mental health. Item scores were summed, with higher scores indicative of greater intentions to seek help. For the sample included in this paper, the total scores ranged from 13 to 65 and the Cronbach’s alpha was 0.87. The Actual Help-Seeking Questionnaire (AHSQ) [33] was used to measure help-seeking behaviour for mental health among participants. Participants were asked whether they had turned to the same list of sources outlined in the GHSQ for help with any mental health issue in the past three months (answered yes or no). For this paper, the 12-week assessment was utilised and participants were classified as an ‘inhibited help-seeker’ based on whether they self-identified as needing support for their mental health but did not seek help from anyone (i.e. those who answered yes to the final item of AHSQ “I needed support but I did not seek help from anyone”).

Mental health stigma

This was measured using the Mental Health Literacy Scale (MHLS) [24]. This 13-item composite scale measured students’ confidence in seeking help (4 items) and their level of stigmatising attitudes towards mental illness (9 items) at baseline and 12 weeks post-baseline. Items were rated on a 5-point Likert scale. Item scores were summed, with higher total scores indicative of greater confidence in help-seeking and lower levels of stigma. The MHLS has demonstrated good internal and test–retest reliability and has been used in school-based mental health research [47]. For the sample included in this paper, participants’ scores ranged from 13 to 65 and the Cronbach’s alpha was 0.71.

Daily functioning

To determine the functional impairment caused by their mental health problems, participants were asked to rate “how difficult have your mental health problems made it for you to do your schoolwork, take care of things at home, or get along with your mates and family?” using a 4-point Likert scale with answers ranging from “not difficult at all” to “extremely difficult”. This question is a supplementary item within the adolescent version of the PHQ-9 scale [17]. In this sample, participants scores ranged from 0 to 3. For this paper, the 12-week assessment was utilised and participants were classified as ‘Not impaired’ (i.e., those who responded, “not difficult at all” or “somewhat difficult”) or ‘Impaired’ (i.e., those who responded, “very difficult” or “extremely difficult”).

Reliable change scores

As the GHSQ and MHLS do not have established cut-points, reliable change (RC) scores were calculated to assess meaningful individual-level change. Individual difference scores were calculated by subtracting the total score at baseline (\({{\text{X}}}_{1}\)) from the total score at 12 weeks post-baseline (\({{\text{X}}}_{2}\)). These difference scores were then used to calculate RC scores (for formulas used to calculate RC scores, see Additional file 1: Text S2). \({\text{RC}}\le -1.96\) and \({\text{RC}}\ge 1.96\) indicate a statistically significant difference from the average difference score and therefore reflect a “reliable change.”

Harms analysis

Case classification, reliable change, and other classifications were then used to calculate several measures such as risk ratios and risk differences. Equations for each of these measures are presented in Additional file 1: Table S1 and were computed for each outcome by comparing the occurrence of that outcome among students in the screening condition (i.e., Experimental Event Rate [EER]) to its occurrence among students in the control condition (i.e., Control Event Rate [CER]).

Statistical analyses

All analyses were conducted using Stata 17.0 [43]. Group differences between the conditions at baseline were examined using mixed linear or logit models. Baseline characteristics were included as the dependent variables, condition was included as a fixed effect, and school was included as a cluster random effect. Poisson generalised linear models with robust standard errors were used to estimate the relative risk of harmful outcomes between the conditions, which have shown to outperform log binomial models when calculating risk ratios [8, 52]. Outcomes (i.e., case classifications, reliable change scores, and other classifications) were included as the dependent variables, condition was included as a fixed effect, and school was included as a cluster random effect. Population average estimates were used instead of cluster specific estimates to control for the effects over clusters. Intracluster correlation coefficients (ICC) were calculated to examine the impact of clustering. The ∞ component of the confidence intervals for relative risk of harmful outcomes indicates instances where the statistical test is non-significant. Specifically, these instances occur when transforming both positive and negative values (and hence spans zero), resulting in confidence intervals that encompass two disjointed regions (e.g., NNTB to ∞, NNTH to ∞). As a result, confidence intervals were expressed as number needed to treat for harm (NNTH) to ∞ to number need to treat for benefit (NNTB) for continuity, in line with Altman [1].

Results

Participants

Participant characteristics are presented in Table 1. No significant differences were found between the intensive screening group and light touch group on baseline sample characteristics. Case classification frequencies are presented in Table 2 and reliable change and other classification frequencies are presented in Table 3.

Table 1 Baseline sample characteristics for the sample (N = 1802)
Table 2 Case Classifications at baseline, 6 weeks post-baseline, and 12 weeks post-baseline
Table 3 Reliable change and other classifications

Risk measures

Event rates and risk indices for each outcome classification are presented in Table 4. Intensive screening was associated with a decreased risk of experiencing inhibited help-seeking behaviour (Relative Risk Reduction = 50%, 95% CI [27%, 74%]; Absolute Risk Reduction = 9%, 95% CI [3%, 15%]) with the NNTB indicating that 11 (95% CI [3, 19]) students needed to be screened to prevent 1 case of inhibited help-seeking behaviour. No other confidence intervals crossed the 0 threshold for risk ratios or ∞ for NNTB.

Table 4 Risk measures for each outcome classification

Discussion

This paper examined some of the potential mental health-related harms associated with two types of universal school-based screening procedures for anxiety and depression in Australian adolescents using data from a cluster RCT. Given the lack of research in this field, this investigation aimed to provide additional insights to help policy-makers and researchers determine best-practice for school-based mental health screening in Australia and worldwide. Notably, there were a high number of cases of anxiety, depression, and psychological distress in the whole sample at baseline, which offers some support to the USPSTF’s recommendation of the need for universal screening for depression and anxiety in adolescents. In the current study, students who received the more intensive screening procedure were not adversely affected when compared to those who received the light touch procedure on a range of potential mental health-related harms, including the increased risk of clinically significant symptoms of anxiety, depression, and psychological distress or the deterioration in help-seeking intentions or mental health stigma. This is an important finding, given the more intensive screening procedure involved the assessment of suicidality, the provision of symptom feedback, and mandated follow-ups with school counsellors, which may have introduced the potential for greater risk. Overall, these findings suggest that the more intensive procedure did not appear to harm students on the measures collected.

In this paper, we investigated two types of screening procedures that differed in the intensity of care and intervention provided to students as well as the resources required by the schools. We found that the more intensive screening procedure resulted in a significantly lower risk of inhibited help-seeking behaviour in students. This is consistent with the primary outcomes of the effectiveness trial [27] and is an important finding given that inhibited help-seeking behaviour (i.e., having a self-identified need for mental health support but not actively seeking help) prolongs mental distress and delays treatment gains. This finding is consistent with Sekhar et al. [37] and indicates that direct links to accessible care are required for universal screening programs to shift help-seeking outcomes in adolescents. As the positive impacts of screening on health outcomes are mitigated by individuals’ willingness to engage in the treatment provided [15], careful consideration must also be given to the interventions recommended by adolescent screening programs. In this study, adolescents’ preferences for digital therapies (e.g., increased privacy, accessibility, autonomy) may have moderated the positive effects of the intensive screening procedure on help-seeking [30]. Different levels of harm may be found when the integrated treatments do not align with adolescents’ expectations, needs and or accessibility requirements. Furthermore, the interventions provided by screening programs may also have indirect effects on adolescent mental health. In this study, the intense screening procedure may have increased students’ awareness to and openness to other school-based supports (e.g. the school counsellor) but inverse effects may be found with different screening procedures. Future trials would also benefit from extrapolating the direct and indirect effects of screening processes on adolescent health outcomes and using qualitative inquiry to capture other types of experiences that are not easily measured through questionnaires.

While students who received the more intensive screening procedure were not adversely affected on any of the mental health harms examined when compared to the light touch procedure, the more intensive procedure required significantly more resources from both the students and schools, even with the integration of self-directed digital interventions. For example, students needed to allocate more time to this approach and required ongoing access to a computer and the Internet for completion of the digital content. School counsellors were also required to allocate significantly more time to completing training on the screening procedure and portal, supervising the screening practices, and following up all students who required it. As time, resources and costs impede the uptake of school-based mental health identification programs [13, 41], the intensive procedure may therefore not be feasible for all schools, despite low levels of harm. The few studies (none from Australia) that have examined the cost-effectiveness of school-based mental health screening approaches have had mixed findings [2, 7, 18]. Future studies should therefore aim to quantify the direct costs of universal screening programs for mental health in the Australian context, in comparison with other initiatives, so that schools are better placed to evaluate program affordability, sustainability and cost versus benefits.

Limitations

This study was a secondary analysis of a cluster RCT and was not specifically designed to test for harms. As such, the findings are exploratory in nature. Further, as screening is likely to generate greatest benefit when delivered ‘en masse’, different levels of harms may emerge when larger samples from more schools are exposed to universal screening. Notably, data on other important potential harms (e.g., impact of false-positive and false-negative results, lack of treatment uptake and non-adherence, negative treatment effects) were not available for this study. While a single item was used to assess daily functioning for brevity and minimal participant burden, a more comprehensive assessment would benefit from the possibility of deeper insights into how their symptoms have impacted their daily life and relationships. The relatively short study period also limited the examination of long-term harms. There may be flow on effects of the negative experiences of universal screening on students, such as disengagement in care and reluctance to participate in other school-based mental health programs. In addition, as this study relied on voluntary participation, different levels of harms may emerge when screening is compulsory. Lastly, as suggested by Foulkes and Stringaris [12], there may be subgroups of adolescents who will experience harms from screening-related interventions, which may be masked when findings are averaged. There may also be harms associated with the different components of universal screening programs, such as the types of treatment young people are referred to, that are better captured through qualitative research.

Conclusion

Our findings suggest that the intensive screening procedure examined by this paper did not appear to increase mental health-related harms for adolescents when compared to the light touch procedure. The intensive screening procedure may offer a beneficial approach for improving aspects of help-seeking behaviour. These results may alleviate some of the concerns held by schools, parents, and students on the benefits of screening and may facilitate greater participation in these procedures. However, given the high resource burden of the intensive screening, future studies are needed to determine whether this approach is superior to other school-based interventions for improving adolescents’ mental health. Moreover, future studies on school-based mental health screening should routinely define, assess, and report on potential harms over extended periods to comprehensively evaluate the impact and net benefit for students.

Availability of data and materials

The data collected and analysed in the current trial is not currently available to researchers outside of the approved team due to constraints placed on the project by the various ethics bodies. Additional related project documents are currently available from the web-based Australian and New Zealand Clinical Trials Registry.

References

  1. Altman DG. Confidence intervals for the number needed to treat. BMJ. 1998;317(7168):1309–12. https://doi.org/10.1136/bmj.317.7168.1309.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Anderson JK, Ford T, Soneson E, Coon JT, Humphrey A, Rogers M, Moore D, Jones PB, Clarke E, Howarth E. A systematic review of effectiveness and cost-effectiveness of school-based identification of children and young people at risk of, or currently experiencing mental health difficulties. Psychol Med. 2019;49(1):9–19. https://doi.org/10.1017/s0033291718002490.

    Article  PubMed  Google Scholar 

  3. Anderson JK, Ford T, Soneson E, Coon JT, Humphrey A, Rogers M, Moore D, Jones PB, Clarke E, Howarth E. A systematic review of effectiveness and cost-effectiveness of school-based identification of children and young people at risk of, or currently experiencing mental health difficulties. Psychol Med. 2019;49(1):9–19. https://doi.org/10.1017/S0033291718002490.

    Article  PubMed  Google Scholar 

  4. Andrews JL, Birrell L, Chapman C, Teesson M, Newton N, Allsop S, McBride N, Hides L, Andrews G, Olsen N, Mewton L, Slade T. Evaluating the effectiveness of a universal eHealth school-based prevention programme for depression and anxiety, and the moderating role of friendship network characteristics. Psychol Med. 2022. https://doi.org/10.1017/s0033291722002033.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Batterham PJ, Sunderland M, Carragher N, Calear AL, Mackinnon AJ, Slade T. The distress questionnaire-5: population screener for psychological distress was more accurate than the K6/K10. J Clin Epidemiol. 2016;71:35–42. https://doi.org/10.1016/j.jclinepi.2015.10.005.

    Article  PubMed  Google Scholar 

  6. Burns JR, Rapee RM. Barriers to universal mental health screening in schools: the perspective of school psychologists. J App School Psychol. 2022;38(3):223–40. https://doi.org/10.1080/15377903.2021.1941470.

    Article  Google Scholar 

  7. Chatterji P, Caffray CM, Crowe M, Freeman L, Jensen P. Cost Assessment of a school-based mental health screening and treatment program in New York City. Ment Health Serv Res. 2004;6(3):155–66. https://doi.org/10.1023/B:MHSR.0000036489.50470.cb.

    Article  PubMed  Google Scholar 

  8. Chen W, Qian L, Shi J, Franklin M. Comparing performance between log-binomial and robust Poisson regression models for estimating risk ratios under model misspecification. BMC Med Res Methodol. 2018;18(1):63. https://doi.org/10.1186/s12874-018-0519-5.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Clare J, McBride E. Half a billion dollar investment into student wellbeing. 2023. https://ministers.education.gov.au/clare/half-billion-dollar-investment-student-wellbeing#:~:text=%24192%20million%20in%20additional%20one,get%20the%20support%20they%20need.

  10. Cosgrove L, Karter JM, Vaswani A, Thombs BD. Unexamined assumptions and unintended consequences of routine screening for depression. J Psychosom Res. 2018;109:9–11. https://doi.org/10.1016/j.jpsychores.2018.03.007.

    Article  PubMed  Google Scholar 

  11. Dunn DT, Copas AJ, Brocklehurst P. Superiority and non-inferiority: two sides of the same coin? Trials. 2018;19(1):499. https://doi.org/10.1186/s13063-018-2885-z.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Foulkes L, Stringaris A. Do no harm: can school mental health interventions cause iatrogenic harm? BJPsych Bull. 2023. https://doi.org/10.1192/bjb.2023.9.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Garbacz SA, Godfrey E, Twombly T, Collins B, Porter J, Davis E, Fischer K, Albers CA. Principal perspectives on addressing youth mental health within schools. School Ment Health. 2023. https://doi.org/10.1007/s12310-023-09588-9.

    Article  Google Scholar 

  14. Husky MM, Kaplan A, McGuire L, Flynn L, Chrostowski C, Olfson M. Identifying adolescents at risk through voluntary school-based mental health screening. J Adolesc. 2011;34(3):505–11. https://doi.org/10.1016/j.adolescence.2010.05.018.

    Article  PubMed  Google Scholar 

  15. Iragorri N, Spackman E. Assessing the value of screening tools: reviewing the challenges and opportunities of cost-effectiveness analysis. Public Health Rev. 2018;39(1):17. https://doi.org/10.1186/s40985-018-0093-8.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Kass M, Alexander L, Moskowitz K, James N, Salum GA, Leventhal B, Merikangas K, Milham MP. Parental preferences for mental health screening of youths from a multinational survey. JAMA Netw Open. 2023;6(6):e2318892–e2318892. https://doi.org/10.1001/jamanetworkopen.2023.18892.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13. https://doi.org/10.1046/j.1525-1497.2001.016009606.x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Kuo E, Vander Stoep A, McCauley E, Kernic MA. Cost-effectiveness of a school-based emotional health screening program. J Sch Health. 2009;79(6):277–85. https://doi.org/10.1111/j.1746-1561.2009.00410.x.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Lustig S, Kaess M, Schnyder N, Michel C, Brunner R, Tubiana A, Kahn J-P, Sarchiapone M, Hoven CW, Barzilay S, Apter A, Balazs J, Bobes J, Saiz PA, Cozman D, Cotter P, Kereszteny A, Podlogar T, Postuvan V, Värnik A, Resch F, Carli V, Wasserman D. The impact of school-based screening on service use in adolescents at risk for mental health problems and risk-behaviour. Eur Child Adolesc Psychiatry. 2023;32(9):1745–54. https://doi.org/10.1007/s00787-022-01990-z.

    Article  PubMed  Google Scholar 

  20. Makover H, Adrian M, Wilks C, Read K, Stoep AV, McCauley E. Indicated prevention for depression at the transition to high school: outcomes for depression and anxiety. Prev Sci. 2019;20(4):499–509. https://doi.org/10.1007/s11121-019-01005-5.

    Article  PubMed  Google Scholar 

  21. Merikangas KR, Cui L, Kattan G, Carlson GA, Youngstrom EA, Angst J. Mania with and without depression in a community sample of US adolescents. Arch Gen Psychiatry. 2012;69(9):943–51. https://doi.org/10.1001/archgenpsychiatry.2012.38.

    Article  PubMed  Google Scholar 

  22. Montero-Marin J, Allwood M, Ball S, Crane C, De Wilde K, Hinze V, Jones B, Lord L, Nuthall E, Raja A, Taylor L, Tudor K, Blakemore SJ, Byford S, Dalgleish T, Ford T, Greenberg MT, Ukoumunne OC, Williams JMG, Kuyken W. School-based mindfulness training in early adolescence: what works, for whom and how in the MYRIAD trial? Evid Based Ment Health. 2022;25(3):117–24. https://doi.org/10.1136/ebmental-2022-300439.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Moore SA, Dowdy E, Hinton T, DiStefano C, Greer FW. Moving toward implementation of universal mental health screening by examining attitudes toward school-based practices. Behavioral Disord. 2020;47(3):166–75. https://doi.org/10.1177/0198742920982591.

    Article  Google Scholar 

  24. O’Connor M, Casey L. The mental health literacy scale (MHLS): a new scale-based measure of mental health literacy. Psychiatry Res. 2015;229(1–2):511–6. https://doi.org/10.1016/j.psychres.2015.05.064.

    Article  PubMed  Google Scholar 

  25. O’Dea B, King C, Subotic-Kerry M, Anderson M, Achilles MR, Parker B, Mackinnon A, Anderson J, Cockayne N, Christensen H. Evaluating a web-based mental health service for secondary school students in Australia: protocol for a cluster randomized controlled trial. JMIR Res Protoc. 2019;8(5): e12892. https://doi.org/10.2196/12892.

    Article  PubMed  PubMed Central  Google Scholar 

  26. O’Dea B, King C, Subotic-Kerry M, O’Moore K, Christensen H. School counselors’ perspectives of a web-based stepped care mental health service for schools: cross-sectional online survey. JMIR Ment Health. 2017;4(4): e55. https://doi.org/10.2196/mental.8369.

    Article  PubMed  PubMed Central  Google Scholar 

  27. O’Dea B, Subotic-Kerry M, King C, Mackinnon AJ, Achilles MR, Anderson M, Parker B, Werner-Seidler A, Torok M, Cockayne N, Baker STE, Christensen H.2021 A cluster randomised controlled trial of a web-based youth mental health service in Australian schools. The Lancet Regional Health—Western Pacific, doi: https://doi.org/10.1016/j.lanwpc.2021.100178

  28. O’Dea B, King C, Achilles MR, Calear AL, Subotic-Kerry M. Delivering a digital mental health service in Australian secondary schools: understanding school counsellors’ and parents’ experiences. Health Services Insights. 2021;14:11786329211017688. https://doi.org/10.1177/11786329211017689.

    Article  PubMed  PubMed Central  Google Scholar 

  29. O’Dea B, King C, Subotic-Kerry M, Achilles MR, Cockayne N, Christensen H. Smooth sailing: a pilot study of an online, school-based, mental health service for depression and anxiety [Original Research]. Front Psychiatry. 2019. https://doi.org/10.3389/fpsyt.2019.00574.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Pretorius C, Chambers D, Coyle D. Young People’s Online Help-Seeking and mental health difficulties: systematic narrative review. J Med Internet Res. 2019;21(11): e13873. https://doi.org/10.2196/13873.

    Article  PubMed  PubMed Central  Google Scholar 

  31. RACGP. (2016). RACGP Guidelines for preventive activities in general practice 9th edition. The RACGP. https://www.racgp.org.au/clinical-resources/clinical-guidelines/key-racgp-guidelines/view-all-racgp-guidelines/guidelines-for-preventive-activities-in-general-pr/psychosocial/depression#ref-num-31

  32. Reinke WM, Thompson A, Herman KC, Holmes S, Owens S, Cohen D, Tanner-Jones LA, Henry L, Green A, Copeland C. The county schools mental health coalition: a model for community-level impact. School Mental Health. 2018;10(2):173–80. https://doi.org/10.1007/s12310-017-9227-2.

    Article  Google Scholar 

  33. Rickwood D, Deane FP, Wilson CJ, Ciarrochi J. Young people’s help-seeking for mental health problems. Aust e-J Advancement Mental Health. 2005;4(3):218–51. https://doi.org/10.5172/jamh.4.3.218.

    Article  Google Scholar 

  34. Roberts RE, Andrews JA, Lewinsohn PM, Hops H. Assessment of depression in adolescents using the Center for Epidemiologic Studies Depression Scale. Psychol Assess: A J Consult Clin Psychol. 1990;2(2):122–8. https://doi.org/10.1037/1040-3590.2.2.122.

    Article  Google Scholar 

  35. Robinson J, Pan Yuen H, Martin C, Hughes A, Baksheev GN, Dodd S, Bapat S, Schwass W, McGorry P, Yung AR. Does screening high school students for psychological distress, deliberate self-harm, or suicidal ideation cause distress—and is it acceptable? Crisis. 2011;32(5):254–63. https://doi.org/10.1027/0227-5910/a000087.

    Article  PubMed  Google Scholar 

  36. Roseman M, Saadat N, Riehm KE, Kloda LA, Boruff J, Ickowicz A, Baltzer F, Katz LY, Patten SB, Rousseau C, Thombs BD. Depression screening and health outcomes in children and adolescents: a systematic review. Can J Psychiatry. 2017;62(12):813–7. https://doi.org/10.1177/0706743717727243.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Sekhar DL, Schaefer EW, Waxmonsky JG, Walker-Harding LR, Pattison KL, Molinari A, Rosen P, Kraschnewski JL. Screening in high schools to identify, evaluate, and lower depression among adolescents: a randomized clinical trial. JAMA Netw Open. 2021;4(11):e2131836–e2131836. https://doi.org/10.1001/jamanetworkopen.2021.31836.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Siu AL, Force USPST. Screening for depression in children and adolescents: U.S. preventive services task force recommendation statement. Ann Intern Med. 2016;164(5):360–6. https://doi.org/10.7326/M15-2957.

    Article  PubMed  Google Scholar 

  39. Skar A-MS, Ormhaug SM, Jensen TK. Reported levels of upset in youth after routine trauma screening at mental health clinics. JAMA Netw Open. 2019;2(5):e194003–e194003. https://doi.org/10.1001/jamanetworkopen.2019.4003.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Soneson E, Childs-Fegredo J, Anderson JK, Stochl J, Fazel M, Ford T, Humphrey A, Jones PB, Howarth E. Acceptability of screening for mental health difficulties in primary schools: a survey of UK parents. BMC public health. 2018;18(1):1404. https://doi.org/10.1186/s12889-018-6279-7.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Soneson E, Howarth E, Ford T, Humphrey A, Jones PB, Thompson Coon J, Rogers M, Anderson JK. Feasibility of school-based identification of children and adolescents experiencing, or at-risk of developing, mental health difficulties: a systematic review. Prev Sci. 2020;21(5):581–603. https://doi.org/10.1007/s11121-020-01095-6.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7. https://doi.org/10.1001/archinte.166.10.1092.

    Article  PubMed  Google Scholar 

  43. StataCorp. (2021). Stata Statistical Software: Release 17. StataCorp LP.

  44. Sterne JAC, Cox DR, Smith GD. &lt;span hwp:id=&quot;article-title-1&quot; class=&quot;article-title&quot;&gt;Sifting the evidence—what&#039;s wrong with significance tests?&lt;/span&gt;&lt;span hwp:id=&quot;article-title-36&quot; class=&quot;sub-article-title&quot;&gt;Another comment on the role of statistical methods&lt;/span&gt. BMJ, 2001:322(7280), 226. https://doi.org/10.1136/bmj.322.7280.226

  45. US Preventive Services Task Force. Screening for anxiety in children and adolescents: us preventive services task force recommendation statement. JAMA. 2022;328(14):1438–44. https://doi.org/10.1001/jama.2022.16936.

    Article  Google Scholar 

  46. US Preventive Services Task Force. Screening for depression and suicide risk in children and adolescents: us preventive services task force recommendation statement. JAMA. 2022;328(15):1534–42. https://doi.org/10.1001/jama.2022.16946.

    Article  Google Scholar 

  47. Vella SA, Swann C, Batterham M, Boydell KM, Eckermann S, Fogarty A, Hurley D, Liddle SK, Lonsdale C, Miller A, Noetel M, Okely AD, Sanders T, Telenta J, Deane FP. Ahead of the game protocol: a multi-component, community sport-based program targeting prevention, promotion and early intervention for mental health among adolescent males. BMC public health. 2018;18(1):390. https://doi.org/10.1186/s12889-018-5319-7.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Villarreal V, Castro-Villarreal F, Peterson LS, Bear M, Cortes DM, Escobedo T. Meta-analysis of proportions of students screened and identified in mental health multiple-gate screening research. School Psychol Rev. 2023;52(2):130–43. https://doi.org/10.1080/2372966X.2022.2106155.

    Article  Google Scholar 

  49. Viswanathan M, Wallace I, Middleton CJ , Kennedy SM, McKeeman J, Hudson K, Rains C, Schaaf EBV, Kahwati L. Screening for Depression, Anxiety, and Suicide Risk in Children and Adolescents: An Evidence Review for the U.S. Preventive Services Task Force. 2022; https://www.uspreventiveservicestaskforce.org/uspstf/document/draft-evidence-review/screening-anxiety-children-adolescents

  50. Williams SB, O’Connor EA, Eder M, Whitlock EP. Screening for child and adolescent depression in primary care settings: a systematic evidence review for the US Preventive Services Task Force. Pediatrics. 2009;123(4):e716-735. https://doi.org/10.1542/peds.2008-2415.

    Article  PubMed  Google Scholar 

  51. Wilson CJ, Deane FP, Ciarrochi J, Rickwood D. Measuring help-seeking intentions: properties of the general help-seeking questionnaire. Can J Couns. 2005;39(1):15–28.

    Google Scholar 

  52. Zou G. A modified poisson regression approach to prospective studies with binary data. Am J Epidemiol. 2004;159(7):702–6. https://doi.org/10.1093/aje/kwh090.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the Black Dog Institute IT team who supported the build and implementation of the web-based service and research trial. The authors would like to acknowledge the Trial Steering Committee for their oversight, guidance, and support throughout the design and evaluation of the Smooth Sailing service model.

Funding

This work was supported by HSBC and the Graf Foundation from a non-competitive philanthropic research grant donation to the Black Dog Institute. The funders had no role in the design, execution, analyses, data interpretation, authorship or the decision to submit the paper for publication.

Author information

Authors and Affiliations

Authors

Contributions

TAB: Analysis, interpretation, knowledge, authorship and editing. STEB: Conception, interpretation, knowledge, authorship and editing. MSK: Recruitment, data collection, interpretation, knowledge, authorship and editing. GT: Interpretation, knowledge, authorship and editing. NJE: Interpretation, knowledge, authorship and editing. AM: Analysis, Interpretation, knowledge, authorship and editing. HC: Interpretation, knowledge, authorship and editing. BOD: Conception, recruitment, data collection, interpretation, knowledge, authorship and editing.

Corresponding author

Correspondence to Taylor A. Braund.

Ethics declarations

Ethics approval and consent to participate

Ethics approvals were obtained from the University of New South Wales Human Research Ethics Committee (HC17910), the State Education Research Applications Process for the New South Wales Department of Education (2016471), the Sydney Catholic Schools Research Centre (20186), and the Catholic Schools Office Diocese of Maitland-Newcastle. The trial was registered with the Australian and New Zealand Clinical Trials Registry (ACTRN12618001539224). Students gave their informed consent to participate on the day of the baseline assessment via a signed PICF that was witnessed by the research team (for full details, see [27].

Consent for publication

Not applicable.

Competing interests

BOD and HC reports philanthropic non-competitive research grants from HSBC and the Graf Foundation during the conduct of the trial. BOD reports speaker fees and travel reimbursements from the New South Wales and Queensland Departments of Education, paid to the Black Dog Institute for educational training seminars, that were outside the submitted work. All other authors have no conflicts to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file1: Figure S1.

Consort Chart. Table S1. Risk Measures and Equations. Text S1. Description of Smooth Sailing. Text S2. RC Score Calculation.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Braund, T.A., Baker, S.T.E., Subotic-Kerry, M. et al. Potential mental health-related harms associated with the universal screening of anxiety and depressive symptoms in Australian secondary schools. Child Adolesc Psychiatry Ment Health 18, 46 (2024). https://doi.org/10.1186/s13034-024-00734-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13034-024-00734-y

Keywords