- Research article
- Open Access
The mediating role of internalizing and externalizing symptoms in the relationship between childhood trauma and suicidality among adolescents: a structural equation model
Child and Adolescent Psychiatry and Mental Health volume 15, Article number: 79 (2021)
The objective of this study is to investigate the direct and indirect effects of childhood trauma, internalizing symptoms, and externalizing symptoms on suicidality among adolescents, thereby establishing a structural equation model.
The present study uses a cross-sectional descriptive design. Among 147 adolescents aged 12–17, 93 outpatients diagnosed with major depressive disorder and 54 controls were included in the study. They completed the Early Trauma Inventory Self-Report (Short Form) and Columbia Suicidality Severity Rating Scale. Their parents completed the Child Behavior Checklist. Analyses were performed using Pearson’s correlation and structural equation modelling.
Childhood trauma had both direct and indirect effects, via internalizing symptoms and externalizing symptoms, on suicidality. Internalizing symptoms had a direct effect on suicidality. Meanwhile, externalizing symptoms were not directly associated with suicidality, but indirectly associated via internalizing symptoms.
Findings provide in-depth understanding of the mediating role of internalizing symptoms and externalizing symptoms in the relationship between childhood trauma and suicidality, suggesting that the therapeutic interventions for both internalizing symptoms and externalizing symptoms may be important to prevent suicide in adolescents with childhood trauma.
Suicidal behavior in adolescents is one of the major psychiatric problems worldwide. Since the 2000s, the suicide rate among adolescents has gradually decreased in the first decade [1, 2]. In the second decade, specifically over the past 5 years, the suicide rate among adolescents has increased in many OECD countries [3,4,5,6]. The suicide rate among Korean youth has shown no signs of decline over the past two decades. Similar to other countries, the suicide rate among Korean youth has slightly increased since 2017 [7, 8]. In Korean adolescents, the suicide rate in 2019 was 5.9 per 100,000, comprising 37.5% of the total death rate of adolescents aged 10–19 years . Previous studies have reported that childhood trauma is a major risk factor for suicide-related behavior [9,10,11,12]. Childhood trauma is a stressful or traumatic experience in childhood, including physical, sexual, and emotional abuse, as well as other negative childhood experiences such as household dysfunction [13, 14]. Previous systematic reviews have reported that childhood trauma is associated with an increased risk of suicide among adolescents [15,16,17].
Previous studies have demonstrated that childhood trauma is associated with internalizing and externalizing disorders in adolescents [18, 19]. Experience of childhood trauma has been reportedly associated with low self-esteem, interpersonal problems, and internalizing and externalizing symptoms in adolescents [20, 21]. In one study, it was found that childhood trauma affected the central nervous system, increasing stress vulnerability, and consequently leading to the development of internalizing symptoms such as depression and anxiety among adolescents .
Additionally, both internalizing and externalizing symptoms in adolescents are related to suicidal risk in adolescence and early adulthood [23, 24]. Internalizing symptoms refer to inner-directed problems that cause internal psychological distress, such as anxiety, depression, somatic complaints, and withdrawal, while externalizing symptoms refer to outer-directed problems that bother other individuals and cause interpersonal conflict in the external environment, such as impulsivity, hyperactivity, delinquent, and aggressive behavior [25,26,27]. A study analyzed trajectories of depressive symptoms and behavioral problems, showing that both trajectories were independently associated with suicide risk . Results of a systematic review noted that adolescents and young adults experiencing internalizing and externalizing symptoms are more prone to engage in suicidal behavior than those having none . In contrast, some studies have shown that internalizing symptoms are associated with an increased possibility of suicide, while the other set of symptoms are not directly associated with this risk [30, 31].
Existing research has shown a significant relationship between childhood trauma and both internalizing and externalizing symptoms, and between both types of symptoms and suicidality in adolescents. Yet developmental pathways or models that explain the overall progression from childhood trauma to suicidality remain unclear. Additionally, few studies have investigated the role of both these sets of symptoms in an integrated model. Results of a longitudinal study proposed that the trajectories of anxiety and disruptiveness were mediating factors in the association between childhood trauma and suicide attempts . A recent study evaluated the mediating role of comorbid symptom trajectories of internalizing and externalizing symptoms in the relationship between childhood trauma and suicide-related behaviors . Although these two longitudinal studies examined the mediating effects of both internalizing and externalizing symptoms, they failed to show any direct or indirect relationships between the experience of childhood trauma and suicidality in adolescents, with either of these types of symptoms acting as mediators.
The purpose of our study was to analyze the relationships between childhood trauma, internalizing and externalizing symptoms, and suicidality among adolescents. We hypothesized that these symptoms would serve as mediators in the relationships being studied. Additionally, our study suggested a hypothetical model including developmental pathways of childhood trauma and suicidality among adolescents, using a structural equation model (SEM). We hypothesized that childhood trauma would have both direct and indirect effects on suicidality among adolescents. We also hypothesized that both internalizing and externalizing symptoms would have direct effects on suicidality among adolescents, thereby playing mediating roles between childhood trauma and risk of suicide.
Our sample consisted of 147 participants aged 12 to 17 years who visited the child and adolescent psychiatric outpatient clinic at the Seoul National University Hospital during August 2015–June 2018. They were a part of a study that was investigating biomarkers of antidepressant response and suicidal behavior in depressed youth (NRF-2015R1A2A2A01004501) [33, 34]. Initially, 152 subjects were recruited, but a total of 147 subjects were included in the analyses, since two depressed participants and three healthy controls withdrew their consent to participate.
The participants included 93 patients diagnosed with major depressive disorder (MDD) which was based on the Kiddie-Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL) [35, 36]. Additionally, the participants scored 40 points or higher on the Children’s Depression Rating Scale-Revised, scored 4 points or higher on the Clinical Global Impression-Severity scale, and had MDD symptoms of at least 4 weeks without psychotic features . These participants had a mean age of 14.8 years (standard deviation [SD] = 1.6), and 67.7% (n = 63) of them were female.
The MDD participants, with a history of chronic medical conditions, a history of psychotic disorders, bipolar disorders, and developmental disorders, with alcohol or other substance abuse within the past 6 months, were excluded from this study. In addition, we measured the intelligence quotient (IQ) of the participants and excluded those with an IQ of less than 70. Since the original study investigated the antidepressant response, exclusion criteria were determined to prevent manic conversion due to medication . Risk factors of manic conversion, such as first-degree relatives with bipolar I disorder, have been considered .
In addition, our study included 54 healthy control participants, recruited via flyers distributed at local schools. The recruited participants who visited our clinic were screened for psychiatric disorders using the K-SADS-PL. If a prospective participant reported receiving a diagnosis of mental illness or had any first-degree relatives with a psychiatric history, they were excluded from the study. Among the control participants, 55.6% (n = 30) were female. Mean participant age was 14.4 years (SD = 1.4).
Childhood trauma was measured with 12 of the 27 items in the Early Trauma Inventory Self Report-Short Form (ETISR-SF). The ETISR-SF is a 27-item questionnaire assessing four domains of early trauma: physical, emotional, or sexual abuse, and general traumatic experiences, occurring before the age of 18. Among these domains, three were used in this study; the domain of sexual abuse was excluded. In Korea, it is difficult for adolescents to report or disclose experiences of sexual harassment due to a victim-blaming culture. For this reason, sexual abuse is likely to be underestimated. Findings related to this domain have had low reliability in previous studies [39, 40]. Each item was answered “yes” or “no” and scored dichotomously (yes = 1/no = 0) [39, 41]. We conducted confirmatory factor analysis (CFA) for the present sample, and items with factor loadings below 0.50 were excluded from the analysis. To construct the three observed variables, the items were combined and averaged. As a result, general trauma consisted of three items (with eight items excluded), physical abuse was composed of four items (with one item excluded), and five items constituted the emotional abuse domain. A previous study provided evidence for the validity and reliability of scores on the ETISR-SF in Korean adolescents . In our sample, Cronbach’s α were 0.65, 0.73, and 0.82, for general trauma, physical abuse, and emotional abuse, respectively, which is evidence for good internal consistency of the instrument (see Additional file 1: Table S1).
The Korean version of the Child Behavior Checklist (CBCL) was used to measure internalizing and externalizing symptoms among the participants. The CBCL is a parent-report scale that evaluates social competence and behavior problems in children aged 6–18 years. The scale is composed of 118 behavioral problem items and 20 social competence items. We used three subscales corresponding to the internalizing broadband in CBCL, using withdrawn, anxious/depressed, and somatic subscales as observed variables to measure internalizing symptoms in the participants . Each item was scored on a 3-point scale of 0 (none at all), 1 (sometimes) and 2 (often). Since item 103 was included in both the withdrawn and anxious/depressed subscales, this item was excluded from the anxious/depressed subscale, which had relatively low convergent validity, for statistical analysis. Items with factor loadings less than 0.50 were excluded from the analysis. Thus, nine items for the withdrawn subscale, 12 items for the anxious/depressed subscale, and eight items for the somatic subscale were added and averaged. The Korean CBCL has been proven to have good validity and reliability for the general child population . In our study, Cronbach’s α for the withdrawn, anxious/depressed, and somatic subscales were 0.88, 0.90, and 0.85, respectively (see Additional file 1: Table S2).
Externalizing symptoms were measured with the externalizing broadband of CBCL, including delinquent subscale with 13 items and aggressive subscale with 20 items. Item 21 belonged to both subscales, so this item was excluded from the delinquent subscale, similar to that in internalizing symptoms. In statistical analysis, excluding items with factor loadings less than 0.50, 4 items (excluding eight items) were summed and averaged for the delinquent subscale, and 14 items (excluding six items) were summed and averaged for the aggressive subscale. Cronbach’s α for the delinquent and aggressive subscales were 0.70, and 0.84, respectively (see Additional file 1: Table S3).
The Columbia Suicidality Severity Rating Scale (C-SSRS) was used to measure suicidality of the participants. Composed of four constructs, this is a semi-structured interview that assesses the severity of suicidal ideation and behaviors. The four constructs are as follows: “suicidal ideation,” “intensity of ideation,” “suicidal behavior,” and “lethality of suicidal behavior.” The two former constructs evaluate suicidal ideation, while the latter two evaluate suicidal behaviors. Among them, we used “intensity of ideation (IOI)” as a measure of suicidality. The subscales that measured suicidal behaviors were excluded for two reasons. First, we utilized only continuous variables in the SEM analysis. Second, we excluded “lethality of suicidal behavior,” as this indicator had low validity and non-normal distribution in our sample. The IOI includes five items: frequency, duration, controllability, deterrents, and reasons for suicidal ideation. Items were rated on a 5-point Likert scale ranging from 1 to 5. When a participant had no suicidal ideation, all items of the participant were coded as 0. Additionally, when a participant checked the questionnaire items “does not attempt to control thought” in controllability, or “does not apply” in deterrents, and reasons constructs, these responses were coded as 0. Each item was scored on a 6-point scale ranging from 0 to 5. The convergent validity of this indicator was evaluated; the factor loadings of all items were greater than 0.50, which was acceptable. The Korean version of the C-SSRS has been proven to have good reliability and validity . Cronbach’s α was 0.91 for IOI (see Additional file 1: Table S4).
As mentioned above, we adjusted the number of measured items through item parceling to simplify the model analysis . While constructing each measured variable with item parceling, some items were excluded from the statistical analysis in terms of validity . Descriptive statistics were used to characterize the study sample and to test for a normal distribution. A bivariate Pearson correlation analysis was used to examine the correlation between the variables before the analysis. A preliminary CFA was performed to confirm the validity of the variables and evaluate the fit of the measurement model, thereby creating latent variables. SEM was used to analyze the fit of our hypothesized structural model and estimate the direct and indirect effects between the latent variables. To handle the missing data, the full information maximum likelihood method was used for the estimation of missing values. In addition to the original hypothesis model, two alternative models were estimated and compared to the original model. For calculating the descriptive statistics and for conducting correlation analysis, SPSS version 22.0 was used, and SEM analysis was conducted with AMOS version 26.0.
To test the hypothesized model, the model fit was analyzed by using the chi-square goodness-of-fit test and goodness-of-fit indices. The χ2 test compares the hypothesized model and the unconstrained model, which completely fits the data. When the probability is higher than 0.05, it can be considered that the hypothesized model fits the data. However, it is well known that since a chi-square statistic is directly affected by the sample size, especially with a large sample size, it could result in rejection of the models . Thus, χ2/df, an indication of χ2 divided by degree of freedom (df), can be used to verify the fit of the model. In general, χ2/df values ranging from 2 to 5 are considered as acceptable [47, 48]. The root mean square error of approximation (RMSEA) is also used for model fit analysis. A value of RMSEA less than 0.08 have been considered to indicate good fit, and a value between 0.08 and 0.10 was considered to indicate moderate fit. However, recently, a cut-off value was reported to be 0.06–0.07 . We also used the incremental fit indices such as the normed fit index (NFI), Tucker-Lewis index (TLI), and comparative fit index (CFI) to analyze the model fit. The values of NFI, TLI, and CFI should be higher than 0.95 for a good fit model, or higher than at least 0.90 [48,49,50,51,52].
Additionally, we performed a sensitivity analysis to assess the robustness of the proposed structural model. We used an independent data sample from the “validation of depression-rated scales in child and adolescent psychiatric outpatients” study (IRB No. 1908-088-1055). A total of 464 participants were recruited from the child and adolescent psychiatric outpatient clinic of Seoul National University Hospital between August 2015 and July 2019. They were aged 7 to 19 years, and 278 of whom were women. The participants responded to the same questionnaire as mentioned above in the Measure section. Among the 464 participants, 46 were excluded because they were included in the primary analysis; thus, the sample consisted of 418 participants (247 of whom were female). Among them, 196 were diagnosed with MDD, 39 with bipolar disorder, 66 with anxiety disorder, 10 with attention deficit hyperactivity disorder, 4 with conduct disorder, 2 with tic disorder, 3 with autism spectrum disorder, and 29 with eating disorder. A total of 69 participants were diagnosed with 2 different psychiatric disorders. First, the CFA model was conducted using an independent dataset. Subsequently, the structural model, which was selected as the final model in the primary analysis, was applied to the independent dataset.
Among the 147 participants, 63.3% were female. The mean age of the participants was 14.6 years (SD = 1.6). The average IQ of the participants was 106.6 (SD = 13.1). As part of important assumptions regarding SEM, we investigated whether the data satisfied the normality assumption .
Table 1 presents the correlation coefficients of the observed variables. Most of the variables were significantly and positively correlated with each other. However, the general trauma and physical abuse subscales of childhood trauma and the delinquent subscale of externalizing symptoms were not related to the observed variables that measured suicidality. Additionally, the general trauma and physical abuse subscales of childhood trauma were not associated with the somatic subscale of internalizing symptoms.
Preliminary CFA (test of the measurement model)
A CFA was conducted to check the model fit for the initial measurement model (see Additional file 2: Fig. S1). The χ2 for the initial measurement model was 143.058 (p < 0.001), and the degree of freedom for the model was 59. The fitness indices demonstrated that the model was a moderate fit. The absolute fit indices were 2.425 for χ2/df and 0.099 for RMSEA, and the incremental fit indices were 0.875 for NFI, 0.896 for TLI, and 0.921 for CFI. Factor loadings were higher than 0.50 for all indicators, except for the observed variable, general trauma. To improve the model fit of the initial measurement model, we excluded the variable general trauma from the latent variables of childhood trauma and conducted another CFA. The final CFA results improved the overall fit compared to the initial model (see Additional file 2: Fig. S2). χ2/df was 2.304 and RMSEA was 0.095, and the incremental fit indices were 0.895 for NFI, 0.916 for TLI, and 0.937 for CFI.
The construct reliabilities (CR) of the four latent variables, childhood trauma, internalizing symptoms, externalizing symptoms, and suicidality, were higher than 0.70, and the average variance extracted (AVE) was higher than 0.50 for all the latent variables, except for suicidality. For suicidality, the CR was 0.799, and the AVE was 0.445. However, even if the AVE was found to be slightly smaller than 0.50, it could be accepted if the CR is more than 0.60, so the convergent validity was considered suitable . When the determination coefficient for two constructs is smaller than the AVEs of these two constructs, the discriminant validity within the construct can be confirmed. As all the determination coefficients were smaller than the corresponding AVEs, the four latent variables were shown to have good discriminant validities.
Test of the structural model
We used SEM analysis to examine the relationships between childhood trauma, suicidality, and two other mediating variables: internalizing and externalizing symptoms. The results of the analysis of the original hypothesized model are presented in Fig. 1 and Table 2. The goodness-of-fit of the original model was analyzed, and the values of fit indices were as follows: χ2 = 139.225, degree of freedom = 49, and χ2/df = 2.841; RMSEA = 0.112; NFI = 0.873, TLI = 0.882, and CFI = 0.912. As shown in Table 2, the unstandardized (B) and standardized (β) path coefficients were estimated. In the original model, the standardized factor loadings from childhood trauma to suicidality, from internalizing symptoms to suicidality, and from externalizing symptoms and suicidality, were not statistically significant.
To improve the model fit, we tested a competitive model, competitive model I (see Additional file 2: Figure S3), in which a pathway from externalizing symptoms to internalizing symptoms was added to the original model. The reasons for adding this pathway to the model are as follows. In the preliminary correlation analysis, a positive correlation between internalizing symptoms and externalizing symptoms was observed. Additionally, a previous study showed that children with externalizing symptoms were more likely to develop a comorbid profile of both symptoms than children with internalizing symptoms, which suggests a causal relationship between externalizing symptoms and internalizing symptoms . We added another competitive model, competitive model II, in which the non-significant pathway from externalizing symptoms to suicidality was removed from competitive model I . Previous studies have suggested a non-significant relationship between externalizing symptoms and suicidality, which was supported by competitive model II [30, 31]. A comparison of the values of goodness-of-fit indices among the three models is displayed in Table 3.
In terms of the model fit of the original model, RMSEA was greater than 0.10, and NFI, TLI, and CFI were less than 0.95, which does not indicate good model fit. The χ2 of this model was also considerably greater than the competitive models. Competitive model I and competitive model II resulted in a substantially better fit as compared to the original model. In these two models, χ2/df values were less than 3, the values of RMSEA were between 0.08 to and 0.10, and TLI and CFI values were higher than 0.90. As a result, competitive model I and competitive model II could be considered to be a moderate fit [46,47,48,49,50,51,52]. We used a chi-square difference test to compare the two competitive models. The difference between the two models was 2.914 (Δdf = 1), which was smaller than 3.84 (p = 0.05). Therefore, competitive model II was a more parsimonious model with higher degrees of freedom than competitive model I [57, 58]. For this reason, competitive model II was determined as the final model (Fig. 2).
Direct and indirect effects of factors affecting suicidality
Standardized direct, indirect, and total effects are presented in Table 4. The significance of the indirect effects was tested by using the bootstrapping method, and all the effects between each variable were statistically significant.
A CFA was conducted on an independent data sample. Similar to the primary analysis, the observed variable of general trauma was excluded from the analysis. However, this CFA model could not be tested because the covariance matrix of latent variables was not positive definite. We also excluded withdrawn subscale of internalizing symptoms, which was expected to make the covariance matrix not positive definite, from the analysis (see Additional file 2: Fig. S4). The absolute fit indices were 1.767 for χ2/df and 0.043 for RMSEA. The incremental fit indices were 0.968 for NFI, 0.979 for TLI, and 0.986 for CFI. Factor loadings for all indicators were higher than 0.50, and the CR and AVE values demonstrated good construct validity for the CFA model. Next, we tested the final SEM model by applying the measurement model identified on the independent data sample (see Additional file 2: Fig. S5). The fitness indices showed that the model was a good fit. χ2/df and RMSEA were 2.087 and 0.051, respectively, and the incremental fit indices were 0.961 for NFI, 0.970 for TLI, and 0.979 for CFI. The unstandardized and standardized path coefficients were estimated and presented in Table 5. All the path coefficients were statistically significant.
The current study was the first study that investigated the mediating role of internalizing and externalizing symptoms in the relationship between childhood trauma and suicidality among adolescents using SEM analyses. Both direct and indirect associations between childhood trauma and suicidality in adolescents were found in our study. Childhood trauma was found to be directly associated with suicidality in adolescents. Meanwhile, childhood trauma was associated with suicidality in adolescents through the following two indirect pathways. Internalizing symptoms were found to have a direct effect on suicidality in adolescents. It was observed that externalizing symptoms had no direct effect on suicidality in adolescents and indirectly affected suicidality in adolescents via internalizing symptoms.
Our finding is in line with previous studies, which demonstrated that adolescents who experienced childhood trauma are at high risk of suicide [9, 11, 12, 15,16,17]. Specifically, our results demonstrated that childhood trauma directly affects suicidality in adolescents without the mediating effects of internalizing symptoms or externalizing symptoms, suggesting that childhood trauma per se could be an important risk factor for suicidality in adolescents. The result that childhood trauma was indirectly associated with suicidality via internalizing symptoms is also consistent with previous studies. A study indicated that psychological stress, which was measured with depression, anxiety, and post-traumatic stress, also had a mediating role in the association between childhood trauma and suicidal ideation . In this study, teenagers who experienced childhood trauma were vulnerable to internalizing symptoms, such as depression or anxiety, leading to suicidal ideation, which was in accordance with our findings.
Interestingly, externalizing symptoms did not have a direct effect on suicidality in adolescents, only having an indirect effect via internalizing symptoms. This finding corroborated previous studies that suggested that internalizing symptoms are associated with suicidal behaviors in adolescents, while externalizing symptoms are not directly associated with suicidal behaviors in adolescents [30, 31]. Aggressive or delinquent behavior in itself might not cause adolescent suffering but would contribute to their problems in other areas. Externalizing problems could prevent adolescents from getting along with family or friends, resulting in parent–child conflict or peer relationship problem [55, 60, 61]. These interpersonal conflicts and maladaptation might increase the risk of developing internalizing symptoms, such as depression and anxiety, in adolescents with externalizing problems . These ideas provide evidence for adding a pathway from externalizing symptoms to internalizing symptoms to the final model of this study.
Besides, it is possible that externalizing behaviors might have protective effects on suicidal risk in adolescents. From the perspective of evolutionary psychology, externalizing behaviors of youth could be a coping strategy for adapting to a stressful environment [62, 63]. Externalizing behavior could help adolescents control their impulses for suicidal behaviors by externalizing aggression and alleviating their suffering. If that is the case, adolescent suicide would be directly increased by the internalizing symptoms and not by the externalizing ones, which corresponds well with our findings.
In fact, whether externalizing symptoms directly affect suicidality in adolescents has been a controversial issue. Some studies have reported that externalizing behaviors such as aggressive behavior and impulsivity could be a link between childhood trauma and suicidality in adolescents [64,65,66]. A previous study investigating the trajectory of high anxiety and high disruptiveness has reported that both trajectories independently affect the association between childhood trauma and suicide attempts . These findings are inconsistent with the results of the present study. We did not directly measure impulsivity, only measuring aggressive behavior and delinquent behavior, which could be a possible cause of this inconsistency. Second, previous studies have generally measured suicidal risk by whether or not the responders had suicidal ideation or suicidal behaviors. In contrast, our study utilized the IOI subscale of C-SSRS, a semi-structured interview, resulting in a more detailed assessment of the risk and severity of suicidality .
Recent research has documented that comorbid trajectories of internalizing and externalizing symptoms play an important role in explaining the relationship between child maltreatment and suicidality in adolescents . Similarly, we substantiated the mediating effects of both internalizing and externalizing symptoms. Furthermore, we constructed paths estimated as potentially causal relationships by integrating the findings of several studies that revealed relationships between variables [15,16,17,18,19, 29, 32]. We validated the fitness of a structural model that includes these paths and proposed an integrative model of developmental pathways using SEM analysis. A previous review article, which suggested a developmental model of youth suicidal behavior, is in line with our model . This review article proposed that depression and aggression significantly interacted with each other, and while internalizing symptoms such as depression directly affected suicidal ideation in adolescents, externalizing symptoms such as aggression, not directly influencing suicidal ideation, had an influence on suicidal attempts of adolescents .
Sensitivity analyses demonstrated that our structural model had a good fit with independent clinical samples and showed that our findings were reproducible. The results of this study need to be considered in light of several limitations. First, since we used cross-sectional data, the causal relationships between variables could not be explained. Therefore, future longitudinal studies should be conducted to validate these causal relationships. Second, our sample size was 147, which was relatively small for conducting SEM analysis. When using the rule of thumb, which recommends having a sample size of at least 10 per measured variable, our sample size met the minimum requirements for SEM analysis . For this reason, we could not conduct a subgroup analysis because of the small sample size. Third, our sample comprised patients with depression and a control group recruited from an outpatient clinic. Hence, the results might not be applicable to the general population of adolescents. However, inclusion of a control group could reduce the selection bias. Additionally, we performed a sensitivity analysis and showed a good fit in independent clinical data with a larger sample size. Fourth, in our sample, externalizing symptoms might have been underestimated. The sample included adolescents with depression; therefore, internalizing symptoms would be more likely to be severe than externalizing symptoms in our sample. Nevertheless, adolescents with depressive symptoms are prone to have comorbid externalizing symptoms, so that their externalizing symptoms score would be high enough for the data relating to these participants to be considered in this study . Finally, to measure suicidality in the participants, we used the C-SSRS, a semi-structured interview assessing the severity of suicidal ideation and behaviors. However, only suicidal ideation was included in the analysis. Suicidal ideation is an important precursor to suicidal behavior, but not everyone with suicidal ideation acts on it . Therefore, future research needs to include not only suicidal ideation but also suicidal behaviors, such as suicide attempts, in the analysis of the developmental model.
The results of this study suggest that internalizing symptoms serve as a mediator of the relationship between childhood trauma and suicidality in adolescents. This finding highlights the importance of treating internalizing symptoms to prevent suicidality in adolescents with childhood trauma. Additionally, externalizing symptoms formed another pathway from childhood trauma to suicidal ideation, in which externalizing symptoms indirectly affected suicidal ideation via internalizing symptoms. These findings indicate that to prevent adolescents from committing suicide, interventions to externalizing symptoms alone might be insufficient, and it is necessary to address both externalizing and internalizing problems in an integrated way.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Average variance extracted
Confirmatory factor analysis
Comparative fit index
Columbia Suicidality Severity Rating Scale
Degree of freedom
Early Trauma Inventory Self Report-Short Form
Intensity of ideation
Kiddie-Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version
Major depressive disorder
Normed fit index
Root Mean Square Approximation
Structural equation model
Roh B-R, Jung EH, Hong HJ. A comparative study of suicide rates among 10–19-year-olds in 29 OECD countries. Psychiatry Investig. 2018;15(4):376.
McLoughlin AB, Gould MS, Malone KM. Global trends in teenage suicide: 2003–2014. QJM Int J Med. 2015;108(10):765–80.
OECD. CO4. 4: teenage suicides. OECD Family Database. 2014.
Bould H, Mars B, Moran P, Biddle L, Gunnell D. Rising suicide rates among adolescents in England and Wales. Lancet. 2019;394(10193):116–7.
Cybulski L, Ashcroft DM, Carr MJ, Garg S, Chew-Graham CA, Kapur N, et al. Temporal trends in annual incidence rates for psychiatric disorders and self-harm among children and adolescents in the UK, 2003–2018. BMC Psychiatry. 2021;21(1):1–12.
Brent DA. Master clinician review: saving Holden Caulfield: suicide prevention in children and adolescents. J Am Acad Child Adolesc Psychiatry. 2019;58(1):25–35.
Liu J. Need to establish a new adolescent suicide prevention programme in South Korea. Gen Psychiatry. 2020;33(4):1–7.
Korea, Statistics. Annual report on the cause of death statistics. 2019. https://kosis.kr/eng/. Accessed 1 Feb 2021.
Goldney RD, Wilson D, Grande ED, Fisher LJ, McFarlane AC. Suicidal ideation in a random community sample: attributable risk due to depression and psychosocial and traumatic events. Aust N Z J Psychiatry. 2000;34(1):98–106.
Sarchiapone M, Carli V, Cuomo C, Roy A. Childhood trauma and suicide attempts in patients with unipolar depression. Depress Anxiety. 2007;24(4):268–72.
Barbosa LP, Quevedo L, da Silva GDG, Jansen K, Pinheiro RT, Branco J, et al. Childhood trauma and suicide risk in a sample of young individuals aged 14–35 years in southern Brazil. Child Abuse Negl. 2014;38(7):1191–6.
Khan A, McCormack HC, Bolger EA, McGreenery CE, Vitaliano G, Polcari A, et al. Childhood maltreatment, depression, and suicidal ideation: critical importance of parental and peer emotional abuse during developmental sensitive periods in males and females. Front Psychiatry. 2015;6:42.
Bremner JD, Vermetten E, Mazure CM. Development, and preliminary psychometric properties of an instrument for the measurement of childhood trauma: the early trauma inventory. Depress Anxiety. 2000;12(1):1–12.
Felitti VJ, Anda RF, Nordenberg D, Williamson DF, Spitz AM, Edwards V, et al. Relationship of childhood abuse and household dysfunction to many of the leading causes of death in adults: the adverse childhood experiences (ACE) study. Am J Prev Med. 1998;14(4):245–58.
Serafini G, Muzio C, Piccinini G, Flouri E, Ferrigno G, Pompili M, et al. Life adversities and suicidal behavior in young individuals: a systematic review. Eur Child Adolesc Psychiatry. 2015;24(12):1423–46.
Zatti C, Rosa V, Barros A, Valdivia L, Calegaro VC, Freitas LH, et al. Childhood trauma and suicide attempt: a meta-analysis of longitudinal studies from the last decade. Psychiatry Res. 2017;256:353–8.
Angelakis I, Gillespie EL, Panagioti M. Childhood maltreatment and adult suicidality: a comprehensive systematic review with meta-analysis. Psychol Med. 2019;49(7):1057–78.
Muniz CN, Fox B, Miley LN, DeLisi M, Cigarran GP, Birnbaum A. The effects of adverse childhood experiences on internalizing versus externalizing outcomes. Crim Justice Behav. 2019;46(4):568–89.
Wanner B, Vitaro F, Tremblay R, Turecki G. Childhood trajectories of anxiousness and disruptiveness explain the association between early-life adversity and attempted suicide. Psychol Med. 2012;42(11):2373–82.
Flynn M, Cicchetti D, Rogosch F. The prospective contribution of childhood maltreatment to low self-worth, low relationship quality, and symptomatology across adolescence: a developmental-organizational perspective. Dev Psychol. 2014;50(9):2165.
Mullen PE, Martin JL, Anderson JC, Romans SE, Herbison GP. The long-term impact of the physical, emotional, and sexual abuse of children: a community study. Eur Psychiatry. 1996;11(S4):393s.
Heim C, Nemeroff CB. The role of childhood trauma in the neurobiology of mood and anxiety disorders: preclinical and clinical studies. Biol Psychiatry. 2001;49(12):1023–39.
Ribakoviene V. Externalizing and internalizing problems of adolescent suicide attempters. Medicina. 2002;38(4):398–404.
Yoder KA, Longley SL, Whitbeck LB, Hoyt DR. A dimensional model of psychopathology among homeless adolescents: suicidality, internalizing, and externalizing disorders. J Abnorm Child Psychol. 2008;36(1):95–104.
Achenbach TM. The classification of children’s psychiatric symptoms: a factor-analytic study. Psychol Monogr Gen Appl. 1966;80(7):1.
Achenbach TM. Manual for the child behavior checklist/4-18 and 1991 profile. Burlington: Department of Psychiatry, University of Vermont; 1991.
Levesque RJ. Encyclopedia of adolescence. Cham: Springer Science & Business Media; 2011.
Kerr DC, Reinke WM, Eddy JM. Trajectories of depressive symptoms and externalizing behaviors across adolescence: associations with histories of suicide attempt and ideation in early adulthood. Suicide Life Threat Behav. 2013;43(1):50–66.
Soto-Sanz V, Castellví P, Piqueras JA, Rodríguez-Marín J, Rodríguez-Jiménez T, Miranda-Mendizábal A, et al. Internalizing and externalizing symptoms, and suicidal behaviour in young people: a systematic review and meta-analysis of longitudinal studies. Acta Psychiatr Scand. 2019;140(1):5–19.
Esposito CL, Clum GA. The relative contribution of diagnostic and psychosocial factors in the prediction of adolescent suicidal ideation. J Clin Child Adolesc Psychol. 2003;32(3):386–95.
Piqueras JA, Soto-Sanz V, Rodríguez-Marín J, García-Oliva C. What is the role of internalizing and externalizing symptoms in adolescent suicide behaviors? Int J Environ Res Public Health. 2019;16(14):2511.
Duprey EB, Oshri A, Liu S. Developmental pathways from child maltreatment to adolescent suicide-related behaviors: the internalizing and externalizing comorbidity hypothesis. Dev Psychopathol. 2019;32(3):945–59.
Kim KM, Nam S, Choi JW, Jung AH, Hong SB, Kim JW, et al. Psychometric properties, and factor structures of the Korean version of children’s depression rating scale-revised. J Child Adolesc Psychopharmacol. 2018;28(4):285–92.
Shin JY, Kim KM, Lee KH, Hong SB, Lee J, Choi CH, et al. Psychometric properties and factor structures and the Korean version of the screen for child anxiety related emotional disorders (SCARED). BMC Psychiatry. 2020;20(1):1–12.
Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, et al. Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry. 1997;36(7):980–8.
Kaufman J, Birmaher B, Axelson D, Perepletchikova F, Brent D, Ryan N. Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL 2013, DSM-5). New Haven: Western Psychiatric Institute and Yale University; 2013.
Brent D, Emslie G, Clarke G, Wagner KD, Asarnow JR, Keller M, et al. Switching to another SSRI or to venlafaxine with or without cognitive behavioral therapy for adolescents with SSRI-resistant depression: the TORDIA randomized controlled trial. JAMA. 2008;299(8):901–13.
McNamara RK, Nandagopal JJ, Strakowski SM, DelBello MP. Preventative strategies for early-onset bipolar disorder. CNS Drugs. 2010;24(12):983–96.
Park S. Reliability and validity of the early trauma inventory self report-short form among Korean adolescents. J Korean Acad Child Adolesc Psychiatry. 2018;29(1):2–6.
Han IY, Lee YW, Yoo SK, Park MS, Kim JS. A national survey on the prevalence and risk factors of child sexual abuse. Korean J Soc Welf. 2008;60(2):131–53.
Jeon JR, Lee EH, Lee SW, Jeong EG, Kim JH, Lee D, et al. The early trauma inventory self-report-short form: psychometric properties of the Korean version. Psychiatry Investig. 2012;9(3):229–35.
Lee HL, Oh KJ, Hong KE, Ha EH. Clinical validity study of Korean CBCL through item analysis. J Korean Acad Child Adolesc Psychiatry. 1991;2(1):138–49.
Pai D, Woo J-M, Son MH, Lee C. The reliability and validity of the Korean version of Columbia-suicide severity rating scale in alcohol dependent patients. J Korean Neuropsychiatr Assoc. 2015;54(2):222–7.
Landis RS, Beal DJ, Tesluk PE. A comparison of approaches to forming composite measures in structural equation models. Organ Res Methods. 2000;3(2):186–207.
Hair JF. Multivariate data analysis. Boston: Cengage; 2009.
Wheaton B. Assessment of fit in overidentified models with latent variables. Sociol Methods Res. 1987;16(1):118–54.
Wheaton B, Muthen B, Alwin DF, Summers GF. Assessing reliability and stability in panel models. Sociol Methodol. 1977;8:84–136.
Hooper D, Coughlan J, Mullen M. Structural equation modeling: guidelines for determining model fit. Electron J Bus Res Methods. 2008;6:53–60.
Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238.
Bentler PM, Bonett DG. Significance tests and goodness of fit in the analysis of covariance structures. Psychol Bull. 1980;88(3):588.
Bollen KA. A new incremental fit index for general structural equation models. Sociol Methods Res. 1989;17(3):303–16.
Browne MW, Cudeck R. Alternative ways of assessing model fit. Sociol Methods Res. 1992;21(2):230–58.
Kline RB. Principles and practice of structural equation modeling. New York: Guilford publications; 2015.
Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Mark Res. 1981;18(1):39–50.
Willner CJ, Gatzke-Kopp LM, Bray BC. The dynamics of internalizing and externalizing comorbidity across the early school years. Dev Psychopathol. 2016;28(4pt1):1033–52.
Choi JH, Yu M, Kim KE. Suicidal ideation in adolescents: a structural equation modeling approach. Nurs Health Sci. 2015;17(1):119–25.
Kim H, Kim B. Verification of the structural relationship model of suicidal ideation to its related variables. Korean J Couns Psychol. 2008;20(2):201–9.
Lee JD, Cho MJ, Sohn JH, Park S, Seong S, Ahn JH, et al. Evaluation of a functional model of acquired capability for suicide in a nationwide sample of Korean adults. Psychiatry Investig. 2016;13(6):601.
Thompson R, Proctor LJ, English DJ, Dubowitz H, Narasimhan S, Everson MD. Suicidal ideation in adolescence: examining the role of recent adverse experiences. J Adolesc. 2012;35(1):175–86.
van Lier PA, Koot HM. Developmental cascades of peer relations and symptoms of externalizing and internalizing problems from kindergarten to fourth-grade elementary school. Dev Psychopathol. 2010;22(3):569–82.
Brook JS, Lee JY, Finch SJ, Brown EN. The association of externalizing behavior and parent–child relationships: an intergenerational study. J Child Fam Stud. 2012;21(3):418–27.
Ellis BJ, Del Giudice M, Dishion TJ, Figueredo AJ, Gray P, Griskevicius V, et al. The evolutionary basis of risky adolescent behavior: implications for science, policy, and practice. Dev Psychol. 2012;48(3):598.
Doan SN, Dich N, Fuller-Rowell TE, Evans GW. Externalizing behaviors buffer the effects of early life adversity on physiologic dysregulation. Sci Rep. 2019;9(1):1–8.
Sarchiapone M, Jaussent I, Roy A, Carli V, Guillaume S, Jollant F, et al. Childhood trauma as a correlative factor of suicidal behavior—via aggression traits. Similar results in an Italian and in a French sample. Eur Psychiatry. 2009;24(1):57–62.
Braquehais MD, Oquendo MA, Baca-García E, Sher L. Is impulsivity a link between childhood abuse and suicide? Compr Psychiatry. 2010;51(2):121–9.
Rytilä-Manninen M, Haravuori H, Fröjd S, Marttunen M, Lindberg N. Mediators between adverse childhood experiences and suicidality. Child Abuse Negl. 2018;77:99–109.
Bridge JA, Goldstein TR, Brent DA. Adolescent suicide and suicidal behavior. J Child Psychol Psychiatry. 2006;47(3–4):372–94.
This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT and Future Planning (NRF-2015R1A2A2A01004501) and was supported by Promising-Pioneering Research Program through Seoul National University (SNU) in 2015. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Ethics approval and consent to participate
Ethical approval for this study was obtained from the Institutional Review Board for Human Subjects of Seoul National University Hospital. All the participants and their parents received detailed information about the study, and written informed consent was obtained from all the participants before the commencement of the study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Structure and internal consistency of childhood trauma. Table S2. Structure and internal consistency of internalizing symptoms. Table S3. Structure and internal consistency of externalizing symptoms. Table S4. Structure and internal consistency of suicidality.
Initial measurement model (Confirmatory Factor Analysis). Figure S2. Final measurement model (Confirmatory Factor Analysis). Figure S3. Competitive model I. Figure S4. Measurement model on independent dataset (sensitivity analysis). Figure S5. Structural model on independent dataset (sensitivity analysis).
About this article
Cite this article
Kim, G., Shin, J. & Kim, JW. The mediating role of internalizing and externalizing symptoms in the relationship between childhood trauma and suicidality among adolescents: a structural equation model. Child Adolesc Psychiatry Ment Health 15, 79 (2021). https://doi.org/10.1186/s13034-021-00434-x
- Childhood trauma
- Internalizing symptoms
- Externalizing symptoms
- Structural equation model