Skip to main content
Download PDF
Download ePub

Development and pilot testing of a five item traumatic stress screener for use with adolescents in pediatric primary care

Child and Adolescent Psychiatry and Mental Health volume 16, Article number: 71 (2022) Cite this article

Abstract

Background

Almost 80% of adolescents in the US have experienced a traumatic event, and approximately 7% have post-traumatic stress disorder. However, there is a lack of validated and feasible assessments for assessing traumatic stress symptoms in pediatric primary care, and traumatic stress symptoms are routinely unidentified. This study aimed to develop, pilot test, and assess the psychometric properties of the Adolescent Primary Care Traumatic Stress Screen (APCTSS), a five-item yes/no screener for post-traumatic stress symptoms in adolescents designed for use in pediatric primary care.

Methods

The APCTSS was developed by pediatricians, psychiatrists, psychologists, and social workers who all provide care to trauma-affected adolescent patients. The providers sought to create a developmentally appropriate tool that accurately reflected DSM-5 posttraumatic stress symptoms and that was feasible and acceptable for use in pediatric primary care. To develop the APCTSS, they combined and adapted the UCLA Post-traumatic Stress Disorder (PTSD) Reaction Index for DSM-5 with the adult Primary Care PTSD Screen for DSM-5. Next, 213 adolescent medicine patients were universally approached during routine clinic visits and 178 agreed to participate and were enrolled. The 178 patients were aged 13-22 (M=18.4, SD=2.3), 64.4% female; 62.1% Black or African-American, and 20.7% Hispanic/Latinx. Patients completed APCTSS, Patient Health Questionnaire for Adolescents (PHQ-A), and the Child PTSD Symptom Scale for DSM-5 Interview (CPSS-5-I), and 61 completed the Traumatic Events Screening Inventory for Children (TESI-C).

Results

56.7% reported a criterion A trauma, 30.1% met criteria for DSM-5 PTSD, 7.4% met criteria for subsyndromal PTSD symptoms, and 19.0% for post-event impairing symptoms. Validity and reliability testing indicated that the APCTSS was internally consistent, had good concurrent and discriminant validity, and demonstrated good sensitivity and specificity in identifying adolescents at high risk for post-trauma symptoms. Over half of patients (56.0%) who screened positive on the APCTSS (score ≥2) would not have been identified as having a mental health concern using the PHQ-A, including 60.8% of patients who had probable PTSD, subsyndromal PTSD, or post-event impairing symptoms.

Conclusions

Many youth with trauma-related mental health symptoms are unidentified in pediatric primary care, which is a missed opportunity for early identification and may contribute to a host of poor outcomes. The development of an effective and feasible traumatic stress screening tool for youth primary care may improve early intervention, and the health and well-being of trauma affected youth.

Background

Almost 80% of adolescents in the US have experienced a traumatic event [1], and approximately 7% have post-traumatic stress disorder (PTSD) [2]. PTSD is associated with school failure, high-risk sexual behaviors, suicide attempts, substance abuse, relationship problems, involvement in the justice system, and poor physical health outcomes [3]. Unfortunately, PTSD and traumatic stress symptoms are routinely unidentified in pediatric primary care [4], and most pediatricians report that they lack adequate knowledge, skills, and comfort to discuss PTSD, and only 10% assess and treat PTSD [5].

Some of the difficulty with identifying patients with traumatic stress symptoms in primary care may stem from the fact that typically individuals with PTSD symptoms do not spontaneously report their mental health symptoms or trauma histories [6, 7]. If health providers do not explicitly assess these symptoms, they are often missed. Indeed, PTSD detection rates in routine adult primary care have found detection rates from 0% to a high of 52% [3]. Therefore, screening may be necessary to detect patients who are coping with trauma-related symptoms. Luckily, research with adult samples has found that most patients are comfortable reporting trauma exposure and PTSD symptoms on primary care screeners [8]. Recently, adverse childhood experiences (ACEs) are being more routinely assessed in pediatric primary care [9]. However, fewer than 20% of trauma-exposed youth will develop PTSD [10], thereby reducing the utility of screening for ACEs to identify youth most in need of trauma-focused mental health care.

Additionally, there is a lack of validated and feasible assessments for assessing traumatic stress symptoms in pediatric primary care. Primary care requires brief and simple tools [11]. However, most PTSD screeners for youth and adults have been developed and validated in specialty mental health settings with clinical populations, and have 17 or more items and multiple response options [12, 13]. A few brief measures with yes/no response options have been developed, but they predict future PTSD [14] or assess acute stress, rather than PTSD symptoms [15]. The Child Trauma Screen (CTS) is the only other PTSD screener for children and adolescents that has been validated for use in primary care for adolescents [16–18]. However, the CTS was developed in a community mental health clinic and consists of four dichotomous trauma exposure items and six reaction items measured on a 4-point Likert scale [19]. The only PTSD symptom scales developed for, and validated in, primary care have been for adults [20].

Few studies have investigated the implementation and feasibility of PTSD screening in primary care, but studies suggest that even the longest screening tools take only 10 minutes to complete [20]. However, given the very limited time available in busy primary care practices, providers and researchers tend to prioritize brevity [21]; often one or two item screeners, such as the Patient Health Questionnaire (PHQ-2) [22], have more uptake in routine care. However, one or two item PTSD screeners such as the Single-item PTSD Screener (SIPS) [23] and the 2-item PTSD Checklist [24] have been found to have weak psychometric properties in medical settings due to limited variation in response options [20] and low specificity [24]. In contrast, the five-item Primary Care PTSD Screen (PC-PTSD) has reasonable psychometric properties [25], and is widely used and accepted in adult primary care [26]. The characteristics of the PC-PTSD that are attractive for use in primary care include: (1) being self-report, (2) being only 4 or 5 items long, (3) focusing on meaningful empirically supported symptoms, (4) not utilizing Likert-style responses, (5) not requiring an interview about trauma exposure, (6) focusing on current PTSD, and (7) having psychometrics from primary care [27].

Given that a wide range of stress-related symptoms in childhood confer a transdiagnostic diathesis for mental disorders including, but not limited to, PTSD [28, 29], somatic syndromes [30], and poor physical health [31] in later adolescence and adulthood, we sought to develop a more comprehensive traumatic stress scale that would not only identify adolescents who meet DSM-5 PTSD diagnostic criteria [32], but also those with functionally-impairing post-trauma symptoms, including subsyndromal PTSD [33], and patients with trauma-related symptoms due to a non-DSM-5 Criterion A trauma such as relationship difficulties, non-violent deaths of loved ones, bullying, and separation from parents. Individuals with subsyndromal PTSD experience substantial functional difficulties that require mental health treatment [34] and often progress to full PTSD [35]. The need to identify youth with post-trauma symptoms who might not meet full diagnostic criteria for PTSD may be particularly pertinent when trying to identify high-risk youth who may be expected to present with less severe symptoms than individuals detected through routine clinical care [36]. Additionally, PTSD symptoms following non-DSM-5 Criterion A traumas are often similar to, or sometimes worse than, those reported after Criterion A traumas [37]. Early identification and treatment of all of these adolescent patients may prevent more severe problems and is therefore of interest to pediatrics providers.

The three aims of this study were to (1) develop the Adolescent Primary Care Traumatic Stress Screen (APCTSS), a screener that is feasible and acceptable in pediatrics, (2) pilot the APCTSS in an adolescent medicine clinic, and (3) assess its psychometric properties, including the internal structure of the scale, its concurrent and discriminant validity, and its sensitivity/specificity and clinical cut point for identifying DSM-5 PTSD, subsyndromal PTSD, or clinically impairing symptoms associated with a non-Criterion A distressing event.

Method: Aim 1—Development of the APCTSS

Study site

This study was conducted in Boston Medical Center’s (BMC) Department of Pediatrics’ Adolescent Center, which treats patients aged 12–22 years old. BMC is the largest safety-net hospital in New England, with 57% percent of patients from underserved populations and 72% insured by government payors [38]. This study was approved and overseen by Boston University Medical Center IRB (H-37901 and H-37749).

Procedures

The 31-item UCLA PTSD Reaction Index for DSM-5 (UCLA-RI-5) [12], a well-validated PTSD scale for children and adolescents, was adapted and combined with the 5-item adult Primary Care PTSD Screen for DSM-5 (PC-PTSD-5) [25]. Six attending-level healthcare providers in the BMC Departments of Psychiatry (two psychologists and one psychiatrist) and Pediatrics (one adolescent medicine physician and two social workers) with expertise in diagnosing and treating PTSD in adolescents independently identified UCLA-RI-5 items corresponding to each of the items on the PC-PTSD-5.

The results of the mapping exercise were presented to five clinicians in the BMC Department of Psychiatry who are experts in diagnosing and treating PTSD in adolescents (three psychiatrists and two psychologists), of which three also participated in the item mapping. The five experts reached consensus on which of the identified UCLA-RI-5 items they thought best represented the symptom profile of PTSD in adolescents and best discriminated adolescents with PTSD from those with other mental health disorders (See Table 1 for consensus results). The first and fourth authors refined and adapted the item language and instructions to develop an introductory prompt.

Table 1 Items from the UCLA-RI-5 that corresponded to the PC-PTSD-5, as rated by expert clinicians
Full size table

Results: Aim 1—Development of the APCTSS

At least four of the five raters believed that 11 items from the UCLA-RI-5 corresponded to at least one of the five items on the PC-PTSD-5 (see Table 1). There was consensus that both of the UCLA-RI-5 items that corresponded to PC-PTSD-5 item #1 (nightmares) were more likely to be present in adolescents with PTSD than adolescents with other mental disorders, and these items were retained. For PC-PTSD-5 item #2 (avoidance), the UCLA-RI-5 item describing imaginal rather than physical avoidance was selected, since many adolescents are unable to physically avoid reminders of trauma. To represent PC-PTSD-5 item #3 (hyperarousal) they selected an item that did not include being on the lookout for danger, as this may be a common response for non-symptomatic adolescents exposed to potentially dangerous environments. The experts agreed that the two UCLA-RI-5 items that corresponded to PC-PTSD-5 item #4 (numbing/detachment) did not adequately differentiate PTSD from other mental disorders in adolescents, and neither were retained. Two of the UCLA-RI-5 items that corresponded to PC-PTSD-5 item #5 (guilt/blame) were deemed to discriminate between PTSD and other mental disorders and were combined into one. The UCLA-RI-5 item, “I have thoughts like I am bad” was not retained due to strong overlap with symptoms of depression and anxiety. The initial prompt for the APCTSS was adapted from the UCLA-RI-5 self-report trauma history screener (See Figure 1 for the complete APCTSS measure).

Fig. 1
figure 1

The Adolescent Primary Care Traumatic Stress Screen (APCTSS)

Full size image

Method: Aim 2—Assessment of the Psychometric Properties of the APCTSS

Recruitment

When a researcher was available for assessment, all BMC adolescent medicine patients seen in the clinic were informed about the study and invited to participate. Patients over 18 provided verbal informed consent, while patients under 18 and a legal guardian provided verbal assent and consent, respectively. Recruitment took place in the waiting room and in examination rooms while patients were waiting to be seen by clinic staff. Informed consent and completion of study measures took place either in a private therapy office or in an examination room.

Participants

A total of 213 adolescents were approached for participation between December 2018 and February 2020. Of the 213 youth, 10 (4.7%) were excluded because they could not complete study procedures in English. Of the 203 remaining youth, 178 agreed to participate and were enrolled (response rate = 87.7% of eligible youth). The 178 participants ranged in age from 13–22 (M = 18.4, SD = 2.3). Almost two-thirds of the sample were female (64.4%), 23.6% were male, and 12.0% were transgender or non-binary. In terms of race/ethnicity, 62.1% of participants identified as Black or African-American, 20.7% identified as Hispanic or Latino, 9.4% identified as White or Caucasian, and 7.4% identified as another race/ethnicity or as multi-racial. Sample demographics were reflective of the overall clinic population.

Sample size and power

The sample size goal was 200 participants based on a power calculation assuming a sample prevalence rate of DSM-5 PTSD of 30%, a sensitivity of 0.85 and specificity of 0.90 with 95% CI half widths of 0.09 for sensitivity and 0.07 for specificity. We had collected data on 178 of 200 participants by the end of February 2020, when data collection was stopped due to Covid-19. Due to uncertain timeline of resumed in-person data collection, we concluded data collection at 178 participants.

Measures

The APCTSS was developed in earlier phases of the study and described above. Self-reported depression was assessed using the Patient Health Questionnaire for Adolescents (PHQ-A) [39], a nine-item survey designed for use in primary care with adolescents aged 13-18. The Traumatic Events Screening Inventory for Children (TESI-C) [40] assessed potentially traumatic events. Participant responses were classified as DSM-5 Criterion A traumatic events in accordance with DSM-5 guidelines [32, 41]. PTSD symptoms were assessed using the Child PTSD Symptom Scale for DSM-5 Interview (CPSS-5-I) [13], which has been validated with youth between the ages of 8 and 18. Cronbach’s alpha of the symptom scale was .95 in this sample. The CPSS-5-I interview begins with a prompt asking participants to “tell me about the most upsetting or scary experience you’ve ever had” and then provides examples [13]. Interviewers recorded the participant’s most upsetting experiences and when they occurred, and also separately recorded whether the experiences included actual or threatened death, serious injury, or sexual violation. After recording the most upsetting event, the interviewers used the CPSS-5-I to assess the frequency of 20 PTSD symptoms that participants experienced in the past month related to the most upsetting event. Symptoms were rated on a 5-point Likert scale (0=not at all; 4=6 or more times a week/almost always). Finally, the CPSS-5-I assesses the frequency of functional impairment due to PTSD symptoms across seven domains using the same Likert scale.

Participants were classified as having DSM-5 PTSD if they reported a Criterion A trauma and at least all of the following: one intrusion item, one avoidance item, two changes in cognition and mood items, two increased arousal and reactivity items, and three impairment items [13, 32]. Participants were classified as having sub-syndromal PTSD if they endorsed a Criterion A trauma and at least two symptom categories and one functional impairment item [32]. Participants were classified as having post-distressing event symptoms if they endorsed at least two symptom categories and at least one functional impairment item, but did not report a qualifying Criterion A trauma.

Study procedures

After informed consent, participants independently completed the APCTSS and PHQ-A with pencil and paper, which is the typical form of PTSD screener administration [20, 21] and which is also the standard screening approach in the clinic. Upon completion of the two screeners, two research team members, who were a PhD candidate in Applied Human Development and a clinical psychology master’s student, verbally administered the CPSS-5-I as an interview [13] and participants completed a demographic questionnaire on their own using pencil and paper. The researchers were blind to the participant responses on the APCTSS and the PHQ-A.

During data collection, researchers suspected that some participants who reported non-Criterion A events as their most upsetting experience in response to the open-ended prompt may have also experienced, but not reported, a Criterion A trauma. Therefore, after the first 9 months of data collection, the Traumatic Events Screening Inventory for Children (TESI-C) [40], a trauma events checklist, was added to evaluate whether participants who completed an inventory of traumatic events reported the same rates of Criterion A trauma as those who were just asked to share the most scary or upsetting event they had experienced when prompted during the CPSS-5-I. The initial open-ended prompt on the CPSS-5-I about, “the most upsetting or scary experiences you’ve ever had” was asked first, then researchers verbally administered the TESI-C, and then the researchers administered the remaining PTSD symptoms and functional impairment items of the CPSS-5-I. Approximately one-third of participants (N = 61) had the TESI-C verbally administered after the CPSS-5-I open-ended prompt, and prior to the CPSS-5-I symptom and functional impairment assessment. All participants received a $5 cash card for their participation.

Statistical analysis

Analysis included examining (1) the internal structure of the APCTSS using Cronbach’s alpha, (2) concurrent and discriminant validity using Pearson’s correlation coefficients with the CPSS-5-I and the PHQ-A, and (3) sensitivity and specificity to differentiate participants with and without PTSD and optimal diagnostic cutoff scores for the APCTSS through the use of receiver operating characteristic (ROC) analysis and calculation of the Youden index. In addition, we compared the ability of the APCTSS to identify adolescents at risk of subsyndromal PTSD symptoms or undetected trauma exposure who would otherwise not be identified by the PHQ-A. Post-hoc ROC analyses were run on the subset of participants who completed the TESI-C to assess area under the curve (AUC), sensitivity, and specificity when accounting for trauma disclosed on the TESI-C when assessing Criterion A for PTSD diagnosis.

Results: Aim 2—Assessment of the Psychometric Properties of the APCTSS

Descriptive statistics

Over half of the sample (57.3%) endorsed at least one item on the APCTSS, and 39.3% endorsed two or more items (See Table 2 for item-level descriptives). More than half (56.7%) of participants reported experiencing a Criterion A trauma on either the TESI-C or CPSS-5-I. Participants who completed the TESI-C were more likely to report Criterion A trauma experiences (71.2%) than those who did not (49.6%), χ2(1) = 7.50, p < .01. The average score on the CPSS-5-I symptom scale was 20.28 (SD = 17.60) regardless of whether they had a qualifying Criterion A trauma, indicating that the average BMC adolescent medicine primary care patient endorsed moderate levels of PTSD symptoms. Almost one-third (30.1%) met criteria for DSM-5 PTSD, 7.4% met criteria for subsyndromal PTSD, and an additional 19.0% met criteria for post-event impairing symptoms. The average score on the PHQ-A was 5.80 (SD = 5.39), indicating non-clinical levels of depression symptoms. Results of Fisher’s exact tests indicated that there were no differences in PTSD rates (Fisher’s exact = 0.78), at least subsyndromal PTSD (Fisher’s exact = 1.67), or at least impairing symptoms (Fisher’s exact = 1.23) by race/ethnicity, although we were underpowered to detect differences for White or multiracial or other race youth.

Table 2 Item-level descriptive statistics for the Adolescent Primary Care Traumatic Stress Screen (APCTSS) (N=178)
Full size table

Internal consistency

The Cronbach’s alpha coefficient for the APCTSS was .77, which is considered adequate. Coefficient alpha did not improve significantly with the removal of any of the 5 items.

Sensitivity, specificity, and positive and negative predictive value

ROC analysis and the Youden index score indicated that a score of 2 or higher on the APCTSS was associated with optimal values for sensitivity (.79; 95% CI=.66 to .89) and specificity (.68; 95% CI = .59 to .76) for probable PTSD diagnosis (see Table 3). A cut-off score of 2 yielded a positive predictive value (PPV) of .55 (95% CI = .47 to .62) and a negative predictive value (NPV) of .87 (95% CI = .80 to .92). The area under the curve (AUC) was .79. A cut-off score of 2 was also the optimal cut-off for detecting sub-syndromal PTSD, with a sensitivity of .78 (95% CI=.67 to .88), specificity of .73 (95% CI=.64 to .82), AUC of .81, and a Youden index of .51. A cut-off score of 2 resulted in 16 false positives (9.0%; i.e., youth identified as being at high risk on the screener, but did not have DSM-5 PTSD, sub-syndromal PTSD, or post-event impairing symptoms), but missed 32 youth (18.0%) who had impairing symptoms. Comparatively, a score of 1 resulted in 41 (23.0%) false positives but only missed 12 (6.7%) youth who did have these symptoms, of which four had PTSD.

Table 3 Number and percent of participants with PTSD diagnoses and symptoms compared to APCTSS scores
Full size table

Results of the post-hoc ROC analyses were run on the subset of participants who completed the TESI-C to assess AUC, sensitivity, and specificity when accounting for Criterion A trauma exposure that was not reported in response to the open-ended prompt on the CPSS-5-I. A cut-off score of 2 was also the optimal cut-point for the subset of participants who completed the TESI-C, but sensitivity (.86; 95% CI=.65 to .90), specificity (.77; 95% CI=.60 to .90), PPV (.70; 95% CI = .56 to .82), NPV (.90; 95% CI = .76 to .96) and AUC (.86) were stronger for PTSD diagnosis compared to the full sample. Similar results were observed for subsyndromal PTSD and post-event impairing symptoms (See Table 3 for complete results).

Concurrent validity

The APCTSS was strongly correlated with the total CPSS-5-I symptom score (r = .71, p < .001) and the total score for impairment items (r = .62, p < .001).

Discriminant validity

The APCTSS was moderately correlated with the PHQ-A (r = .55, p <. 001), and the association was significantly lower than the association between the APCTSS and the CPSS-5-I (z = 3.87, p < .001) [42]. Over half of patients (56.0%) who screened positive on the APCTSS (score ≥2) would not have been identified as having a mental health concern using the PHQ-A, including 60.8% of patients who had probable PTSD, subsyndromal PTSD, or post-event impairing symptoms.

Discussion

The need for a feasible and valid primary care posttraumatic stress screener for pediatrics is high. In this sample, more than 55% of adolescents presenting for primary care reported experiencing a Criterion A trauma, 30% met DSM-5 diagnostic criteria for PTSD, and a further 26% either had sub-syndromal PTSD or post-event impairing symptoms. All together, 56% had functionally impairing symptoms associated with a traumatic or difficult event. Although the PTSD prevalence rate found in this study was high, results also suggest that our study may have actually underestimated the prevalence of PTSD in our sample. Because more participants who were administered the TESI-C endorsed Criterion A traumas than participants who were only asked to report trauma in response to an open-ended prompt, it is possible that the false positive rate on the screener was artificially inflated because some would have qualified for DSM-5 PTSD or sub-syndromal PTSD had we administered the TESI-C, since more of them likely would have endorsed Criterion A experiences. The finding of somewhat higher trauma reports using a trauma checklist has been observed in other studies that specifically sought to answer this question [43]. Therefore, it is likely that more than 30% of the adolescent patients seen in routine pediatric primary care at BMC have PTSD, which is often not detected or assessed. The high rates of PTSD and post-trauma symptoms identified by this study emphasize the need to have a psychometrically sound and feasible traumatic stress screener for use in pediatric primary care, particularly clinics serving low-income and black, indigenous, and people of color (BIPOC) youth.

The PTSD prevalence in this sample is much higher than rates found from epidemiological studies [2], but is similar to other populations of youth who receive primary care services in US safety net hospitals or federally qualified health centers [44] which provide healthcare to individuals regardless of their insurance status or ability to pay, and serve a higher proportion of patients who are racial/ethnic minorities, non-English speaking, uninsured, underinsured, undocumented, or low-income [45–47]. Our study sample was more than 60% Black or African-American and more than 21% Hispanic or Latino, which mirrors the overall BMC pediatric primary care clinic population. Although we did not collect data on income or socioeconomic status, more than 70% of BMC patients are insured by government payors [38], a blunt proxy for low-income status. Low-income and BIPOC youth are disproportionately affected by traumatic and adverse events [48, 49], which are at least partially downstream outcomes of structural inequities. One consequence of the disproportionate exposure to trauma and ACEs that low-income and BIPOC youth cope with is a higher rate of subsequent PTSD and associated mental health symptoms and disorders [50-52].

This study developed and pilot tested the Adolescent Primary Care Traumatic Stress Screen (APCTSS), the first traumatic stress symptoms screener for adolescents developed specifically for and within pediatric primary care. The development process leveraged expert and stakeholder knowledge by asking pediatricians, psychiatrists, psychologists, and social workers who all provide care to trauma-affected adolescent patients in BMC to identify common post-trauma symptoms expressed by their patients, refine the language in the measure to be developmentally appropriate, ensure that items accurately reflect symptoms rather than environmental or social stressors which may disproportionately impact some youth or communities (i.e., not including ‘being on the lookout for danger’), and create a feasible and useable measure that would have a very high likelihood of being adopted into routine practice in an urban pediatric primary care clinic that serves a diverse and primarily low-income patient population. Validity and reliability testing indicated that the APCTSS is internally consistent, has good concurrent and discriminant validity, and is effective at identifying adolescents at high risk for post-trauma symptoms and PTSD.

Our results suggest that a cut-off score of 2 on the APCTSS is appropriate for correctly identifying adolescents who are at high risk of having posttraumatic stress symptoms and require further assessment. The AUC of .79 was comparable to the AUC rate of other PTSD screeners used in primary care, which range from .75 to .93 [20], and an AUC of 0.7 and higher is generally considered strong in the field of applied psychology [53]. Moreover, a cut-off score of 2 yielded a PPV of .55 (95% CI = .47 to .62) and a NPV of .87 (95% CI = .80 to .92), in line with the performance of the PC-PTSD in in routine care primary care samples (0.41 and 0.97, respectively) [54] and in rigorous validity studies (0.51 and 0.99. respectively) [25].

While the results of the ROC curve analysis were strong for the full sample, they were even better in the sub-sample of participants who completed the TESI-C, with an AUC of .86, a sensitivity of .86 (95% CI=.65 to .90) and specificity of .77 (95% CI=.60 to .90). The results suggest that the lower scores in the full sample may be better explained by misclassification of some participants with PTSD as not having PTSD rather than inaccurate detection of the APCTSS. It is likely that the true classification accuracy of the APCTSS is closer to an AUC of .86 than .79. Regardless, the APCTSS was successful in accurately detecting high risk participants in this sample, demonstrating internal reliability, convergent validity, sensitivity, and specificity comparable to the Child Trauma Screen (CTS), a 10-item measure that uses a four-point Likert scale, and has also been validated, but not developed, in pediatric primary care [18]. However, the brevity, simplicity, and lack of a traumatic events scale of the APCTSS, along with its similar psychometric properties to longer screeners evaluated in pediatric primary care, may increase its likelihood of being adopted as the measure of choice in routine pediatric primary care, just as the PC-PTSD-5 has been adopted in routine adult primary care [55].

Notably, almost 70% of patients who screened positive on the APCTSS would not have been detected by the PHQ-A [39]. This included over half who had DSM-5 PTSD, subsyndromal PTSD, or post-event impairing symptoms. Reliance solely on generalized distress and depression scales to screen for common mental disorders may miss more than 50% of adolescents with trauma-related distress and impairment, similar to findings with adult samples [54]. Including a brief screener for posttraumatic stress symptoms may identify youth coping with PTSD symptoms who would otherwise not receive care.

Researchers have noted that the evidence base for universal screening of PTSD in primary care is limited, and therefore universal screening is not yet warranted. However, they suggest that targeted screening of patients who spontaneously report posttraumatic symptoms [36] or trauma exposure, have other mental health or substance abuse problems, or who are non-responsive to treatment for insomnia or pain [3], should be screened for trauma-related symptoms. This approach may be more cost-effective and would be expected to result in higher specificity and sensitivity [36]. The APCTSS could help fill the gap in pediatric primary care by providing a tool to quickly screen these high-risk patients.

Results must be interpreted within the limitations of the methods, including the reliance on youth self-report. However, the goal was to identify adolescents using self-report methods in assessing the APCTSS, and adolescents tend to be accurate reporters of internalizing distress [56] and so we concluded that self-report assessments would be appropriate. A second limitation was the lack of a clinician administered structured clinical interview, although we did utilize the interview version of the CPSS-5. Studies have found correlations exceeding .90 between self-report PTSD symptom scales and clinician rated structured interviews [57], and so we primarily utilized self-report measures for ease of administration. Future studies should validate the APCTSS using a clinician-rated structured clinical interview.

This study is also limited by the lack of inclusion of a trauma event checklist for most of the participants. The inclusion of the TESI-C for the last 34% of participants allowed us to identify more participants that qualified for PTSD or subsyndromal PTSD, and it is likely that earlier participants may have been misclassified as having post-event impairing symptoms when they met criteria for PTSD or subsyndromal PTSD. A further limitation is that our sample size did not allow us to look at psychometric properties by race/ethnicity or gender, and we did not include a measure of socioeconomic status. Future studies should utilize a larger sample size to assess differential validity or reliability across different demographic variables.

In addition, there was overlap of expert participants during the two phases of the development of the measure, such that three experts participated in step one, which was independently identifying UCLA-RI-5 items that corresponded to PC-PTSD-5 items, and also participated in step two, which was the consensus discussion of the results from step one to select specific items for inclusion on the APCTSS. It may be that the overlap in participants decreased the variance in expert opinion or biased the results in step two. However, we believe that use of both an independent rating and a consensus rating also strengthened item selection.

Finally, the APCTSS was developed and validated in the BMC Department of Pediatrics’ adolescent medicine clinic and results may not be generalizable to other clinics or populations. To address the above limitations, the psychometric properties of the APCTSS need to be further assessed in a different and larger pediatric primary care sample, using both clinician and patient rated symptoms, and a comprehensive trauma event checklist.

Despite these limitations, we believe that the development of the APCTSS is a first step towards routine implementation of a contextually and culturally appropriate posttraumatic stress screener for busy pediatrics clinics and their diverse patients. Although the APCTSS was developed and validated in one clinic, since it capitalizes on expert and stakeholder feedback, UCLA-RI-5 and PC-PTSD-5 items, and reliability and validity assessed in routine care in a diverse population, it may be generalizable and usable for many clinics. The study also had several other strengths which have typically been limitations of the other studies of primary care PTSD screeners [20], including universally approaching and enrolling primary care patients, non-selective recruitment for CPSS-5-I administration, and conducting the CPSS-5-I without knowledge of the results of the APCTSS.

Conclusion

Many youth with trauma-related mental health symptoms and functional impairment have not been identified in pediatric primary care. This missed opportunity for early identification, prevention, and intervention, may have contributed to a host of poor outcomes for these youth. The development of an effective and feasible posttraumatic stress screening tool for youth primary care may improve the health and well-being for some of our most vulnerable adolescents.

Availability of data and materials

The deidentified datasets used and analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

APCTSS:

Adolescent Primary Care Traumatic Stress Screen

PTSD:

Post-traumatic Stress Disorder

PHQ-A:

Patient Health Questionnaire for Adolescents

CPSS-5-I:

Child PTSD Symptom Scale for DSM-5 Interview

TESI-C:

Traumatic Events Screening Inventory for Children

ACEs:

Adverse childhood experiences

CTS:

Child Trauma Screen

PHQ-2:

Patient Health Questionnaire

SIPS:

Single-item PTSD Screener

PC-PTSD:

Primary Care PTSD Screen

BMC:

Boston Medical Center’s

UCLA-RI-5:

item UCLA PTSD Reaction Index for DSM-5

PC-PTSD-5:

Primary Care PTSD Screen for DSM-5

ROC:

receiver operating characteristic

AUC:

area under the curve

PPV:

positive predictive value

NPV:

negative predictive value

BIPOC:

black, indigenous, and people of color

References

  1. Turner HA, Finkelhor D, Ormrod R. Poly-victimization in a national sample of children and youth. Am J Prev Med. 2010;38(3):323–30.

    Article  PubMed  Google Scholar 

  2. Merikangas KR, He J-p, Burstein M, Swanson SA, Avenevoli S, Cui L, et al. Lifetime prevalence of mental disorders in US Adolescents Results from the National Comorbidity Study-Adolescent Supplement (NCS-A). J American Academy Child and Adolescent Psychiatry. 2010;49(10):980–9.

    Article  Google Scholar 

  3. Greene T, Neria Y, Gross R. Prevalence, detection and correlates of PTSD in the primary care setting: a systematic review. J Clin Psychol Medical Settings. 2016;23(2):160–80.

    Article  Google Scholar 

  4. Gerson R, Rappaport N. Traumatic stress and posttraumatic stress disorder in youth: recent research findings on clinical impact, assessment, and treatment. J Adolesc Health. 2013;52(2):137–43.

    Article  PubMed  Google Scholar 

  5. Banh MK, Saxe G, Mangione T, Horton NJ. Physician-reported practice of managing childhood posttraumatic stress in pediatric primary care. Gen Hosp Psychiatry. 2008;30(6):536–45.

    Article  PubMed  Google Scholar 

  6. Wurr CJ, Partridge IM. The prevalence of a history of childhood sexual abuse in an acute adult inpatient population. Child Abuse & Neglect. 1996;20(9):867–72.

    Article  CAS  Google Scholar 

  7. Read J, McGregor K, Coggan C, Thomas DR. Mental health services and sexual abuse: the need for staff training. J Trauma Dissociation. 2006;7(1):33–50.

    Article  PubMed  Google Scholar 

  8. Goldstein E, Athale N, Sciolla AF, Catz SL. Patient preferences for discussing childhood trauma in primary care. Perm J. 2017;21:16–055.

    Article  PubMed  PubMed Central  Google Scholar 

  9. California Department of Health Care Services. Trauma Screenings and Trauma-Informed Care Provider Trainings 2021. https://www.dhcs.ca.gov/provgovpart/Pages/TraumaCare.aspx. Accessed 30 Dec 2020.

  10. Alisic E, Zalta AK, van Wesel F, Larsen SE, Hafstad GS, Hassanpour K, et al. Rates of post-traumatic stress disorder in trauma-exposed children and adolescents: meta-analysis. Br J Psychiatry. 2014;204:335–40.

    Article  PubMed  Google Scholar 

  11. Löwe B, Kroenke K, Gräfe K. Detecting and monitoring depression with a two-item questionnaire (PHQ-2). J Psychosomatic Res. 2005;58(2):163–71.

    Article  Google Scholar 

  12. Steinberg AM, Brymer MJ, Kim S, Briggs EC, Ippen CG, Ostrowski SA, et al. Psychometric properties of the UCLA PTSD reaction index: part I. J Trauma Stress. 2013;26(1):1–9.

    Article  PubMed  Google Scholar 

  13. Foa EB, Asnaani A, Zang Y, Capaldi S, Yeh R. Psychometrics of the child PTSD symptom scale for DSM-5 for trauma-exposed children and adolescents. J Clin Child Adolesc Psychol. 2018;47(1):38–46.

    Article  PubMed  Google Scholar 

  14. Kenardy JA, Spence SH, Macleod AC. Screening for posttraumatic stress disorder in children after accidental injury. Pediatrics. 2006;118(3):1002–9.

    Article  PubMed  Google Scholar 

  15. Kassam-Adams N, Marsac ML. Brief practical screeners in english and spanish for acute posttraumatic stress symptoms in children. J Traumatic Stress. 2016;29(6):483–90.

    Article  Google Scholar 

  16. Lang JM, Connell CM, Macary S. Validating the child trauma screen among a cross-sectional sample of youth and caregivers in pediatric primary care. Clinical Pediatrics. 2021;60(4/5):252–8.

    Article  PubMed  Google Scholar 

  17. Lang JM, Connell CM. The child trauma screen: a follow-up validation. J Traumatic Stress. 2018;31(4):540–8.

    Article  Google Scholar 

  18. Lang JM, Connell CM, Macary S. Validating the child trauma screen among a cross-sectional sample of youth and caregivers in pediatric primary care. Clin Pediatr (Phila). 2021;60(4–5):252–8.

    Article  PubMed  Google Scholar 

  19. Lang JM, Connell CM. Development and validation of a brief trauma screening measure for children: the child trauma screen. Psychol Trauma. 2017;9(3):390–8.

    Article  PubMed  Google Scholar 

  20. Spoont M, Arbisi P, Fu S, Greer N, Kehle-Forbes S, Meis L, et al. VA Evidence-based Synthesis Program Reports. Screening for Post-Traumatic Stress Disorder (PTSD) in Primary Care: A Systematic Review. Washington (DC): Department of Veterans Affairs (US); 2013.

  21. Brewin CR. Systematic review of screening instruments for adults at risk of PTSD. J Traumatic Stress. 2005;18(1):53–62.

    Article  Google Scholar 

  22. Kroenke K, Spitzer RL, Williams JB. The Patient Health Questionnaire-2: validity of a two-item depression screener. Med Care. 2003;41(11):1284–92.

    Article  PubMed  Google Scholar 

  23. Gore KL, Engel CC, Freed MC, Liu X, Armstrong DW. 3rd Test of a single-item posttraumatic stress disorder screener in a military primary care setting. General Hospital Psychiatry. 2008;30(5):391–7.

    Article  PubMed  Google Scholar 

  24. Lang AJ, Stein MB. An abbreviated PTSD checklist for use as a screening instrument in primary care. Behav Res Ther. 2005;43(5):585–94.

    Article  PubMed  Google Scholar 

  25. Prins A, Bovin MJ, Smolenski DJ, Marx BP, Kimerling R, Jenkins-Guarnieri MA, et al. The primary care PTSD screen for DSM-5 (PC-PTSD-5): development and evaluation within a veteran primary care sample. J General Internal Med. 2016;31(10):1206–11.

    Article  Google Scholar 

  26. Spoont MR, Williams JW Jr, Kehle-Forbes S, Nieuwsma JA, Mann-Wrobel MC, Gross R. Does this patient have posttraumatic stress disorder?: rational clinical examination systematic review. JAMA. 2015;314(5):501–10.

    Article  CAS  PubMed  Google Scholar 

  27. Prins A, Ouimette P, Kimerling R, Cameron RP, Hugelshofer DS, Shaw-Hegwer J, et al. The primary care PTSD screen (PC-PTSD): development and operating characteristics. Primary Care Psychiatry. 2003;9(1):9–14.

    Article  Google Scholar 

  28. Basu A, Farkas DK, Jiang T, Koenen KC, Lash TL, Sørensen HT, et al. Incident psychiatric comorbidity following stress disorder diagnoses in Danish school-aged children: prospective population-based study. British J Psychiatry. 2020;217(1):377–82.

    Article  Google Scholar 

  29. D’Andrea W, Ford J, Stolbach B, Spinazzola J, van der Kolk BA. Understanding interpersonal trauma in children: why we need a developmentally appropriate trauma diagnosis. Am J Orthopsychiatry. 2012;82(2):187–200.

    Article  PubMed  Google Scholar 

  30. Afari N, Ahumada SM, Wright LJ, Mostoufi S, Golnari G, Reis V, et al. Psychological trauma and functional somatic syndromes: a systematic review and meta-analysis. Psychosomatic Med. 2014;76(1):2.

    Article  Google Scholar 

  31. O’Donovan A, Sun B, Cole S, Rempel H, Lenoci M, Pulliam L, et al. Transcriptional control of monocyte gene expression in post-traumatic stress disorder. Dis Markers. 2011;30(2–3):123–32.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. American Psychiatric Association. Diagnostic and statistical manual of mental disorders, Fifth Edition. 5th ed. Arlington: American Psychiatric Publishing; 2013.

    Book  Google Scholar 

  33. Alessi EJ, Meyer IH, Martin JI. PTSD and sexual orientation: An examination of criterion A1 and non-criterion A1 events. Psychol Trauma: Theory, Research, Practice, and Policy. 2013;5(2):149–57.

    Article  Google Scholar 

  34. Pietrzak RH, Schechter CB, Bromet EJ, Katz CL, Reissman DB, Ozbay F, et al. The burden of full and subsyndromal posttraumatic stress disorder among police involved in the World Trade Center rescue and recovery effort. J Psychiatric Res. 2012;46(7):835–42.

    Article  Google Scholar 

  35. Fink DS, Gradus JL, Keyes KM, Calabrese JR, Liberzon I, Tamburrino MB, et al. Subthreshold PTSD and PTSD in a prospective-longitudinal cohort of military personnel: potential targets for preventive interventions. Depress Anxiety. 2018;35(11):1048–55.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Sonis J. PTSD in primary care—an update on evidence-based management. Cur Psychiatry Rep. 2013;15(7):373.

    Article  Google Scholar 

  37. Lansing AE, Plante WY, Beck AN. Assessing stress-related treatment needs among girls at risk for poor functional outcomes: The impact of cumulative adversity, criterion traumas, and non-criterion events. J Anxiety Disorders. 2017;48:36–44.

    Article  Google Scholar 

  38. Boston Medical Center. Boston Medical Center Community Health Needs Assessment Final Report. 2016.

  39. Johnson JG, Harris ES, Spitzer RL, Williams JB. The patient health questionnaire for adolescents: validation of an instrument for the assessment of mental disorders among adolescent primary care patients. J Adolesc Health. 2002;30(3):196–204.

    Article  PubMed  Google Scholar 

  40. Ford J, Racusin R, Rogers K, Ellis C, Schiffman J, Ribbe D, et al. Traumatic events screening inventory for children (TESI-C) Version 8.4. National Center for PTSD and Dartmouth Child Psychiatry Research Group. 2002.

  41. Pai A, Suris AM, North CS. Posttraumatic stress disorder in the DSM-5: controversy, change, and conceptual considerations. Behav Sci (Basel). 2017;7(1):7.

    Article  PubMed Central  Google Scholar 

  42. Steiger JH. Tests for comparing elements of a correlation matrix. Psychological Bulletin. 1980;87(2):245–51.

    Article  Google Scholar 

  43. Monson E, Lonergan M, Caron J, Brunet A. Assessing trauma and posttraumatic stress disorder: single, open-ended question versus list-based inventory. Psychological Assessment. 2016;28(8):1001–8.

    Article  PubMed  Google Scholar 

  44. Selwyn CN, Schneider M, Anderson C, Langhinrichsen-Rohling J. Recognizing the hurt: prevalence and correlates of elevated PTSD symptoms among adolescents receiving mental/behavioral health services in primary care. Psychological Services. 2019;16(1):58–66.

    Article  PubMed  Google Scholar 

  45. Gaskin DJP, Hadley JP. Population characteristics of markets of safety-net and non-safety-net hospitals. J Urban Health. 1999;76(3):351–70.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. Lasser KE, Liu Z, Lin M-Y, Paasche-Orlow MK, Hanchate A. Changes in hospitalizations at US safety-net hospitals following medicaid expansion. JAMA Network Open. 2021;6:e2114343.

    Article  Google Scholar 

  47. Nath JB, Costigan S, Hsia RY. Changes in demographics of patients seen at federally qualified health centers, 2005–2014. JAMA internal medicine. 2016;176(5):712–4.

    Article  PubMed  Google Scholar 

  48. Giano Z, Wheeler DL, Hubach RD. The frequencies and disparities of adverse childhood experiences in the US. BMC Public Health. 2020;20(1):1327.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Mersky JP, Choi C, Plummer Lee C, Janczewski CE. Disparities in adverse childhood experiences by race/ethnicity, gender, and economic status: Intersectional analysis of a nationally representative sample. Child Abuse Neglect. 2021;117: 105066.

    Article  PubMed  Google Scholar 

  50. Price J, Genuario K, Romeo D, Pruden K, Elwell S, Matwiejewicz D, et al. Implementation of a standardized screening program for risk of posttraumatic stress disorder among youth hospitalized with injury. Psychol Serv. 2019;16(1):48–57.

    Article  PubMed  Google Scholar 

  51. Lopez CM, Andrews AR, Chisolm AM, de Arellano MA, Saunders B, Kilpatrick DG. Racial/ethnic differences in trauma exposure and mental health disorders in adolescents. Cultur Divers Ethnic Minor Psychol. 2017;23(3):382–7.

    Article  PubMed  Google Scholar 

  52. Pulsifer BH, Evans CL, Capel L, Lyons-Hunter M, Grieco JA. Cross-sectional assessment of mental health and service disparities in a high-risk community. Transl Issues Psychological Sci. 2019;5(4):365–73.

    Article  Google Scholar 

  53. Rice ME, Harris GT. Comparing effect sizes in follow-up studies: ROC Area, Cohen’s d, and r. Law Hum Behav. 2005;29(5):615–20.

    Article  PubMed  Google Scholar 

  54. Ouimette P, Wade M, Prins A, Schohn M. Identifying PTSD in primary care: comparison of the primary Care-PTSD Screen (PC-PTSD) and the General Health Questionnaire-12 (GHQ). Journal of Anxiety Disorders. 2008;22(2):337–43.

    Article  PubMed  Google Scholar 

  55. Bovin MJ, Kimerling R, Weathers FW, Prins A, Marx BP, Post EP, et al. Diagnostic accuracy and acceptability of the primary care posttraumatic stress disorder screen for the diagnostic and statistical manual of mental disorders (Fifth Edition) among US Veterans. JAMA Netw Open. 2021;4(2):e2036733.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Weems CF, Zakem AH, Costa NM, Cannon MF, Watts SE. Physiological response and childhood anxiety: association with symptoms of anxiety disorders and cognitive bias. J Clin Child Adolesc Psychol. 2005;34(4):712–23.

    Article  PubMed  Google Scholar 

  57. Blanchard EB, Jones-Alexander J, Buckley TC, Forneris CA. Psychometric properties of the PTSD checklist (PCL). Behav Res Ther. 1996;34(8):669–73.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

The authors wish to thank Janice Weinberg, ScD of the Boston University School of Public Health, for her assistance with the power analysis.

Funding

This study was funded by The Gennaro Acampora Junior Investigator Pilot Award through the Boston Medical Center Department of Psychiatry to Lauren Ng. The funder did not participate in the work.

Author information

Author notes

  1. Lauren C. Ng

    Present address: Department of Psychology, University of California Los Angeles, Psychology Building 1285, Box 951563, Los Angeles, CA, 90095-1563, USA

  2. Ming Him Tai

    Present address: University of Minnesota, Minneapolis, MN, USA

Authors and Affiliations

  1. Department of Psychiatry, Boston Medical Center, Boston University, Boston, MA, USA

    Lauren C. Ng

  2. Department of Psychiatry, Boston Medical Center, Boston, MA, United States

    Rachel Oblath & Ming Him Tai

  3. Department of Pediatrics, Boston Medical Center, Boston, MA, USA

    Rebecca Brigham & Mandy Coles

  4. Department of Psychology, Boston University, Boston, MA, USA

    Ming Him Tai

  5. Department of Pediatrics, Boston University, Boston, MA, USA

    Mandy Coles

Authors
  1. Lauren C. Ng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rachel Oblath
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rebecca Brigham
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ming Him Tai
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mandy Coles
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Lauren Ng conceptualized and designed the study, drafted the initial manuscript, reviewed and revised the manuscript, and acquired funding. Rachel Oblath designed the data collection instruments, collected data, carried out the initial analyses, and reviewed and revised the manuscript. Rebecca Brigham coordinated and supervised data collection and critically reviewed the manuscript for important intellectual content. Ming Him Tai collected data and reviewed and revised the manuscript. Mandy Coles conceptualized and designed the study, coordinated and supervised data collection, and critically reviewed the manuscript for important intellectual. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Lauren C. Ng.

Ethics declarations

Ethics approval and consent to participate

Patients over 18 provided verbal informed consent, while patients under 18 and a legal guardian provided verbal assent and consent, respectively. Recruitment took place in the waiting room and in examination rooms while patients were waiting to be seen by clinic staff. Informed consent and completion of study measures took place either in a private therapy office or in an examination room. This study was approved and overseen by Boston University Medical Center IRB (H-37901 and H-37749).

Consent for publication

Not Applicable

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ng, L.C., Oblath, R., Brigham, R. et al. Development and pilot testing of a five item traumatic stress screener for use with adolescents in pediatric primary care. Child Adolesc Psychiatry Ment Health 16, 71 (2022). https://doi.org/10.1186/s13034-022-00501-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13034-022-00501-x

Keywords

  • Traumatic stress
  • Pediatric primary care
  • Assessment
  • Post-traumatic stress disorder

Child and Adolescent Psychiatry and Mental Health

ISSN: 1753-2000