Skip to main content

Translation, cultural adaptation and validation of Patient Health Questionnaire and generalized anxiety disorder among adolescents in Nepal

Abstract

Background

Depression and anxiety are significant contributors to the global burden of disease among young people. Accurate data on the prevalence of these conditions are crucial for the equitable distribution of resources for planning and implementing effective programs. This study aimed to culturally adapt and validate data collection tools for measuring depression and anxiety at the population level.

Methods

The study was conducted in Kathmandu, Nepal, a diverse city with multiple ethnicities, languages, and cultures. Ten focus group discussions with 56 participants and 25 cognitive interviews were conducted to inform adaptations of the Patient Health Questionnaire adapted for Adolescents (PHQ-A) and Generalized Anxiety Disorder (GAD-7). To validate the tools, a cross-sectional survey of 413 adolescents (aged 12–19) was conducted in three municipalities of Kathmandu district. Trained clinical psychologists administered the Kiddie Schedule for Affective Disorders and Schizophrenia (K-SADS-DSM 5 version) to survey participants.

Results

A number of cultural adaptations were required, such as changing statements into questions, using a visual scale (glass scale) to maintain uniformity in responses, and including a time frame at the beginning of each item. For younger adolescents aged 12 to 14 years, a PHQ-A cut-off of > = 13 had a sensitivity of 0.93, specificity of 0.80, positive predictive value (PPV) of 0.33, and negative predictive value (NPV) of 0.99. For older adolescents aged 15–19, a cut-off of > = 11 had a sensitivity of 0.89, specificity of 0.70, PPV of 0.32, and NPV of 0.97. For GAD-7, a cut-off of > = 8 had a sensitivity of 0.70 and specificity of 0.67 for younger adolescents and 0.71 for older adolescents, with a PPV of 0.39 and NPV of 0.89. The individual symptom means of both PHQ-A and GAD-7 items showed moderate ability to discriminate between adolescents with and without depression and anxiety.

Conclusion

The PHQ-A and GAD-7 demonstrate fair psychometric properties for screening depression but performed poorly for anxiety, with high rates of false positives. Even when using clinically validated cut-offs, population prevalence rates would be inflated by 2–4 fold with these tools, requiring adjustment when interpreting epidemiological findings.

Introduction

Adolescence is the peak age for the onset of 50% of mental health conditions (Kessler et al. [16]). Depressive and anxiety disorders make up over 50% of the total estimated mental health burden among adolescents (Institute of Health Metrics (IHME), [12]). Additionally, suicide was the fourth leading cause of death among 15-29-year-olds globally in 2019 (World Health Organization [39]). Negative impacts associated with depression and anxiety disorders include failure to complete secondary school, unemployment, and unplanned pregnancy or parenthood (Cleary et al. [6]). These adverse consequences disproportionately affect the more than 1 billion adolescents living in low- and middle-income countries (LMICs) (Hayes et al. [10]).

Adolescents in Nepal are at high risk of mental health problems due to recent and historical trauma, including two major earthquakes in 2015, civil war from 1996 to 2006 and recurrent natural disasters such as seasonal flash floods and landslides. This compounded by parental migration and socio-economic deprivation. Limited research has been conducted to assess mental health problems among children and adolescents in Nepal. Existing studies show a wide variation in reported rates of depression ranging from 0.4 to 56.5%, (Dhimal et al. [8]; Gautam et al. [9]; Karki et al. [14]; Ojha et al. [28]; Paudel et al. [29]; Risal and Sharma [32]; Sharma et al. [33]; Silwal et al. [34]) and anxiety ranging from 2 to 55.6% (Dangal and Bajracharya [7]; Dhimal et al. [8]; Karki et al. [14]; Ojha et al. [28]; Paudel et al. [29]; Rimal and Pokharel [31]) among children and adolescents. The wide range of reported prevalence rates could be due to the range of tools used, non-random sampling and small sample sizes (Steel et al. [36]). Research on adolescent mental health in LMICs like Nepal is hindered by the lack of validated measurement tools that can be used at the population level. Cultural adaptation and validation of tools are needed to accurately assess the mental health burden (Kohrt and Kaiser [19]) and inform the development and implementation of mental health policies and services (Hayes et al. [10]). Similarly, studies have pointed out that early identification and treatment of these disorders are the key factors for improved prognosis (McGorry and Mei [24]).

This study aims to address gaps in measuring depression and anxiety among adolescents in Nepal at the population level. In this paper, we describe a systematic process to translate, culturally adapt, and validate the Patient Health Questionnaire adapted for adolescents (PHQ-A) and Generalized Anxiety Disorder (GAD-7) for adolescents aged 12 to 19. This process follows the protocol developed as part of UNICEF’s initiative to measure adolescent and young people’s mental health at the population level (MMAPP) (Carvajal-Velez et al. [4]). The cultural adaptation and clinical validation ensure the accuracy of assessment tools to improve the detection of adolescents with mental health conditions. This data can be used in future health-promotion efforts and healthcare resource allocation. Ultimately, the data generated by these tools may guide the appropriate allocation of resources to address adolescent mental health conditions and inform decisions about prioritizing investment in interventions to prevent or alleviate the impact of mental health conditions among adolescents.

Methods

Setting

The study was conducted in Kathmandu district, the capital city of Nepal, which has a total population of approximately two million (National Statistics Office [27]). Nepal is home to more than 125 caste/ethnic groups, many of whom have their own language and culture (Central Bureau of Statistics [5]). There are 123 languages spoken including Nepali, the national language. The national literacy rate is 76.2% (National Statistics Office [27]) with school enrollment at 94.7% in the basic level (grades 1 to 8) and 51.2% in the secondary level (Ministry of Education Science and Technology [25]). Focus group discussions (FGDs) and cognitive interviews were conducted in Nagarjun Municipality while the validation study was conducted in Kathmandu Metropolitan City, Budhanilkantha Municipality and Tokha Municipality of Kathmandu district.

Participants and sample size

The study included Nepali-speaking adolescents aged 12 to 19, representing diverse castes, ethnicities, languages, and cultures. We aimed to recruit 500 adolescents, divided into two age groups: 12 to 14 and 15 to 19. The study had two phases: Phase 1 involved qualitative research, including FGDs and CIs to translate and adapt the tool, while Phase 2 included survey questionnaires and semi-structured clinical interviews. In Phase-I, 81 adolescents participated in activities to adapt the PHQ-A and GAD-7 for the Nepali context. This included 10 FGDs (56 participants) and 25 cognitive interviews conducted between July and August 2021. FGDs were held separately for boys and girls, as well as younger and older adolescents. In Phase 2, 413 adolescents completed the quantitative survey for the validation component (157 younger adolescents and 256 older adolescents).

Figure 1 summarizes the study process and steps followed in both the adaptation and pilot testing, and validation phases.

Fig. 1
figure 1

Study process and flow chart

Recruitment process

Two trained and experienced researchers oversaw both Phase 1 qualitative (focus group discussions and cognitive interviews) and Phase 2 quantitative survey administration. Research assistants (RAs) received a two-week training that covered both qualitative and quantitative data collection. The training focused on unstructured and structured interviewing, study population, sample size, and recruitment process. It also covered the content of the instruments and interview guides, scoring, referral systems, immediate care, and inclusion/exclusion criteria. Various pre-tests and mock interviews were conducted during the training period to assess the interviewers’ confidence levels.

Phase-I recruitment

The focus group discussions and cognitive interviews were conducted with school-going adolescents from Nagarjun Municipality, Budhanilkantha Municipality, and Kathmandu Metropolitan City, all located in the Kathmandu Valley. Participants for the FGDs and CIs were selected with the support from school teachers and principals. Purposive sampling was used to ensure representation of different castes/ethnicities and age groups. After receiving the name list from the schools, we distributed consent forms to the adolescents. Those who returned the signed forms were included in the focus group discussions and cognitive interviews. Additionally, we conducted interviews with adolescents receiving services from TPO Nepal.

Phase II recruitment

We aimed to recruit a diverse sample of participants, some of whom were likely to have anxiety or depression, and others who did not have these conditions. We used proactive case detection strategies, specifically the Community Informant Detection Tool (CIDT) (Jordans et al. [13]) to recruit participants from different public schools in Budhanilkantha and Tokha Municipalities. First, a psychosocial counselor trained school teachers on the CIDT for anxiety and depression, asking them to refer adolescents who met the CIDT threshold for anxiety or depression, as well as those who did not meet any CIDT criteria. When we were unable to recruit enough adolescents through teachers, the psychosocial counselor also trained students on the CIDT for self-referral. To increase the number of adolescents likely to have depression or anxiety, we also recruited some adolescents from the Child & Adolescent Psychiatry (CAP) unit of Kanti Children’s Hospital (KCH), the only dedicated child and mental health service provider in Nepal. Research assistants (RAs) visited each school or KCH, assessed inclusion/exclusion criteria, obtained written informed assent and consent, and conducted interviews in a confidential space, such as a spare room or open ground.

Four clinical psychologists specializing in child and adolescent populations conducted clinical interviews using the Kiddie Schedule for Affective Disorders and Schizophrenia (K-SADS). They received training on identifying depressive and anxiety disorders, interviewing techniques, K-SADS administration, and referrals from an expert psychiatrist. They also established inter-rater reliability through practice assessments with adolescents. Both research assistants (RAs) and clinical psychologists used Android-supported devices to administer the PHQ-A and GAD-7, as well as the K-SADS interview schedules. Of the 413 participants, 236 were first interviewed by RAs, while 177 were first interviewed by the clinical psychologists. The second interviews were conducted within 72 h of the first interview. The clinical psychologists conducting the interviews were blind to the results of the PHQ-A and GAD-7. The entire interview process, including the PHQ-A, GAD-7, and K-SADS, lasted between 1 and 1.15 h. Data collected by RAs and clinical psychologists on Android devices were submitted online daily for quality assurance. Data collection took place between September 1, 2021, and December 21, 2021, and was conducted in Nepali for both Phase-I and Phase-II.

Phase-I interview guide

The FGD guide included questions to assess the acceptability, relevance, comprehensibility, and completeness of each item in the tool. It also included pictorial and Likert scales (Kohrt et al. [18]) to determine the best structure for eliciting responses. The guide also included questions to check participants’ understanding by asking them to rephrase the questions in their own words. The CI guide included questions to determine how participants interpret the items and response options in the tool. It also included questions to assess the extent to which adolescents associate symptoms with impairment in daily functioning. The guide also allowed participants to modify and change the questions in their own language.

Phase-II instruments

Patient health questionnaire adapted for adolescents (PHQ-A): PHQ-A is a widely used tool for assessing depressive symptoms in adolescents aged 11 to 17 [30]. Adolescents are asked to score nine common symptoms of depression based on their experience in the past 2 weeks. It has a four-point rating scale that ranges from 0 ‘not at all’ to 3 ‘always. The raw scores on the 9 items should be summed to obtain a total. The total score ranges from 0 to 27, with higher scores indicating greater severity of depression. The PHQ-A is based on the PHQ-9 which was previously shown to be a reliable and valid tool to assess depressive symptoms among adults in Nepal (Kohrt et al. [20]). A cut-off of 10 was recommended to indicate moderate and severe depression.

Generalized Anxiety Disorder (GAD-7): GAD-7 is a seven-item tool that is used to screen for generalized anxiety disorder. The GAD-7 is a self-administered questionnaire and each item has a Likert-response format on a 4-point scale (0–3 points). Respondents were asked to consider the previous 2 weeks and to rate symptom frequency as ‘not at all’ (0), ‘several days’ (1), ‘more than half of all days’ (2) or ‘nearly all days’ (3). The total score response ranged from 0 to 21 (Spitzer et al. [35]). GAD-7 has been validated in various settings, and has widely been used to measure anxiety disorders (Mughal et al. [26]).

Kiddie Schedule for Affective Disorders and Schizophrenia (K-SADS): We used the K-SADS as the standard diagnostic measure for depression and anxiety. The K-SADS is a semi-structured interview for children aged 6–18, designed to assess ongoing psychopathology, including mood and anxiety disorders (Kaufman et al. [15]). Modules include a screening section to determine if a more comprehensive section is needed. Symptoms are scored as 2 (subthreshold) or 3 (threshold), and criteria-based algorithms determine the presence of current disorders, in line with the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) (American Psychiatric Association [1]). For this study, clinical psychologists administered the depression module and a selection of anxiety modules (generalized anxiety, social anxiety, panic disorder, and separation anxiety) of the K-SADS to identify major depressive disorder and anxiety disorders. The clinical psychologists were trained and supervised by a bilingual psychiatrist. The K-SADS was previously translated, adapted and used in Nepal (Kohrt et al. [18]).

Statistical analyses

We manually analyzed Phase 1 qualitative data using the content analysis method. In Phase II, we presented the data descriptively for the full sample and stratified by gender. We used diagnostic categories including depression diagnosis, anxiety diagnosis, any diagnosis, and no diagnosis. To assess the criterion validity of the PHQ-A and GAD-7 against a clinician’s diagnosis (K-SADS), we constructed a receiver operating characteristic (ROC) curve using the PHQ-A and GAD-7 total scores. We calculated the area under the curve (AUC) separately for boys, girls, younger adolescents, and older adolescents, using the K-SADS as the gold standard. Additionally, we calculated psychometric properties for a range of cut-off scores and presented sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). We compared individual items of both the PHQ-A and GAD-7 between adolescents with depression/anxiety and those without any diagnosis using an independent t-test. Statistical analysis was performed using the Statistical Package for Social Science (SPSS) version 28 (IBM Corp [11]).

Results

Phase-1 qualitative results

Out of the 81 adolescents who participated in the Phase-I qualitative study, the majority were between the ages of 12 and 15 (58%), currently in grades 6 to 8 (38.3%), and belonged to the Brahmin/Chhetri (45.7%) or Janajati (34.6%) caste/ethnic groups.

Translation and cultural adaptation of PHQ-A and GAD-7

The translation and cultural adaptation of the PHQ-A and GAD-7 were conducted following UNICEF’s MMAPP protocol (Carvajal-Velez et al. [4]). The PHQ-A was translated by two mental health experts, including a clinical psychologist and a psychiatrist with a research background, who were experienced in translating mental health tools. The GAD-7 was translated by three mental health experts, including two clinical psychologists and one psychiatrist. The translators followed the guidelines recommended for cross-cultural research (van Ommeren et al. [38]).

First, a particular item of the PHQ-A and GAD-7 was translated from English to Nepali, back translated into English, and evaluated based on comprehensibility, acceptability, relevance, and completeness (Kohrt et al. [18]). Second, the translations were reviewed by two mental health researchers and one psychiatrist, who made several adaptations to ensure the translations were acceptable and easily understandable by different groups of adolescents. Third, feedback and inputs from adolescents were obtained through focus group discussions (FGDs) and cognitive interviews (CIs). In the FGDs, participants were asked if the translations were understandable, acceptable, and relevant to adolescents from different caste/ethnic groups, ages, and education levels. If a word or terminology was not acceptable or understandable, participants were asked to provide an alternative translation or terminology. Fourth, after incorporating feedback and suggestions from the FGDs, cognitive interviews were conducted individually with adolescents who were not involved in the FGDs. The results from the FGDs and CIs are summarized separately for the PHQ-A and GAD-7 in Tables 1 and 2, respectively.

Table 1 PHQ-A original item, back-translation of Nepali items, and comments from adolescents
Table 2 GAD-7 original item, back-translation of Nepali items, and comments from adolescents

The major adaptation made in both PHQ-A and GAD-7 included changing statements into questions, using a visual scale (glass scale) to maintain uniformity in responses and keeping a time frame (i.e. in the past two weeks) in the beginning of each item. We included a water glass response pictorial scale to maintain uniformity in assessing the severity of each symptom. This scale was developed through a transcultural translation process with children in Nepal (Kohrt et al. [18]). Adolescents in the adaptation phase found that using the water glass response scale helped them differentiate between different response options.

Other adaptations suggested by the adolescents included providing examples to clarify specific questions, dividing certain items into multiple questions, and ensuring that items are relevant to the local context by explaining the meaning of specific terminology or idioms. For example, adolescents mentioned that “watching TV” is one of their most enjoyable activities, so it was recommended to remove “watching TV” from PHQ-A item-7.

Sometimes it is hard to concentrate due to tension or sadness. However, adolescents are able to maintain their concentration on TV at any time, even when they are feeling tense, because watching TV is an interesting activity for them.Cognitive interview-8.

Moreover, during the FGDs and CIs, most of the adolescents recommended splitting PHQ-A items 3, 5, 6, and 8 into multiple questions. They observed that these items encompassed multiple themes or ideas within a single question. For instance, during a cognitive interview, one adolescent mentioned experiencing sleep problems for several days. However, he pointed out that he couldn’t provide the same response to all three issues, such as having difficulty falling asleep, waking up during sleep, or feeling sleepier than before.

Similarly, during the FGDs and CIs, many adolescents suggested breaking down PHQ-A items 3, 5, 6, and 8 into multiple questions. They noticed that these items covered multiple themes or ideas within a single question. For example, during a cognitive interview, one adolescent mentioned having sleep problems for several days. However, he noted that he couldn’t give the same response to all three issues, such as difficulty falling asleep, waking up during sleep, or feeling sleepier than before.

This question (PHQ-9 item3) contains three ideas/concepts, therefore, it makes hard to understand once at a time. Therefore, I suggest asking the first two ideas in a separate question, and last idea in another question–Cognitive interview-9.

Participants reported that there is no idiom or appropriate terminology for “feeling on edge” (GAD-7 item-1) in Nepali. Therefore, they suggested excluding this term from the Nepali translation. Additionally, an example of “writing, playing games, hanging out, using mobile” has been suggested to added clarifying the term “things” for GAD-7 item-3. Most participants associated “trouble relaxing” (GAD-7 item-4) with physical aspects, so this has been further clarified by adding “because of (feeling) fidgety in your mind”. Furthermore, the term “easily annoyed or irritable” in GAD-7 item-6 has been changed to “annoyed or irritable in small things”. An example has also been added in GAD-7 item-7 to clarify the term “awful” (Table 2).

Phase-2 validation study results

Table 3 displays the socio-demographic characteristics of the participants in the validation study (Phase II). The majority of the participants were girls (55%). Their ages ranged from 12 to 19 years, with most falling between 15 and 19 years old (62%). The most common castes were Brahmin/Chhetri (53.1%) or Janajati (36.1%), and the majority practiced Hinduism (79.7%) and spoke Nepali at home (81.4%).

Table 3 Social demographic characteristics of the participants involved in the validation study

Psychometric properties for PHQ-A

We presented the area under the curves (AUCs) for both PHQ-A and GAD-7 separately for girls, boys, younger, and older adolescents. The AUC of PHQ-A for boys was 0.81 (95% CI, 0.68–0.93), while it was 0.88 (95% CI, 0.82–0.93) for girls. Similarly, the AUC for younger adolescents was 0.92 (95% CI, 0.85–0.98), while it was 0.85 (95% CI, 0.79–0.92) for older adolescents.

Table 4 presents the psychometric properties of the adapted PHQ-A compared with the K-SADS depression module. A cut-off score for the overall sample of > = 11, yields sensitivity of 0.90 and specificity of 0.71. The positive predictive value for the cut-off score of > = 11 was 0.31 and 0.98. The results suggested different cut-off scores for younger and older adolescents. A cutoff score for younger adolescents (12 to 14 years) is > = 13, with a sensitivity of 0.93 and specificity of 0.80. The PPV and NPV for > = 13 for younger adolescents were 0.33 and 0.99. On the other hand, a cut-off score for older adolescents was > = 11, with a sensitivity of 0.89 and specificity of 0.70, and PPV of 0.32 and NPV of 0.97 (Table 2). Similarly, the results also suggested different cut-off scores for boys and girls. A cut-off score of > = 11 with a sensitivity of 0.73 and specificity of 0.78 has been suggested for boys. The PPV and NPV for the > = 11 cut-off for boys were 0.17 and 0.97. Similarly, a cut-off score for girls of > = 13 has a sensitivity of 0.85 and specificity of 0.73. The cut-off score of > = 13 has a PPV of 0.40 and NPV of 0.96 (supplementary table-1).

Table 4 Validation psychometrics of the PHQ-A comparison with the K-SADS

Psychometric properties for GAD-7

The AUC of GAD-7 was 0.80 (95% CI, 0.73–0.87) for younger adolescents and 0.76 (95% CI, 0.70–0.82) for older adolescents. For boys, the AUC was 0.77 (95% CI, 0.69–0.85) and slightly lower for girls at 0.74 (95% CI, 0.68–0.81).

Table 5 presents the psychometric properties of GAD-7 for the overall sample, boys, girls, and younger and older adolescents separately. A cut-off score for the overall sample of > = 7 yields a sensitivity of 0.83 and specificity of 0.61. The PPV and NPV for the cut-off score of > = 7 were 0.41 and 0.92. Acut-off score for both younger and older adolescents was 8, with the same sensitivity (0.70 for both groups) but slightly different specificities (0.67 for younger and 0.71 for older adolescents), PPVs (0.39 for younger and 0.50 for older adolescents), and NPVs (0.89 for younger and 0.85 for older adolescents). The results suggested different cut-off scores for boys and girls. A cut-off score of > = 7 with a sensitivity of 0.75 and specificity of 0.71 has been suggested for boys. The PPV and NPV for the > = 7 cut-off for boys were 0.31 and 0.94. Similarly, a cut-off score for girls of > = 8 yields a sensitivity of 0.76 and specificity of 0.61. The cut-off score of > = 8 has a PPV of 0.51 and NPV of 0.83 (supplementary table-1).

Table 5 Validation psychometrics of the GAD-7 from comparison with the K-SADS

Adjustments for population prevalence

Figure 2 shows the adjusted prevalence rates for adolescent depression and anxiety at the population level. These rates were calculated using the psychometric properties obtained in this study. We adjusted the false positive (FP) and false negative (FN) rates in the current sample to calculate the true prevalence in the population. For instance, if a prevalence rate of 40% is found for depression on the PHQ-A, the estimated true prevalence rate in younger populations is closer to 25% and for older adolescents it would be below 20%.

Fig. 2
figure 2

Application of the validation results: adjustments for population level prevalence

Item level analysis

The internal consistency reliability of the PHQ-A (Cronbach’s alpha) was 0.914. Table 6 shows the mean scores of each PHQ-A item for adolescents diagnosed with depression and those without a diagnosis. The results indicate that the PHQ-A items have excellent discriminant ability between depressed and non-depressed adolescents. The mean scores of all PHQ-A items were significantly higher (P < .001) among adolescents with depression compared to those without a diagnosis. Similarly, the mean scores of all PHQ-A items were significantly higher among younger and older adolescents with depression compared to their counterparts without a diagnosis.

Table 6 Discriminant ability of PHQ-A items for adolescents with and without diagnosis on K-SADS

Supplemental Table 4 showed that there was no significant difference in the mean score of PHQ-9 item-9 (thoughts of being better off dead/hurting yourself) between boys with and without depression. However, the mean scores of all PHQ-9 items were significantly higher among girls with anxiety (supplemental Table 4).

The internal consistency reliability for GAD-7 (Cronbach’s alpha) was 0.907. Table 7 shows that the mean scores of all GAD-7 items were significantly higher among adolescents diagnosed with generalized anxiety disorder than those without any diagnosis. Similarly, the mean scores of all GAD-7 items were also significantly higher among younger and older adolescents with GAD compared to their counterparts without any diagnosis (Table 7).

Table 7 Discriminant ability of GAD-7 items for adolescents with and without diagnosis on the K-SADS

Supplemental Table 5 shows that there was no significant difference in the mean score of GAD-7 item 7 (feeling afraid as if something awful might happen) between boys with and without depression. However, the mean scores of all GAD-7 items were significantly higher among girls with anxiety (Supplemental Table 5).

Discussion

This study translated, culturally adapted, and validated the PHQ-A and GAD-7 for Nepali-speaking adolescents aged 12 to 19 years, following the methods outlined in UNICEF’s MMAPP protocol (Carvajal-Velez et al. [4]). These methods are based on the systematic process recommended for cross-cultural research (Kohrt et al. [18]; van Ommeren et al. [38]). Key adaptations to both the PHQ-A and GAD-7 included changing statements to question form, using a visual scale (e.g., a glass with water) to standardize responses, adding a timeframe to each item, and simplifying the language with local idioms of distress to fit the local context. Examples were also added to clarify the meaning of multiple items in the PHQ-A and GAD-7. Additionally, some words and terminologies were changed to make them more relevant to the local context. For example, “weight loss” was replaced by “getting thinner without intention” or “losing weight for no reason.” Similarly, the term “trouble relaxing” was further clarified by adding “because of fidgety in your mind,” as adolescents understood “trouble relaxing” as a physical problem.

The adolescents who participated in the adaptation process made a key comment about the need to split an item with multiple ideas into different questions. They noted that participants tend to remember the last part of the question and respond accordingly. For example, they suggested splitting PHQ-A item-4 into three separate questions: poor appetite, overeating, and weight loss for no reason, as they believed these are distinct ideas that should not be combined into one question. Most of the adolescents also commented that each item should only include one idea, while commonly used mental health tools often include multiple ideas in one item (known as double-barrel questions). Another interesting finding is that the examples provided by participants in this study differed from those in previous studies. For instance, in the past, visiting a maternal uncle’s house was reported as the most enjoyable activity among adolescents (Kohrt et al. [18]), but none of the adolescents in this study mentioned it. Instead, they reported enjoying activities such as watching TV or playing games on mobile phones. This suggests that examples of enjoyable activities change over time, and it is important for tools to be adaptable to reflect adolescents’ current experiences, which may differ from those of previous generations.

Adolescents linked their mental health problems with tension/stress (tanab) and bodily complaints. They explained how tension affects their bodies and daily lives. Many existing mental health assessment tools do not include items related to bodily complaints, which are important indicators for accurately detecting mental health problems. In Nepal, the understanding and expression of mental health and psychosocial problems is complex among the various ethnic and cultural groups. Generally, people express their mental health problems through their bodies, and the heart-mind (man) is believed to be an organ of emotion and feeling, while the brain-mind (dimaag) is considered an organ of cognition (Kohrt and Harper [17]). Therefore, it is important to include physical or bodily complaints in mental health assessment tools to capture the specific idioms of distress in different contexts.

The results showed that the culturally adapted Nepali version of the PHQ-A had fair sensitivity, specificity, diagnostic agreement, and overall accuracy for adolescents in Nepal. A cut-off score of 11 could be for general use, but different cut-off scores should be used based on intended use of the tool (e.g., is higher sensitivity, specificity, PPV, or NPV desired), then the cut-off should be adjusted accordingly (Kohrt and Kaiser [19]; Conflict and health). Different cut-offs can be used for specific groups such as younger or older adolescents, boys or girls, and clinical or community-based samples. Adolescents with depression had significantly higher mean scores in all individual symptom PHQ-A items, demonstrating discriminant validity of individual depression symptoms. The sensitivity and specificity for the cut-off score of 11 were 0.90 and 0.71, respectively. Our sensitivity results are consistent with or better than those summarized in a recent systematic review of 29 validation studies of the PHQ-9 (Carroll et al. [3]), which reported a combined sensitivity and specificity at a cut-off score of 10 or above as 0.88 and 0.85, respectively (Levis et al. [21]). However, the specificity was considerably lower for our study compared the systematic review findings, which illustrates high rates of false positives when using the tool with a similar cut-off in Nepal. The cut-off score recommended in our study (11 or more) is consistent with a study conducted in Chile. As with the systematic review findings, the specificity reported in our study (0.71) was much lower than that of the Chilean study (0.83) (Borghero et al. [2]). Similarly, a cut-off score of 11 with a sensitivity of 89.5 and specificity of 77.5 has been recommended for adolescents in the USA (Richardson et al. [30]), while a cut-off score of 9 with a sensitivity of 89.0% and specificity of 70.0% has been recommended for Swahili-speaking adolescents in Kenya, with the caveat that those authors also called for caution because of the high false positive rates (Tele et al. [37]). In Mozambique, a cut-off score of 8 with a sensitivity of 0.78 and specificity of 0.80 has been used for adolescents (Lovero et al. [22]).

The GAD-7 showed strong internal consistency with a Cronbach’s alpha of 0.907. It has acceptable sensitivity (0.83) but only poor specificity (0.61) for a cut-off score of 7. Despite performing less optimally compared to the PHQ-A, the item analysis of all GAD-7 items demonstrated individual item discriminant ability to differentiate adolescents with generalized anxiety disorder from those without any diagnosis. However, due to limited data on the validation of the GAD-7 among adolescents, comparisons are restricted. Our results are similar to a validation study conducted in South Africa, where a cut-off score of 6 or more was recommended with a sensitivity of 0.75 and specificity of 0.67, also noting high false positive rates in that study (Marlow et al. [23]).

The results of this study could have several implications for accurately collecting data on the prevalence of depression and anxiety among adolescents in Nepal. First, the PHQ-A and GAD-7 were translated and adapted using a systematic process involving mental health experts and adolescents themselves. These tools use context-specific and non-stigmatized language, which may help participants share their problems and experiences more openly. Second, the study also recommended different cut-off scores for older/younger adolescents and boys/girls, which could improve the accuracy and reliability of the data for different sub-groups. Additionally, the results indicated that both PHQ-A and GAD-7 have high false positive rates and low PPV, so caution should be used when interpreting the results for reporting prevalence rates or for identifying adolescents to refer for interventions. To address this for future studies, we recommend adjusting identified rates by using the psychometric properties from this validation (as shown in Fig. 1 above). For clinical purposes and intervention studies, we strongly recommend conducting a clinical interview to confirm depression or anxiety before proceeding with an intervention given the low PPV.

The study has some limitations. The data collection for the validation study occurred from September 1, 2021, to December 21, 2021, during a period when some COVID-19 restrictions were still in effect. The results of the study may have been influenced by the ongoing pandemic and its stressors. Similarly, the participants in this study were recruited from schools and the outpatient department of the Kanti Children’s Hospital, so the study is lacking a community sample. Finally, as adolescents from certain language-speaking communities, such as Maithili, Bhojpuri, and Tharu, were underrepresented in the study, the findings may not accurately represent these caste/ethnic groups.

Conclusion

The study addressed the current lack of systematically translated, adapted, and validated tools for measuring adolescent depression and anxiety in Nepal. The results showed that both the PHQ-A and GAD-7 are reliable tools for detecting and screening depression and anxiety among adolescents. Moreover, the approach to estimate true prevalence rate in the population can help policymakers and planners allocate resources to address mental health issues in this population.

Data availability

Interested parties may notify the investigators of their interest in collaboration, including access to the data-set analyzed here, through the following email: luitelnp@gmail.com.

Abbreviations

AUC:

Area under the curve

CI:

Cognitive interviews

CIDT:

Community informant detection tool

DSM-5:

Diagnostic and Statistical Manual of Mental Disorders

FGD:

Focus group discussion

GAD-7:

Generalized anxiety disorder

K-SADS:

Kiddie Schedule for Affective Disorders and Schizophrenia

LMIC:

Low and Middle Income Countries

MMAPP:

Measuring mental health among adolescents and young people at the population level

NPV:

Negative predictive value

PHQ-A:

Patient Health Questionnaire adapted for adolescents

PPV:

Positive predictive value

UNICEF:

United Nations Children’s Fund

References

  1. American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental Disorders, DSM-5 (Vol. 17).

  2. Borghero F, Martínez V, Zitko P, Vöhringer PA, Cavada G, Rojas G. [Screening depressive episodes in adolescents. Validation of the Patient Health Questionnaire-9 (PHQ-9)]. Rev Med Chil. 2018;146(4):479–86. https://doi.org/10.4067/s0034-98872018000400479.

    Article  PubMed  Google Scholar 

  3. Carroll HA, Hook K, Perez OFR, Denckla C, Vince CC, Ghebrehiwet S, Henderson DC. Establishing reliability and validity for mental health screening instruments in resource-constrained settings: systematic review of the PHQ-9 and key recommendations. Psychiatry Res. 2020;291:113236. https://doi.org/10.1016/j.psychres.2020.113236.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Carvajal-Velez L, Ahs JW, Requejo JH, Kieling C, Lundin A, Kumar M, Kohrt BA. Measurement of Mental Health among adolescents at the Population Level: a Multicountry Protocol for Adaptation and Validation of Mental Health Measures. J Adolesc Health. 2023;72(1s):S27–33. https://doi.org/10.1016/j.jadohealth.2021.11.035.

    Article  PubMed  Google Scholar 

  5. Central Bureau of Statistics. Population Monograph of Nepal-Population dynamics. Volume I. Kathmandu: Government of Nepal; 2014.

    Google Scholar 

  6. Cleary M, Raeburn T, Escott P, West S, Lopez V. Walking the tightrope’: the role of peer support workers in facilitating consumers’ participation in decision-making. Int J Ment Health Nurs. 2018;27(4):1266–72. https://doi.org/10.1111/inm.12474.

    Article  PubMed  Google Scholar 

  7. Dangal MR, Bajracharya LS. Students anxiety experiences during COVID-19 in Nepal. Kathmandu Univ Med J (KUMJ). 2020;18(70):53–7.

    Article  PubMed  Google Scholar 

  8. Dhimal M, Dahal S, Adhikari K, Koirala P, Bista B, Luitel N, Jha AK. A Nationwide Prevalence of Common Mental disorders and Suicidality in Nepal: evidence from National Mental Health Survey, 2019–2020. J Nepal Health Res Counc. 2022;19(4):740–7. https://doi.org/10.33314/jnhrc.v19i04.4017.

    Article  PubMed  Google Scholar 

  9. Gautam P, Dahal M, Ghimire H, Chapagain S, Baral K, Acharya R, Neupane A. Depression among adolescents of Rural Nepal: A Community-based study. Depress Res Treat. 2021;2021:7495141. https://doi.org/10.1155/2021/7495141.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Hayes J, Carvajal-Velez L, Hijazi Z, Ahs JW, Doraiswamy PM, Azzouzi E, Wolpert FA, M. You can’t manage what you do not measure - why adolescent Mental Health monitoring matters. J Adolesc Health. 2023;72(1s):S7–8. https://doi.org/10.1016/j.jadohealth.2021.04.024.

    Article  PubMed  Google Scholar 

  11. IBM Corp. IBM SPSS statistics for Windows, Version 28.0. Armonk, NY: IBM Corp; 2021.

    Google Scholar 

  12. Institute of Health Metrics (IHME). (2021). Global Burden of Disease Collaborative Network. Global Burden of Disease Study 2019 (GBD 2019). Seattle, United States of America.

  13. Jordans MJD, Kohrt BA, Luitel NP, Lund C, Komproe IH. Proactive community case-finding to facilitate treatment seeking for mental disorders, Nepal. Bull World Health Organ. 2017;95(7):531–6. https://doi.org/10.2471/blt.16.189282.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Karki A, Thapa B, Pradhan PMS, Basel P. Depression, anxiety and stress among high school students: a cross-sectional study in an urban municipality of Kathmandu, Nepal. PLOS Glob Public Health. 2022;2(5):e0000516. https://doi.org/10.1371/journal.pgph.0000516.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Kaufman J, Boris B, David A, Francheska P, David B, Neal R. "K-SADS-PL DSM-5." Pittsburgh: Western Psychiatric Institute and Clinic; Child and Adolescent Research and Care Program, Yale University. 2016. https://doi.org/10.1097/00004583-199707000-00021.

    Article  Google Scholar 

  16. Kessler RC, Angermeyer M, Anthony JC, Demyttenaere RDEG, Gasquet K, Ustün I, T. B. Lifetime prevalence and age-of-onset distributions of mental disorders in the World Health Organization’s World Mental Health Survey Initiative. World Psychiatry. 2007;6(3):168–76.

    PubMed  PubMed Central  Google Scholar 

  17. Kohrt BA, Harper I. Navigating diagnoses: understanding mind–body relations, Mental Health, and Stigma in Nepal. Cult Med Psychiatry. 2008;32(4):462–91. https://doi.org/10.1007/s11013-008-9110-6.

    Article  PubMed  Google Scholar 

  18. Kohrt BA, Kaiser BN. Measuring mental health in humanitarian crises: a practitioner’s guide to validity. Confl Health. 2021;15(1):72. https://doi.org/10.1186/s13031-021-00408-y.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Kohrt BA, Jordans MJ, Tol WA, Luitel NP, Maharjan SM, Upadhaya N. Validation of cross-cultural child mental health and psychosocial research instruments: adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal. BMC Psychiatry. 2011;11(1):127. https://doi.org/10.1186/1471-244x-11-127.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Kohrt BA, Luitel NP, Acharya P, Jordans MJD. Detection of depression in low resource settings: validation of the Patient Health Questionnaire (PHQ-9) and cultural concepts of distress in Nepal. BMC Psychiatry. 2016;16(1):58.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Levis B, Benedetti A, Thombs BD. Accuracy of Patient Health Questionnaire-9 (PHQ-9) for screening to detect major depression: individual participant data meta-analysis. BMJ. 2019;365:l1476. https://doi.org/10.1136/bmj.l1476.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Lovero KL, Adam SE, Bila CE, Canda ED, Fernandes ME, Rodrigues TIB, Wainberg ML. Validation of brief screening instruments for internalizing and externalizing disorders in Mozambican adolescents. BMC Psychiatry. 2022;22(1):549. https://doi.org/10.1186/s12888-022-04189-3.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Marlow M, Skeen S, Grieve CM, Carvajal-Velez L, Åhs JW, Kohrt BA, Tomlinson M. Detecting depression and anxiety among adolescents in South Africa: validity of the isiXhosa Patient Health Questionnaire-9 and generalized anxiety Disorder-7. J Adolesc Health. 2023;72(1s):S52–60. https://doi.org/10.1016/j.jadohealth.2022.09.013.

    Article  PubMed  Google Scholar 

  24. McGorry PD, Mei C. Early intervention in youth mental health: progress and future directions. Evid Based Ment Health. 2018;21(4):182–4. https://doi.org/10.1136/ebmental-2018-300060.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Ministry of Education Science and Technology. (2020). (2020) Flash I REPORT 2077 (2020-021). Available at: https://cehrd.gov.np/file_data/mediacenter_files/media_file-17-1312592262.pdf(Accessed: 30 April 2023). Kathmandu, Nepal: Government of Nepal.

  26. Mughal AY, Devadas J, Ardman E, Levis B, Go VF, Gaynes BN. A systematic review of validated screening tools for anxiety disorders and PTSD in low to middle income countries. BMC Psychiatry. 2020;20(1):338. https://doi.org/10.1186/s12888-020-02753-3.

    Article  PubMed  PubMed Central  Google Scholar 

  27. National Statistics Office. (2023). National Population and Housing Census 2021 (Acced through https:http://censusnepal.cbs.gov.np/results/literacy on 30 April 2023). Kathmandu, Nepal: Government of Nepal, Office of the Prime Minister and Council of Ministers.

  28. Ojha SP, Ma J, Chapagain M, Tulachan P. Emotional and behavioural problems among sheltered homeless children. JNMA J Nepal Med Assoc. 2013;52(191):457–61.

    PubMed  Google Scholar 

  29. Paudel S, Gautam H, Adhikari C, Yadav DK. Depression, anxiety and stress among the undergraduate students of Pokhara Metropolitan, Nepal. J Nepal Health Res Counc. 2020;18(1):27–34. https://doi.org/10.33314/jnhrc.v18i1.2189.

    Article  PubMed  Google Scholar 

  30. Richardson LP, McCauley E, Grossman DC, McCarty CA, Richards J, Russo JE, Katon W. Evaluation of the Patient Health Questionnaire-9 item for detecting major depression among adolescents. Pediatrics. 2010;126(6):1117–23. https://doi.org/10.1542/peds.2010-0852.

    Article  PubMed  Google Scholar 

  31. Rimal H, Pokharel A. Prevalence of attention deficit hyperactivity disorder among School Children and Associated Co-morbidities - A Hospital based descriptive study. Kathmandu Univ Med J (KUMJ). 2016;14(55):226–30.

    CAS  PubMed  Google Scholar 

  32. Risal A, Sharma PP. Psychiatric illness in the paediatric population presenting to a psychiatry clinic in a tertiary care centre. Kathmandu Univ Med J (KUMJ). 2010;8(32):375–3981. https://doi.org/10.3126/kumj.v8i4.6235.

    Article  CAS  PubMed  Google Scholar 

  33. Sharma V, Levin BL, Rahill GJ, Baldwin JA, Luitel A, Marhefka SL. Post-earthquake self-reported depressive symptoms and post-traumatic stress disorder and their correlates among College-youths in Kathmandu, Nepal. Psychiatr Q. 2021;92(4):1595–609. https://doi.org/10.1007/s11126-021-09928-5.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Silwal S, Dybdahl R, Chudal R, Sourander A, Lien L. Psychiatric symptoms experienced by adolescents in Nepal following the 2015 earthquakes. J Affect Disord. 2018;234:239–46. https://doi.org/10.1016/j.jad.2018.03.002.

    Article  PubMed  Google Scholar 

  35. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7. https://doi.org/10.1001/archinte.166.10.1092.

    Article  PubMed  Google Scholar 

  36. Steel Z, Chey T, Silove D, Marnane C, Bryant RA, van Ommeren M. Association of torture and other potentially traumatic events with mental health outcomes among populations exposed to mass conflict and displacement: a systematic review and meta-analysis. JAMA. 2009;302(5):537–49. https://doi.org/10.1001/jama.2009.1132.

    Article  CAS  PubMed  Google Scholar 

  37. Tele AK, Carvajal-Velez L, Nyongesa V, Ahs JW, Mwaniga S, Kathono J, Kumar M. Validation of the English and Swahili Adaptation of the Patient Health Questionnaire-9 for Use among adolescents in Kenya. J Adolesc Health. 2023;72(1s):S61–70. https://doi.org/10.1016/j.jadohealth.2022.10.003.

    Article  PubMed  Google Scholar 

  38. van Ommeren M, Sharma B, Thapa SB, Makaju R, Prasain D, Bhattarai R, de Jong J. Preparing instruments for Transcultural Research: Use of the translation monitoring form with Nepali-speaking Bhutanese refugees. Transcult Psychiatry. 1999;36(3):285–301. https://doi.org/10.1177/136346159903600304.

    Article  Google Scholar 

  39. World Health Organization. (2023). Suicide. Retrieved 24 December 2023, from https://www.who.int/news-room/fact-sheets/detail/suicide.

Download references

Acknowledgements

We want to thank Ms. Janaki Giri for her support in data collection. We also want to thank Dr. Budhi Setiawan, Chief, Health Section and Health Officer, Mr. Ghanshyam Kandel, from UNICEF Nepal office for their support. The authors alone are responsible for the views expressed in this article and they do not necessarily represent the views, decisions or policies of the institutions with which they are affiliated. NPL is supported by National Institute for Health Research (NIHR) and Wellcome Trust under the NIHR-Wellcome Partnership for Global Health Research [grant reference 222001/Z/20/Z].

Funding

Open access funding provided by Karolinska Institute. This work was supported, in whole or in part, by the Bill & Melinda Gates Foundation (INV-001395 provided to UNICEF HQ in 2017–2018). The work was also supported by the UK Medical Research Council, the National Institute for Health Research, and the Department for International Development (grant reference: MR/R020434/1). The funders had no role in study design, data collection and analysis, and decision to publish or prepare the manuscript. The authors had full control of all primary data.

Author information

Authors and Affiliations

Authors

Contributions

NPL, KRC, LCV, JWA, and BAK were responsible for conceptualization and design of the study. NPL, DR, KG and BAK were responsible for supervision of data collection. ND, JMC, SR, BG were responsible for administering K-SADS. SN was responsible for administering PHQ-A and GAD-7. NPL, DR, GE, BAK performed data analysis. NPL drafted the first version of the manuscript; all authors reviewed and revised the manuscript. BAK also provided clinical psychologists a TOT on administration of K-SADS. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Nagendra P. Luitel.

Ethics declarations

Ethics approval and consent to participate

The study received ethical approval from the Nepal Health Research Council, (ref: 105/2021 P) and the Kanti Children’s Hospital (ref: 58/2021). A written consent was obtained from each study participant and their legal parents before enrollment. Only those who voluntarily agreed to participate were included. Participants were informed of their right to refuse participation and to leave the interview at any time.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Luitel, N.P., Rimal, D., Eleftheriou, G. et al. Translation, cultural adaptation and validation of Patient Health Questionnaire and generalized anxiety disorder among adolescents in Nepal. Child Adolesc Psychiatry Ment Health 18, 74 (2024). https://doi.org/10.1186/s13034-024-00763-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13034-024-00763-7

Keywords