Validation of the Arab Youth Mental Health scale as a screening tool for depression/anxiety in Lebanese children
© Mahfoud et al; licensee BioMed Central Ltd. 2011
Received: 27 October 2010
Accepted: 24 March 2011
Published: 24 March 2011
Early detection of common mental disorders, such as depression and anxiety, among children and adolescents requires the use of validated, culturally sensitive, and developmentally appropriate screening instruments. The Arab region has a high proportion of youth, yet Arabic-language screening instruments for mental disorders among this age group are virtually absent.
We carried out construct and clinical validation on the recently-developed Arab Youth Mental Health (AYMH) scale as a screening tool for depression/anxiety. The scale was administered with 10-14 year old children attending a social service center in Beirut, Lebanon (N = 153). The clinical assessment was conducted by a child and adolescent clinical psychiatrist employing the DSM IV criteria. We tested the scale's sensitivity, specificity, and internal consistency.
Scale scores were generally significantly associated with how participants responded to standard questions on health, mental health, and happiness, indicating good construct validity. The results revealed that the scale exhibited good internal consistency (Cronbach's alpha = 0.86) and specificity (79%). However, it exhibited moderate sensitivity for girls (71%) and poor sensitivity for boys (50%).
The AYMH scale is useful as a screening tool for general mental health states and a valid screening instrument for common mental disorders among girls. It is not a valid instrument for detecting depression and anxiety among boys in an Arab culture.
Poor mental health in childhood and adolescence is a prevalent global public health challenge and accounts for a significant proportion of the disease burden and disability among young age groups worldwide [1, 2]. Depression and anxiety are two common mental disorders (CMDs) , that have their onset in childhood or adolescence. As they are associated with a host of co-morbidities that carry into adulthood [4, 5], early detection and adequate treatment of these disorders are pressing public health needs . Yet, only a small proportion of children and adolescents with mental health conditions in general, and depression and anxiety specifically, are diagnosed in clinical settings and receive treatment [7, 8]. More efforts are clearly needed to develop a community-based approach to detection and follow-up of CMDs . This requires the development and validation of screening instruments that can be used as a first step in diagnosis.
Careful considerations should be given to measurement instruments that are both developmentally- and culturally-appropriate. Researchers and practitioners cannot assume that instruments developed for adult populations would capture the phenomena of depression and anxiety among young age groups. As such, a few of the most widely used screening instruments - such as the Center for Epidemiologic Studies Depression Scale, CES-D , and the General Health Questionnaire, GHQ-12  - have been validated for use with children and adolescents. In addition to ensuring that a measurement tool is developmentally sound, the different ways in which CMDs are expressed cross-culturally should be taken into account . Since conceptions of health and illness in general vary between cultural and linguistic groups, developing new instruments or adapting already existing ones for use in non-Western and non-English speaking countries is warranted.
The Arab countries in the Middle East and North Africa Region (MENA) have one of the largest proportions of youth compared to other world regions . In 2005, around 21% of the total population in 19 Arab countries was comprised of those aged 15-24 years old. Countries in the MENA exhibit many of the factors that contribute to increased poor mental health among children and adolescents - namely political conflict and the rise of social disconnectedness with the expansion of low-income urban settings. Mental health services in urban centers are limited, of high cost, and unequally distributed . Further, poverty and political conflict increase young people's exposure to negative major life events , which have been shown to increase the risk of mental distress and depression [15, 16].
Research to explore the prevalence of CMDs among youth in the MENA and its associated burden is slowly gaining momentum. A review of mental health publications in the Arab world revealed that, between 1987 and 2002, there was an increase in mental health research in general and among children and adolescents specifically . For example, whereas only one research study on the mental health of children and adolescents was published in 1991, a total of 12 were published in 2001. Recent evidence from Lebanon suggests the existence of high prevalence of mental disorders among the adult population coupled with an unmet need for detection and treatment [15, 18]. Knowledge on the prevalence and burden of CMDs among children and adolescents in Lebanon is limited, highlighting the need for more community-based detection efforts that employ developmentally and culturally appropriate measurement instruments.
A review of mental health research in Arab countries  highlighted that most published studies were epidemiological and only a small proportion (8.6 percent of studies on children and adolescents) were psychometric in nature, i.e., designed to test the properties of a measurement instrument. The number of validated Arabic-language instruments to detect CMDs in adults as well as children and adolescents is very small. Only a few of the widely-used mental health scales have been adapted, translated, and validated for use with Arabic-speaking adults or children, such as the Edinburgh Postnatal Depression Scale , the TEMPS-A scale , and the Strengths and Difficulties Questionnaire, SDQ . To our knowledge, only the SDQ was validated in Arabic among a youth population.
In this paper, we examined the validity and psychometric properties of the Arab Youth Mental Health (AYMH) scale as a screening tool for CMDs among Arabic-speaking youth. The AYMH scale was developed as part of a large community-based participatory intervention to improve the mental health of 10-14 year old children in a disadvantaged urban community in Beirut, Lebanon. Because ninth grade (age 14) was deemed by community partners as a critical period for youth, the intervention was planned to be administered prior to that age. As such, the evaluation instrument for the intervention, the AYMH scale, was developed to screen for CMDs among 10-14 year old children. The primary objectives of this paper were: 1) to examine the psychometric properties of the AYMH scale and 2) to validate the scale against a diagnostic assessment of depression and anxiety. The construct and clinical validation of the scale were carried out among 10-14 year old youth in Beirut, Lebanon.
Ethical approval for the study was obtained from the American University of Beirut's Institutional Review Board. The study protocol involved obtaining written consent from one of the parents of the child and a verbal assent from the child himself or herself. Recruitment was carried out by three trained social workers from a local Ministry of Social Affairs (MOSA) center through home visits. Participants who were determined to be in need of psychological counseling were referred to the American University Hospital child psychology clinic for up to 10 free visits.
The sample consisted of 153 children between 10 and 14 years of age who were recruited through a convenience sampling strategy. The sampling frame consisted of all households with 10-14 year old children in a socioeconomically disadvantaged neighborhood serviced by the MOSA center. Inclusion criteria were any 10-14 year old child who was enrolled in school at the time of the study and who did not have any physical illness or disability. In cases where there was a child in the household who fit the inclusion criteria, a trained social worker explained to one or both parents the purpose of the study and sought their consent. To increase the sample size, social workers also recruited children who came to the MOSA center seeking a service from one of its social programs. In all cases, parents were informed that the study was carried out by university researchers and that a decision not to participate would in no way affect their ability to access services through the center.
Screening Instrument and Diagnostic Assessment
The screening instrument for depression/anxiety consisted of the recently-developed AYMH scale in addition to a few demographic and wellbeing questions. The process of developing the scale for use in a community-based participatory intervention study has been described in detail in a recently published article . In brief, the process of constructing the scale began with translating and reviewing a total of 14 English-language mental health measurement instruments that focus on CMDs and that have been previously used with youth. After soliciting community and professional opinion, researchers selected three for further consideration - the CES-D, the Hopkins Symptom Checklist, and the SDQ.
Focus group discussions were carried out with youth to test whether the mental health constructs in selected instruments were comprehensible and linguistically and culturally meaningful. Based on focus group results, researchers further examined and modified some constructs in the scales. To give a few examples, the researchers included items in the new scale that linguistically distinguish between feeling upset versus sad; added a new construct - feeling suffocated - because this expression was frequently invoked by youth during focus groups to express frustration; and changed the response options to include in addition to words a "star system," whereby a higher number of stars meant increasing intensity of experiencing a particular feeling. Based on this iterative process, the final scale was generated (see appendix 1).
It is worth noting that the scale was named an Arab Youth Mental Health scale, and not an anxiety/depression scale, to reflect the language employed by researchers and community members involved during the process of constructing it and throughout designing and implementing the intervention. The terms depression, anxiety, and disorder in Arabic, both linguistically and culturally, connote stigmatizing medical conditions. As such, the intervention was presented to community members, parents, and children as one designed to improve the mental health of children in general, so as not to imply erroneously that those who participate are admitting to having a mental disorder.
Data for the screening instrument were collected from children through an interviewer-administered structured questionnaire. This data collection step was carried out by a research assistant with a BA in psychology and in a private room in the MOSA center without interference from the child's parent or the psychiatrist. All items in the scale had a one-week recall period and were scored on a three-point Likert scale - rarely (one star), sometimes (two stars), and always (three stars). The range for the scale was 21 to 63, with a higher score indicative of poorer mental health. In addition to the scale items, the screening instrument collected data on age in five categories (9 &10, 11, 12, 13, 14 years old) and gender. It also included the self-rated health and self-rated mental health questions, both measured on a 5-point Likert scale (very good, good, fair, poor, very poor); due to sample size considerations, both variables were dichotomized in the analysis into very good, good, and fair versus poor and very poor. Finally, the instrument included a question on happiness (very happy, a little bit happy, not happy), worrying about the future (agree, not sure, disagree), and a question about enjoying life (agree, not sure, disagree).
For the diagnostic assessment, a child and adolescent psychiatrist who was blinded to the results of the screening instrument conducted individual clinical interviews with each child participant, with at least one of his/her parents separately, and with both child and parent together to corroborate information. The presence and intensity of distressing signs and symptoms were evaluated and the Diagnostic and Statistical Manual of Mental Disorders, DSM-IV, criteria were employed to diagnose mental disorders. A symptom checklist covering all diagnostic categories was filled out, followed by an assessment of internalizing disorders using the Schedule for Affective Disorders and Schizophrenia (K-SADS) semi-structured questionnaire. In cases where there was suspicion of a disorder, the supplement for that disorder was filled out. The diagnostic interview also included ten minutes of unstructured assessment to evaluate the child's general wellbeing, school and family environment, stress, and trauma. A profile of each child was established along the five DSM-IV axes. All children diagnosed with a major depressive disorder, dysthymia, depressive disorder, or adjustment disorder with depressive mood were referred for psychiatric counseling. Similarly, all major anxiety disorders were considered positive diagnosis and the child was referred for psychiatric counseling. Given the AYMH scale's focus on CMDs, a diagnostic assessment of anxiety or depression by the psychiatrist was used as the standard reference to evaluate the specificity and sensitivity of the screening instrument.
Summary statistics using frequency distribution were used to describe the sample. Due to the small sample size in the youngest age group (n = 9), the 9- and 10-year old children were grouped into one category. The association between the scores on the mental health scale and other variables included in the instrument were evaluated using the t-test (for gender and psychiatric diagnoses of anxiety and depression) and one way analysis of variance (ANOVA) for associations with happiness, self-rated health, self-rated mental health, worrying about the future, and enjoying life, along with the Bonferroni's method for pair-wise comparisons when needed. We used Levene's test to check the equality of variance assumption.
Internal consistency of the scale was evaluated using Cronbach's alpha. As for validity analysis, the diagnostic assessment of depression and anxiety by the psychiatrist was used as standard reference. The Receiver Operator Curve method was used to determine the best cut-off for the scale, one that produced the best balance between sensitivity and specificity and the best agreement with the diagnostic assessment measured using the kappa statistic. All analyses were carried out for the total sample and for girls and boys separately using the Statistical Package for Social Sciences (SPSS, version 16, Chicago, USA). Significance levels were set at the 5% level.
Comparisons of mean scores of AYMH scale by different variables
A little bit
Self-rated mental health
Worried/afraid about future
Not enjoying life
Validity, sensitivity and specificity of the AYMH scale against clinical assessment for depression and anxiety
Area under ROC
Best cut-off value
Diagnosed AYMH mean score
Not diagnosed AYMH mean score
Anxiety and depression are two of the most common mental disorders that often begin in childhood and adolescence. The detection and treatment of these two conditions in early developmental phases is imperative in a region that has a large proportion of youth and many of the factors that contribute to the onset of mental disorders. The main goal of the present validation was to contribute to the development of linguistically- and culturally-appropriate instruments for use in the early detection of CMDs in general, and anxiety and depression specifically, among Arab children and adolescents in the MENA region.
The validation revealed that the AYMH scale has reasonably good construct validity and internal consistency. However, the scale has moderate discriminatory capabilities as a diagnostic tool for depression and anxiety. Compared to a psychiatric assessment, the AYMH scale has low sensitivity and is a weak instrument to use as a diagnostic screening tool for depression and anxiety, especially among boys. The scale's ability to detect depression and anxiety is moderate for girls (70% sensitivity) and poor for boys (i.e., half of all boys diagnosed with depression or anxiety through a clinical psychiatric assessment were missed by the scale). By comparison, the SDQ showed better discriminating capabilities for psychiatric diagnoses when validated in Arabic , though it is important to note that the questionnaire was administered with the teachers and parents of children and not the children themselves.
The difference in diagnostic capability of the AYMH scale by gender deserves discussion. Research has consistently reported a higher prevalence of depression in women [23, 24]. Findings of the studies we reviewed from the Arab region are consistent with those from international studies, showing that women and adolescent girls exhibit poorer mental health in general compared to men and adolescent boys, respectively [20, 25]. In contrast, girls in the present validation did not significantly score higher than boys on the AYMH scale. Yet, the scale was moderately sensitive in detecting depression and anxiety for girls but not sensitive for boys. A potential explanation for this finding may lie in the nature of the items that make up the scale, namely that items may be biased towards detecting depression and anxiety among girls but not boys in an Arab culture. This corroborates with the body of literature which suggests that there is a "masculine" form of depression that is under-detected because it manifests through aggression and anger . With respect to the AYMH scale, only one out of 21 items can be said to capture a form of aggressive behavior which captures a masculine expression of depression (item 15: fighting for no particular reason). Despite the rigorous process through which the scale was constructed, its inability to capture gendered feelings and behaviors indicative of CMDs meant that it missed half of the boys who were diagnosed with depression or anxiety by an experienced child and adolescent psychiatrist. In the future, we suggest that research focus on exploring gendered differences among Arab children and adolescents. With respect to the AYMH scale, we suggest incorporating items that capture externalizing behavior suggestive of mental disorders among boys.
Despite the poor sensitivity of the AYMH scale as a screening tool for depression and anxiety in boys, other robust psychometric properties of the scale merit its use as a screening tool for general mental health states in children and adolescents. Mean scores on the AYMH scale were associated with measures often employed to detect poor mental health states (such as single-item questions on happiness, self-rated health, and self-rated mental health). In general, adolescents who reported not being happy, being worried, and not enjoying life scored worse on the scale. Moreover, poor self-rated health (with the exception of the subsample of boys) and poor self-rated mental health were strongly associated with poor health. These findings and the good internal consistency of the scale suggest that the AYMH scale, though is not a good screening tool for depression and anxiety among boys, nonetheless measures mental health states and is a good tool to employ in community- and population-level screening efforts as a first step in detecting signs of CMDs among youth. The internal consistency of the scale is comparable to that observed for the CES-D scale (with a Cronbach's alpha of 0.82) when examined among American Indian adolescents .
It is important to acknowledge some of the limitations of the study. First, the sample was relatively small (153 children), which also meant that only a small number of children were diagnosed with depression and anxiety. Second, because participants were recruited through a social service center located in a disadvantaged community in Beirut, the validation findings may not be generalizable to Lebanese youth of different socioeconomic or regional backgrounds. Finally, the convenience sampling strategy might have biased our sample, whereby parents who felt a need for their child to undergo a mental health check up consented more than other parents and whereby compliant children agreed to participate more than others. Notwithstanding the limitations of the present validation and the low clinical validity of the AYMH scale among boys, we argue that the scale is still useful given its good internal psychometric characteristics. We recommend its use as a preliminary screening test for CMDs, with the important caveat to incorporate items on externalizing behavior in order for the scale to capture the gendered ways in which CMDs manifest among boys in an Arab culture.
Depression, anxiety, and mental states among Arab children and adolescents may be constructed and expressed differently than among youth in other cultures. With growing research interest in the MENA region to understand mental disorders and to measure their prevalence and risk factors, there is a clear need for more culturally adapted and validated scales for use among youth. The AYMH scale fills an important gap and addresses some of the limitations identified when examining some of the established instruments. The scale has gone through a rigorous process of development and is responsive to the context in which it was intended to be used. It uses simple language and specific terms which are commonly exchanged among Arab youth. We argue that even though the AYMH scale has limited use as a screening tool for depression and anxiety among boys, it has other positive attributes to justify its future use as a first step in screening for poor mental health states in 10-14 year old children.
Appendix 1: The Arab Youth Mental Health Scale
During the last week I was upset
During the last week I burst into tears several times
During the last week I was feeling scared and frightened
During the last week I felt suffocated
During the last week my sleep was interrupted because I was thinking of so many things
During the last week I was tense and nervous
During the last week I felt lonely
During the last week I was sad
During the last week I was worried
During the last week I was having difficulty concentrating on what I was doing
During the last week I felt dizzy/light headed
During the last week I didn't feel like talking
During the last week I was bored and I hated my life
During the last week I didn't have any hope for the future
During the last week I was fighting for no particular reason
During the last week I was bored and I had nothing to do
During the last week I was having thoughts of death
During the last week I was feeling emotionally drained
During the last week my heart was beating fast even without doing any type of sports
During the last week I was feeling fidgety and moving a lot. I couldn't sit still for a long time without any particular reason
During the last week, I was having a lot of headaches, stomach-aches, and nausea
This study was financially supported by a grant from the Wellcome Trust, UK. We thank the social workers from the community center for providing instrumental support in recruitment.
- Patel V, Flisher AJ, Hetrick S, McGorry P: Mental health of young people: A global public-health challenge. The Lancet. 2007, 369 (9569): 1302-1313. 10.1016/S0140-6736(07)60368-7.View ArticleGoogle Scholar
- WHO: The World Health Report 2001. Mental Health: New Understanding, New Hope. 2010, Retrieved April 23, [http://www.who.int/whr/2001/en/whr01_en.pdf]Google Scholar
- WHO: The ICD-10 Classification of Mental and Behavioral Disorders. 1992, Geneva: World Health OrganizationGoogle Scholar
- Pine DS, Cohen E, Cohen P, Brook J: Adolescent depressive symptoms as predictors of adult depression: Moodiness or mood disorder?. The American Journal of Psychiatry. 1999, 156 (1): 133-5.View ArticlePubMedGoogle Scholar
- Lewinsohn P, Hops H, Roberts RE, Seeley JR, Andrews JA: Adolescent psychopathology: I- Prevalence and incidence of depression and other DSM-III-R disorders in high school students. Journal of Abnormal and Social Psychology. 1993, 102 (1): 133-144. 10.1037/0021-843X.102.1.133.View ArticleGoogle Scholar
- Wang PS, Aguilar-Gaxiola S, Alonso J, Angermeyer CM, Borges G, Bromet JE, Bruffaerts R, De Girolamo G, De Graaf R, Gureje O, Haro JM, Karam GE, Kessler CR, Kovess V, Lane CM, Lee S, Levinson D, Ono Y, Petukhova M, ÅL Posada-Villa J, Seedat S, Wells JE: Use of mental health services for anxiety, mood, and substance disorders in 17 countries in the WHO world mental health surveys. The Lancet. 2007, 370 (9590): 841-850. 10.1016/S0140-6736(07)61414-7.View ArticleGoogle Scholar
- WHO: Mental health: facing the challenges, building solutions. Report from the WHO European Ministerial Conference. 2011, Retrieved April March 7, [http://www.knowandpol.eu/fileadmin/KaP/content/Scientific_reports/Orientation3/WHO.WP11.Production.pdf]Google Scholar
- Kataoka SH, Zhang L, Wells KB: Unmet Need for Mental Health Care Among U.S. Children: Variation by Ethnicity and Insurance Status. American Journal of Psychiatry. 2002, 159: 1548-1555. 10.1176/appi.ajp.159.9.1548.View ArticlePubMedGoogle Scholar
- Manson SM, Ackerson LM, Dick RW, Baron AE, Fleming CM: Depressive symptoms among American Indian adolescents: Psychometric characteristics of the Center for Epidemiologic Studies Depression scale (CES-D). Psychological Assessment: A Journal of Consulting and Clinical Psychology. 1990, 2 (3): 231-237.View ArticleGoogle Scholar
- Tait RJ, French DJ, Huse GK: Validity and psychometric properties of the General Health Questionnaire-12 in young Australian adolescents. Australian & New Zealand Journal of Psychiatry. 2003, 37 (3): 374-381.View ArticleGoogle Scholar
- Guillemin F, Bombardier C, Beaton D: Cross-Cultural Adaptation of Health-Related Quality of Life Measures: Literature Review and Proposed Guidelines. Journal of Clinical Epidemiology. 1993, 46 (12): 1417-1432. 10.1016/0895-4356(93)90142-N.View ArticlePubMedGoogle Scholar
- Assaad R, Roudi-Fahimi F: Youth in the Middle East and North Africa: Demographic opportunity or challenge? Population Reference Bureau. 2010, Retrieved April 23, [http://www.prb.org/pdf07/youthinMENA.pdf]Google Scholar
- Saxena S, Thornicroft G, Knapp M, Whiteford H: Resources for mental health: Scarcity, inequity, and inefficiency. Lancet. 2007, 370 (9590): 878-89. 10.1016/S0140-6736(07)61239-2.View ArticlePubMedGoogle Scholar
- Patel V, Kleinman A: Poverty and Common Mental Disorders in Developing Countries. Bulletin of the World Health Organization. 2003, 81 (8): 609-615.PubMed CentralPubMedGoogle Scholar
- Karam EG, Mneimneh ZN, Dimassi H, Fayyad JA, Karam AN, Nasser SC, Chatterji S, Kessler RC: Lifetime prevalence of mental disorders in Lebanon: First onset, treatment, and exposure to war. PLoS Medicine. 2008, 5 (4): e61-10.1371/journal.pmed.0050061.PubMed CentralView ArticlePubMedGoogle Scholar
- Thoits PA: Dimensions of life events that influence psychological distress: An evaluation and synthesis of the literature. Psychosocial stress: Trends in Theory and Research. Edited by: Kaplan HB. 1983, New York: Academic PressGoogle Scholar
- Afifi MM: Mental health publications from the Arab world cited in PubMed, 1987-2002. Mental Health. 2005, 11 (3): 319-328.Google Scholar
- Karam EG, Mneimneh ZN, Karam AN, Fayyad JA, Nasser SC, Chatterji S, Kessler RC: Prevalence and treatment of mental disorders in Lebanon: A national epidemiological survey. The Lancet. 2006, 367 (9515): 1000-1006. 10.1016/S0140-6736(06)68427-4.View ArticleGoogle Scholar
- Ghubash R, Abou-Saleh MT, Daradkeh TK: The validity of the Arabic Edinburgh postnatal depression scale. Social Psychiatry and Psychiatric Epidemiology. 1997, 32: 474-476.PubMedGoogle Scholar
- Karam EG, Mneimneh Z, Salamoun M, Akiskal KK, Akiskal HS: Psychometric properties of the Lebanese-Arabic TEMPS-A: A national epidemiologic study. Journal of Affective Disorders. 2005, 87 (2-3): 169-183. 10.1016/j.jad.2005.02.010.View ArticlePubMedGoogle Scholar
- Alyahri A, Goodman R: Validation of the Arabic Strengths and Difficulties Questionnaire and the development and well-being assessment. Eastern Mediterranean Health Journal. 2006, 12 (Supplement Number 2): S138-S146.PubMedGoogle Scholar
- Makhoul J, Nakkash RT, El Hajj T, Abdulrahim S, Kanj M, Mahfoud Z, Afifi RA: Development and Validation of the Arab Youth Mental Health Scale. Community Mental Health Journal. 2010Google Scholar
- Marcus SM, Young EA, Kerber KB, Kornstein S, Farabaugh AH, Mitchell J, Wisniewski SR, Balasubramani GK, Trivedi MH, Rush AJ: Gender differences in depression: Findings from the STAR*D study. Journal of Affective Disorders. 2005, 87 (2-3): 141-150. 10.1016/j.jad.2004.09.008.View ArticlePubMedGoogle Scholar
- Nolen-Hoeksema S, Girgus JS: The emergence of gender differences in depression during adolescence. Psychological Bulletin. 1994, 115 (3): 424-443. 10.1037/0033-2909.115.3.424.View ArticlePubMedGoogle Scholar
- Afifi M: Gender differences in mental health. Singapore Medical Journal. 2007, 48 (5): 395-391.Google Scholar
- Kilmartin C: Depression in men: Communication, diagnosis and therapy. Journal of Men's Health and Gender. 2005, 2 (1): 95-99.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.