School-based screening for psychiatric disorders in Moroccan-Dutch youth
Child and Adolescent Psychiatry and Mental Health volume 9, Article number: 13 (2015)
While ethnic diversity is increasing in many Western countries, access to youth mental health care is generally lower among ethnic minority youth compared to majority youth. It is unlikely that this is explained by a lower prevalence of psychiatric disorders in minority children. Effective screening methods to detect psychiatric disorders in ethnic minority youth are important to offer timely interventions.
School-based screening was carried out at primary and secondary schools in the Netherlands with the Strengths and Difficulties Questionnaire (SDQ) self report and teacher report. Additionally, internalizing and psychotic symptoms were assessed with the depressive, somatic and anxiety symptoms scales of the Social and Health Assessment (SAHA) and items derived from the Kiddie-Schedule for Affective Disorders and Schizophrenia (K-SADS). Of 361 Moroccan-Dutch youths (ages 9 to 16 years) with complete screening data, 152 children were diagnostically assessed for psychiatric disorders using the K-SADS. The ability to screen for any psychiatric disorder, and specific externalizing or internalizing disorders was estimated for the SDQ, as well as for the SAHA and K-SADS scales.
Twenty cases with a psychiatric disorder were identified (13.2 %), thirteen of which with externalizing (8.6 %) and seven with internalizing (4.6 %) diagnoses. The SDQ predicted psychiatric disorders in Moroccan-Dutch youth with a good degree of accuracy, especially when the self report and teacher report were combined (AUC = 0.86, 95 % CI = 0.77-0.94). The SAHA scales improved identification of internalizing disorders. Psychotic experiences significantly predicted psychiatric disorders, but did not have additional discriminatory power as compared to screening instruments measuring non-psychotic psychiatric symptoms.
School-based screening for psychiatric disorders is effective in Moroccan-Dutch youth. We suggest routine screening with the SDQ self report and teacher report at schools, supplemented by the SAHA measuring internalizing symptoms, and offering accessible non-stigmatizing interventions at school to children scoring high on screening questionnaires. Further research should estimate (subgroup-specific) norms and optimal cut-offs points in larger groups for use in school-based screening methods.
While ethnic diversity is increasing in many Western countries, access to youth mental health care is generally lower among ethnic minority youth compared to majority youth [1, 2]. It is unlikely that these lower treatment rates are explained by a lower prevalence of psychiatric disorders, as mental health problems are equally or more prevalent in minority youth as compared to majority youth [3, 4]. Therefore, detection of psychiatric disorders in ethnic minority communities is particularly important to offer timely interventions.
Schools may play an important role in the early detection of psychiatric disorders outside the mental health care system. If school-based screening for psychiatric disorders is effective among ethnic minority youth in Western societies, it might provide a pathway to care for ethnic minority youth and an opportunity to bridge the treatment gap observed in this group.
Since most screening instruments have been developed for Western populations and cross-cultural biases are likely to influence psychometric properties , it is not known how these questionnaires can be used in ethnic minority youth. It has been found that construct validity, that is the degree to which the instrument captures the construct to be measured, and factor structure of screening instruments differed between ethnic groups [6, 7]. Using specific questionnaires or underlying factor structures for each subgroup in society is practically unfeasible and undesirable. Instead, subgroup-specific norms may be required . This applies to self-report questionnaires because minority children may interpret questions differently or have different thresholds for reporting psychiatric symptoms, due to language or cultural differences. It also applies to teacher-report questionnaires, as ethnic biases of teachers may influence their ratings, in particular of children from groups with a low social status [9, 10]. As a result of potential cross-cultural biases in construct validity and norms, it is preferable to study the performance of screening instruments for each ethnic group separately.
The Strengths and Difficulties Questionnaire (SDQ)  is a questionnaire that is frequently used to screen for psychiatric disorders in children. The ability of the SDQ to detect psychiatric disorders has been shown in community and clinical samples of youth in multiple countries [e.g. 12–14], providing evidence for the applicability of the SDQ in different cultures. Less is known about the test characteristics of the SDQ in ethnic minority youth. In a systematic review on measurement properties of instruments measuring externalizing problems in ethnic minority youth, good internal consistency, content, structural and concurrent validity were found for the SDQ self-report version. For the SDQ teacher report the factor structure was similar in majority and minority groups, whereas norms were likely to be different across ethnic groups [15, 16]. A scoring rule based on the teacher-reported SDQ predicted externalizing disorders equally well in ethnic minority and majority youth in the Netherlands . However, the ability of the SDQ to detect internalizing psychiatric disorders in ethnic minority youth has not been investigated.
Studies report cultural variations in the presentation or symptom expression of internalizing disorders . Therefore, including a wide variety of items on internalizing symptoms may enhance identification of these problems in ethnic minorities. In addition, it has become clear that psychotic experiences in adolescence are important risk markers for severe psychopathology, whether psychotic or non-psychotic . Ethnic minorities have an increased risk for psychotic experiences in childhood [20, 21] and psychotic disorders in adulthood , suggesting that psychotic symptoms might be even more important signals of psychopathology in ethnic minority youth. The SDQ includes only five items on internalizing symptoms and no items on psychotic experiences. Therefore, it is clinically relevant to investigate the added value of other screening questionnaires, assessing internalizing and psychotic symptoms, when screening for psychiatric disorders in ethnic minority youth.
The present study was carried out among Moroccan-Dutch youth. In the Netherlands, Moroccan-Dutch youth is the largest ethnic minority population in its age group, has an increased risk to develop childhood psychiatric problems  or psychotic disorders in (young) adulthood , and is underrepresented in youth mental health care . In addition, Moroccan-Dutch often have a low social status and a relatively wide cultural gap to the majority group, which may increase ethnic and cultural bias in self reports and teacher reports of psychiatric problems .
The aim of this study was to examine if school-based screening for psychiatric disorders, using children and teachers as informants, is effective in Moroccan-Dutch youth. We examined the ability of the SDQ to predict any psychiatric disorder, and specific externalizing or internalizing disorders among Moroccan-Dutch youth. Since internalizing disorders are best detected by self-report measures  and externalizing disorders by teacher reports , both the self-report and teacher-report versions were used. To examine the added value of assessing internalizing and psychotic symptoms, we administered selected scales of the Social and Health Assessment (SAHA)  and items adapted for use in a self-report setting from the Kiddie Schedule for Affective Disorders and Schizophrenia (K-SADS) . For each screening instrument we examined the predictive value by comparing the scores on existing (sub)scales to diagnoses of psychiatric disorders.
The study had two phases, a screening part and a diagnostic part.
In the first phase of the study, schools with various educational levels in districts with small and large Moroccan-Dutch populations (range 1.9-9.2 %) were approached, in order to obtain a large sample of Moroccan-Dutch youth with various socio-economic backgrounds. Eight primary schools and ten secondary schools (78.2 %) participated. Children in years six to eight of primary schools (9–12 year olds) and years one to three of secondary schools (12–15 year olds) were included. The overall participation rate was 85.7 %. The total sample consisted of 1563 participants.
According to the ethnic classification of Statistics Netherlands, children were categorized as Moroccan-Dutch when they and one or both parents (first-generation migrants) or when one or both parents (second-generation migrants) were born in Morocco (n = 407).Footnote 1 In case of parents with two different foreign countries of birth, the mother’s country of birth was used to define the child’s ethnic group.
Teachers filled out a questionnaire on 88.7 % of the Moroccan-Dutch children and adolescents (n = 361, see section Measurements).
In the second phase of the study, a high-risk and a low-risk subgroup of the total Moroccan-Dutch screening sample were selected for in-depth psychiatric diagnostic assessment. Only youth with complete data (self report and teacher report) were eligible (n = 361). Cut-offs were calculated for children (9–12 year olds, n = 180) and adolescents (13–16 year olds, n = 181) separately. Cut-offs for high-risk and low-risk subgroup selection, were based on scores on nine (sub)scales measuring psychiatric problems: subscales emotional symptoms, conduct problems and hyperactivity of the SDQ self report, subscales conduct problems and hyperactivity of the SDQ teacher report , subscales of depressive, somatic and anxiety symptoms scales of the Social and Health Assessment (SAHA)  and eight items derived from the Kiddie-Schedule for Affective Disorders and Schizophrenia (K-SADS)  assessing psychotic experiences. Moroccan-Dutch youth scoring two standard deviations above the mean of their age category on at least one of the selected (sub)scales (screen positives, n = 105), and Moroccan-Dutch youth scoring below one standard deviation above the mean on all selected (sub)scales (screen negatives, n = 128) were selected for diagnostic evaluation. Of the 233 eligible Moroccan-Dutch youths, 65.2 % (n = 152) participated, 69 were screen positives and 83 were screen negatives. There were no significant differences in response rate between screen positive and screen negative groups (X2 = 0.019; df = 1; p = 0.89) or age groups (X2 = 0.201; df = 1; p = 0.65). The sampling procedure and response are presented in Fig. 1.
The ethics committee of the VU Medical Centre approved the study. In the screening phase (2009–2010), a letter of introduction and a description of the study were sent to children and parents at their home address in separate envelopes. Parents or primary caregivers additionally received a passive informed consent form, which they could sign and return when they did not want their child to participate. Children had the option to decline at the time the survey was administered. They completed the web-based survey during a regular school day. A trained research assistant introduced the study and at least two research assistants were available in the classroom to answer the children’s questions during administration. Teachers were not involved in the actual administration. For every child, the teacher filled out a paper version of the SDQ teacher report (see section Measurements). All instruments were administered in Dutch.
In the diagnostic phase (2010–2011), the selected Moroccan-Dutch youths and their parents received a letter in Dutch and Moroccan Arabic introducing the study. Parents or primary caregivers were asked to inform the researchers if they refused participation. The remaining families were visited at home in a face-to-face approach. We worked exclusively with female interviewers, because for some Moroccan-Dutch families it is more accepted to welcome unknown females than males into their homes. Additionally, each team consisted of at least one Moroccan-Dutch research assistant to have the option to inform families about the study in Dutch, Moroccan Arabic or a Berber (Tamazight) language. Written informed consent was obtained from all parents and children. Children were interviewed on psychiatric symptoms and impairment by medical doctors trained in transcultural psychiatry using the K-SADS (see section Measurements) during a separate appointment at school or at home. The average time between the screening and diagnostic phase was 13 months.
Children filled out questions on demographic characteristics, such as their gender, age, and child’s and parents’ country of birth. A measure of the socioeconomic status of the neighbourhood was obtained from the Netherlands Institute for Social Research . Reading skills were assessed in the diagnostic phase using the One-Minute Reading Task .
Screening instrument: Strengths and Difficulties Questionnaire (SDQ)
Children and teachers completed the self-report and teacher-report versions of the SDQ , consisting of five subscales: emotional symptoms, conduct problems, hyperactivity, peer problems and pro-social behaviour. Each subscale consists of five items on a three-point scale ranging from 0 (not true) to 2 (certainly true). A total difficulties score is generated by summing the scores on four subscales: emotional symptoms, conduct problems, hyperactivity and peer problems (range 0–40). In order to create an aggregated measure of the self report and teacher report, we added the self-report and teacher-report total difficulties scores. Cronbach’s alphas in the screening sample (n = 361) were good for the self report (α = 0.76), the teacher report (α = 0.87), as well as for the aggregated self report and teacher report (α = 0.87) total difficulties scores.
Comparisons of SDQ scores between Moroccan-Dutch youth and other ethnic groups are reported elsewhere .
Additional screening instruments
Social and Health Assessment (SAHA)
Children additionally completed selected scales of the SAHA . The SAHA has been used in ethnically diverse samples in multiple countries [e.g. 31–33]. The depressive symptoms scale consists of 15 items, with 11 negative (e.g. ‘I did not feel like eating’, and ‘I felt really down’) and four positive (e.g. ‘I enjoyed doing things’) statements. The somatic symptoms scale consists of 12 items representing somatic symptoms commonly reported by children and adolescents (e.g. ‘I felt my health should be better’, ‘I had aches or pains’, and ‘I often woke up early’). Children reported on the presence of depressive symptoms and somatic symptoms during the past month on a three-point scale (0 - not true, 1 - somewhat true, 2 - certainly true). The anxiety symptoms scale consists of 13 items (e.g. ‘I worry about what others think about me’, ‘I worry about what is going to happen in the future’, and ‘I stay away from things that make me nervous’). Children reported on the presence of anxiety symptoms on a three-point scale (0 - not true, 1 - sometimes true, 2 - certainly true). By summing the scores of the depressive, somatic and anxiety scales a total internalizing symptoms scale was computed. The Cronbach’s alpha of the total internalizing symptoms score in the screening sample (n = 361) was excellent (α = 0.90).
Kiddie-Schedule for Affective Disorders and Schizophrenia (K-SADS)
Eight items from the K-SADS , adapted for use in a self-report setting, were used to assess the presence of psychotic experiences. These items had high resemblance to items that were predictive of adult schizophreniform disorder . Six items assessed delusional experiences (e.g. ‘Have you ever believed that you were being sent special messages through television or radio?’, ‘Have you ever thought you were being followed or spied on?’, and ‘Have you ever believed that you are an important person or have special gifts other people do not have?’). Two items assessed hallucinatory experiences (‘Have you ever heard voices that other people could not hear?’, and ‘Have you ever seen things that other people could not see?’). Responses were made on a three-point scale: 0 – not true, 1 – yes, likely and 2 – yes, definitely and summed into a psychotic experiences score. The Cronbach’s alpha of the psychotic experiences score in the screening sample (n = 361) was good (α = 0.76).
Details on the prevalence of psychotic experiences among the Moroccan-Dutch screening sample compared to other ethnic groups have been reported elsewhere .
Outcome: DSM-IV diagnosis
Children were interviewed using the K-SADS , a semi-structured diagnostic interview to assess DSM-IV diagnoses. The interviewers were blind to screening status. For all 41 children and adolescents with decreased functioning in the past year, as operationalized by a score of 7 or lower on the Children’s Global Assessment Scale (C-GAS; included in the K-SADS) , summaries of the diagnostic interviews were discussed in consensus meetings of a child psychiatrist (among who TD), a psychiatrist (among who WV), one of the medical doctors who performed the interviews (MA) and a medical student who summarized the audiotapes. The committee, experienced in cross-cultural psychiatry, discussed to formulate one consensus diagnosis per child, based on the scores on the K-SADS, the summary of the audiotape and the clinical evaluation of the medical doctor who conducted the interview. The committee was blind to screening and diagnostic status. An acceptable level of agreement was achieved between the diagnoses made by the interviewers and the committee: the kappa coefficient was 0.76 . The outcome used for analyses was the presence of any, externalizing or internalizing psychiatric disorder according to the DSM-IV criteria, as diagnosed by the interviewers.
Analyses were performed using the Statistical Package for Social Sciences (SPSS), version 20.0. First, demographic characteristics, SDQ, SAHA and K-SADS psychotic experiences scores and numbers of psychiatric disorders in the screening and diagnostic sample were described. There were no significant differences in SDQ, SAHA and K-SADS psychotic experiences scores for migrant status or reading skills. Second, logistic regression analyses were performed to assess the ability of (sub)scales of the used screening instruments to predict a diagnosis of any, externalizing or internalizing psychiatric disorder. Third, Receiver-Operating Characteristic (ROC) analyses were run for the SDQ total difficulties (self report, teacher report and aggregated self report and teacher report), SAHA total internalizing symptoms and K-SADS psychotic experiences scores assessing the diagnostic performance to predict any psychiatric disorder, an externalizing disorder and an internalizing disorder. For all ROC curves the Area Under the Curve (AUC), the optimal cut-off point, based on the cut-off point extending the highest towards the upper left corner, sensitivity and specificity were determined. Finally, the prediction of the optimal cut-off point of the screening instrument with the highest AUC for any psychiatric disorder was shown in a cross-tabulation, with a range of test values. The added value of the SAHA and K-SADS psychotic experiences scales were calculated as well.
Demographic characteristics and SDQ, SAHA and K-SADS psychotic experiences scores of the Moroccan-Dutch screening and diagnostic sample are presented in Table 1. Boys and girls were represented equally. Most Moroccan-Dutch youths were second-generation migrants and more than half lived in neighbourhoods with a low socioeconomic status in both the screening and the diagnostic sample. A quarter of the children in the diagnostic phase was more than a year behind considering reading skills. The mean age of the screening sample was 12.5 years (SD ± 1.9). During the diagnostic phase of the study, participants were on average one year older (13.6 ± 1.9). SDQ, SAHA and K-SADS psychotic experiences scores and standard deviations were similar in the screening and diagnostic samples.
The prevalence of psychiatric disorders in the Moroccan-Dutch diagnostic sample was 13.2 % (Table 1). Twenty children (28 % of screen positives and 1 % of screen negatives) met the DSM-IV criteria for any psychiatric disorder. Attention-deficit hyperactivity disorder (n = 3, 2.0 %), oppositional defiant disorder (n = 5, 3.3 %) and conduct disorder (n = 5, 3.3 %) were categorized as externalizing disorders (n = 13, 8.6 %). Major depressive disorder (n = 6, 3.9 %) and generalized anxiety disorder (n = 1, 0.7 %) were categorized as internalizing disorders (n = 7, 4.6 %). There was no comorbidity: none of the participants met the diagnostic criteria for more than one DSM-IV diagnosis.
In Table 2, odds ratios for a DSM-IV diagnosis are displayed for each screening instrument. All SDQ, SAHA and K-SADS psychotic experiences (sub)scales significantly predicted a diagnosis of any psychiatric disorder. Further, all SDQ (sub)scales, except for the self-reported emotional symptoms, as well as K-SADS psychotic experiences scale, significantly predicted the diagnosis of an externalizing disorder. The emotional symptoms, hyperactivity and total difficulties scales of the SDQ self report, the emotional symptoms scale of the SDQ teacher report, all SAHA scales and K-SADS psychotic experiences scale all significantly predicted internalizing disorders. No interaction effects for age and reading skills were found for all regression analyses in Table 2.
ROC curves for all screening instruments predicting the diagnosis of any, an externalizing or internalizing psychiatric disorder are shown in Figs. 2, 3, 4. Table 3 presents all AUC’s, the optimal cut-off points, based on the cut-off point extending the highest towards the upper left corner of the ROC curve (indicated as red dots in Figs. 2, 3, 4), and their corresponding abnormal ranges, sensitivities and specificities.
For any disorder (Fig. 2), all measures significantly outperformed a random predictor (Table 3). A good discriminatory power was achieved with the SDQ aggregated self-report and teacher-report total difficulties score (AUC = 0.86, 95 % CI = 0.77-0.94) and SDQ teacher-report total difficulties score (AUC = 0.82, 95 % CI = 0.72-0.92). For externalizing disorders (Fig. 3), all measures, except the SAHA total internalizing symptoms scale, predicted significantly better than a random predictor (Table 3). The SDQ teacher-report total difficulties score (AUC = 0.93, 95 % CI = 0.88-0.97) and SDQ aggregated self-report and teacher-report total difficulties score (AUC = 0.92, 95 % CI = 0.87-0.97) had excellent discriminatory power. For internalizing disorders (Fig. 4), an excellent discriminatory power was achieved with the SAHA total internalizing symptoms scale (AUC = 0.90, 95 % CI = 0.85-0.96). The SDQ self-report total difficulties score (AUC = 0.77, 95 % CI = 0.62-0.91) and K-SADS psychotic experiences score (AUC = 0.71, 95 % CI = 0.51-0.91) had reasonable discriminatory power (Table 3).
Table 4a shows the prediction of the optimal cut-off point of the screening instrument with the highest AUC for any psychiatric disorder (SDQ self report and teacher report), with the corresponding test values. Using these instruments, a sensitivity of 85 % and specificity of 80 % was reached, 29 % of the screening sample was screen positive. In Table 4b and c the added value of the SAHA and K-SADS psychotic experiences scales are presented. By including the SAHA total internalizing symptoms, the sensitivity increased from 85 to 95 % and the specificity decreased from 80 to 72 %, with an increase from 29 to 37 % of screen positives. By including the K-SADS psychotic experiences the sensitivity increased slightly from 85 to 90 % and the specificity decreased from 80 to 67 %, with a considerable increase of screen positive children from 29 to 41 %.
Summary of findings
School-based screening using the SDQ predicted psychiatric disorders in Moroccan-Dutch youth with a good degree of accuracy, especially when the self report and teacher report were combined. The additional assessment of internalizing symptoms with the SAHA improved detection of internalizing disorders in Moroccan-Dutch youth. Psychotic experiences predicted both externalizing and internalizing psychiatric disorders, but did not have additional discriminatory power as compared to screening instruments measuring non-psychotic psychiatric symptoms.
The ability of the SDQ to screen for psychiatric disorders
The SDQ, a screening instrument developed for Western populations, was also effective in the detection of psychiatric disorders in Moroccan-Dutch youth, especially when using both the self report and teacher report. Psychometric properties of screening instruments for psychiatric disorders have frequently been called into question due to cross-cultural biases [5–7]. By showing the good discriminatory power of the SDQ in an ethnic minority group that is marked by a relatively wide cultural gap to the majority group , we have provided evidence for the construct validity of the SDQ in this ethnic group. We tested the predictive value of existing (sub)scales, instead of identifying an underlying factor structure in our data. In this way uniformity in the administration might be reached.
Norms may differ substantially between ethnic groups . We compared our cut-offs to normative SDQ data from the United Kingdom (UK), since no Dutch SDQ norms are published and we assumed the UK as a country comparable to the Netherlands. The abnormal range derived from the ROC curve for predicting psychiatric disorders on the teacher report was comparable to the abnormal range recommended in the UK. Zwirs and colleagues also found that similar norms could be used for ethnic minority and majority youth when they developed a scoring rule based on four items of the SDQ teacher report . On the self report, however, the optimal cut-off in Moroccan-Dutch youth was substantially lower than the UK norm (10 versus 16) . This raises questions about the response style of Moroccan-Dutch youth as compared to English youth. Compared to English youth, Moroccan-Dutch youth seem to have a higher threshold to report psychiatric problems . As the difference between the cut-offs is substantial, subgroup-specific norms for Moroccan-Dutch youth on self-report measures should be developed.
Use of different informants
Consistent with literature on other ethnic groups, internalizing disorders were best detected by self-report measures  and externalizing disorders by teacher reports . The discriminatory power improved by combining the scores of the two informants. Without the need to assess parents as a third informant, a satisfactory predictive value was obtained. This not only shows that school-based screening is possible, but also has broader implications. Non-Western parents are less likely to recognize psychiatric problems in their children [38, 39] and are difficult to involve in diagnostic assessments as well as in treatment [e.g. 40]. Our results suggest that information from parents is not necessary for screening or diagnostic purposes for psychiatric problems in Moroccan-Dutch children.
The added value of the SAHA and psychotic experiences scales
The additional assessment of the SAHA measuring internalizing symptoms increased the accuracy to detect internalizing disorders among Moroccan-Dutch youth. When screening for internalizing disorders, particularly the specificity improved from 61 to 86 % compared to the SDQ self report only. When screening for psychiatric disorders with the SDQ self report and teacher report the sensitivity increased from 85 to 95 % by adding the SAHA; by diagnostically assessing a slightly larger proportion of the screening sample (8 % extra), additional cases of internalizing disorders were found. The SAHA did not predict externalizing disorders, which is interesting because it confirms that the measurement of internalizing symptoms and externalizing symptoms in the screening phase captured different constructs.
Considering the lower discriminatory powers of the psychotic experiences scale and the absent added value to the SDQ self report and teacher report in detecting psychiatric disorders, the additional assessment of psychotic symptoms is not needed for screening purposes. Interestingly though, psychotic experiences were significantly related to self- and teacher-reported psychiatric problems , and externalizing and internalizing disorders among Moroccan-Dutch youth. Since such symptoms are an important risk marker for severe psychopathology in adolescence  and predictive of psychotic disorders in (young) adulthood [e.g. 34], it is important to take the presence of such symptoms into account in clinical settings.
Identification of internalizing disorders
Identification of internalizing psychiatric disorders in general screening and diagnostic procedures in ethnic minorities is hampered by cultural variations in presentation or symptom expression . In our sample, the minority of diagnoses was internalizing (4.6 %, 7 out of 152) and the majority externalizing (8.5 %, 13 out of 152). Compared to Dutch prevalence rates for child psychiatric disorders of 8 to 14 %, inter alia constituting of 9 % internalizing and 5 % externalizing disorders , the distribution in our Moroccan-Dutch sample is different. In spite of our cultural sensitive approach, we might still have missed cases of internalizing disorders. However, psychiatric symptom profiles in Moroccan-Dutch youth measured with various instruments tend to be more externalizing than internalizing [9, 16, 30], thus it could also be a reflection of the actual distribution.
Access to care
School-based screening is a practical way to gather multi-informant data of large groups of children, especially when using a web-based survey. A next step is to investigate how to connect children from school-based screening to mental health care. An option is to offer accessible, non-stigmatizing interventions at school to children scoring high on screening questionnaires. If psychiatric problems turn out to be more severe, children should be referred to specialized mental health care centres for further diagnostic assessment and treatment. Such stepped care methods ensure that children detected by screening methods also receive timely intervention. For ethnic minority youth, school-based screening in combination with stepped care interventions may provide an alternative pathway to care and an opportunity to bridge the treatment gap observed in this group.
Strengths and limitations
The findings of this study are subject to several limitations. First, although studying the performance of screening instruments in one separate ethnic minority group is preferable to overcome possible cross-cultural biases, it precludes generalization of results to other ethnic groups. Second, only Moroccan-Dutch youth scoring very high (above two standard deviations above the mean) or average/low (beneath one standard deviation above the mean) on selected subscales measuring psychiatric problems were included in the diagnostic phase of the study. These cut-off points were chosen to form a group of Moroccan-Dutch youth exhibiting high numbers of internalizing, externalizing or psychotic psychiatric symptoms and to create a contrasting comparison group of Moroccan-Dutch youth with few symptoms on any group of psychiatric symptoms. Since Moroccan-Dutch youths with medium scores were excluded and in these cases it is usually more difficult to make a diagnosis, results on the performance of the screening instruments might be somewhat inflated. Moreover, we did not use the algorithm, based on scores reported by parents, teachers and children, developed for the SDQ for the selection or prediction methods . This was impossible as we did not include parents in our screening method and we had decided to use additional screening questionnaires besides the SDQ and to use the same method for every scale. Third, there was a relatively long time lag between the screening and diagnostic phase. We administered the screening questionnaires only in the screening phase and not in the diagnostic phase. Therefore, we were not able to study stability on the screening instruments. Since childhood and adolescence are turbulent periods, psychiatric symptoms are likely to vary over time. Results can be biased because (i) part of the screen negatives may have developed a psychiatric disorder (test outcome in screening incorrectly negative) and some of the psychiatric problems of screen positive children may have been remitted (higher rate of false positives). Last, medical doctors and not child psychiatrists conducted the diagnostic interviews. The agreement between a committee consisting of psychiatrists and the medical doctors in assigning diagnoses among youth with decreased functioning, indicated that the medical doctors were able to detect psychiatric disorders accurately. However, it is possible that diagnoses were missed. The number of children with a DSM-IV diagnosis was low compared to the prevalence in national sample of Dutch adolescents in 1997 . Diagnoses may also have been missed because only children and not their teachers or parents were interviewed and even more cultural sensitive diagnostic procedures should be used as was discussed earlier.
Strengths of this study were the use of a web-based survey, a high participation rate and multi-informant data on psychiatric problems in a community sample at school in the screening phase of the study, and in-depth diagnostic assessment with a semi-structured psychiatric interview in a subgroup of Moroccan-Dutch youth in the diagnostic phase of the study.
School-based screening for psychiatric disorders is effective in Moroccan-Dutch youth. We suggest routine screening with the SDQ self report and teacher report at schools, with additional administration of the SAHA measuring internalizing symptoms to enhance identification of internalizing disorders. To make the connection with actual treatment, we suggest offering accessible non-stigmatizing interventions at school to children scoring high on screening questionnaires and referring severe cases to specialized mental health care centres. Further research should estimate (subgroup-specific) norms and optimal cut-off points in larger groups for use in school-based screening methods. School-based screening in combination with timely interventions may reduce the treatment gap observed in Moroccan-Dutch youth in the Netherlands. Other countries with similar underrepresentation of ethnic minority youth in mental health care could possibly benefit in the same way.
This method will have misclassified 1.7 % of Moroccan-Dutch youth as ethnically Dutch, because not their parents, but their grandparents were born in Morocco (third-generation migrants). The third generation of Moroccan migrants in the Netherlands is small 
Area under the curve
Diagnostic and statistical manual of mental disorders, fourth edition
Social and Health Assessment
Strengths and difficulties questionnaire
Kiddie-schedule for affective disorders and schizophrenia
de Haan AM, Boon AE, Vermeiren RR, de Jong JT. Ethnic differences in utilization of youth mental health care. Ethn Health. 2012;17:105–10.
Angold A, Erkanli A, Farmer EMZ, Fairbank JA, Burns BJ, Keeler G, et al. Psychiatric disorder, impairment, and service use in rural African American and white youth. Arch Gen Psychiatry. 2002;59:893–901.
Stevens GWJM, Vollebergh WAM. Mental health in migrant children. J Child Psychol Psychiatry. 2008;49:276–94.
Zwirs BWC, Burger H, Schulpen TWJ, Buitelaar JK. Different treatment thresholds in non-Western children with behavioral problems. J Am Acad Child Adolesc Psychiatry. 2006;45:476–83.
Jastrowski Mano KE, Hobart Davies W, Klein-Tasman BP, Adesso VJ. Measurement equivalence of the Child Behavior Checklist among parents of African American adolescents. J Child Fam Stud. 2009;18:606–20.
van de Vijver FJR, Poortinga YH. Towards an integrated analysis of bias in cross-cultural assessment. Eur J Psychol Assess. 1997;13:21–9.
Richter J, Sagatun A, Heyerdahl S, Oppedal B, Roysamb E. The Strengths and Difficulties Questionnaire (SDQ) - self-report. An analysis of its structure in a multiethnic urban adolescent sample. J Child Psychol Psychiatry. 2011;52:1002–11.
Goodman A, Heiervang E, Fleitlich-Bilyk B, Alyahri A, Patel V, Mullick MS, et al. Cross-national differences in questionnaires do not necessarily reflect comparable differences in disorder prevalence. Soc Psychiatry Psychiatr Epidemiol. 2012;47:1321–31.
Stevens GWJM, Pels T, Bengi-Arslan L, Verhulst FC, Vollebergh WAM, Crijnen AAM. Parent, teacher and self-reported problem behavior in The Netherlands: comparing Moroccan immigrant with Dutch and with Turkish immigrant children and adolescents. Soc Psychiatry Psychiatr Epidemiol. 2003;38:576–85.
Jackson SA. A study of teachers’ perception of youth problems. J Youth Stud. 2002;5:313–23.
Goodman R. The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry. 1997;38:581–6.
Klasen H, Woerner W, Wolke D, Meyer R, Overmeyer S, Kaschnitz W, et al. Comparing the German versions of the Strengths and Difficulties Questionnaire (SDQ-Deu) and the Child Behavior Checklist. Eur Child Adolesc Psychiatry. 2000;9:271–6.
Woerner W, Fleitlich-Bilyk B, Martinussen R, Fletcher J, Cucchiaro G, Dalgalarrondo P, et al. The Strengths and Difficulties Questionnaire overseas: evaluations and applications of the SDQ beyond Europe. Eur Child Adolesc Psychiatry. 2004;13 Suppl 2:II47–54.
Brondbo PH, Mathiassen B, Martinussen M, Heiervang E, Eriksen M, Moe TF, et al. The strengths and difficulties questionnaire as a screening instrument for norwegian child and adolescent mental health services, application of UK scoring algorithms. Child Adolesc Psychiatry Ment Health. 2011;5:32.
Paalman CH, Terwee CB, Jansma EP, Jansen LM. Instruments measuring externalizing mental health problems in immigrant ethnic minority youths: a systematic review of measurement properties. PLoS One. 2013;8:e63109.
Zwirs B, Burger H, Schulpen T, Vermulst A, HiraSing R, Buitelaar J. Teacher Ratings of Children’s Behavior Problems and Functional Impairment Across Gender and Ethnicity: Construct Equivalence of the Strengths and Difficulties Questionnaire. J Cross Cult Psychol. 2011;42:466–81.
Zwirs BWC, Burger H, Schulpen TWJ, Buitelaar JK. Developing a brief cross-culturally validated screening tool for externalizing disorders in children. J Am Acad Child Adolesc Psychiatry. 2008;47:309–16.
Kirmayer LJ. Cultural variations in the clinical presentation of depression and anxiety: implications for diagnosis and treatment. J Clin Psychiatry. 2001;62 Suppl 13:22–8.
Kelleher I, Keeley H, Corcoran P, Lynch F, Fitzpatrick C, Devlin N, et al. Clinicopathological significance of psychotic experiences in non-psychotic young people: evidence from four population-based studies. Br J Psychiatry. 2012;201:26–32.
Adriaanse M, van Domburgh L, Hoek HW, Susser E, Doreleijers TAH, Veling W. Prevalence, impact and cultural context of psychotic experiences among ethnic minority youth. Psychol Med. 2015;45:637–46.
Laurens KR, West SA, Murray RM, Hodgins S. Psychotic-like experiences and other antecedents of schizophrenia in children aged 9–12 years: a comparison of ethnic and migrant groups in the United Kingdom. Psychol Med. 2008;38:1103–11.
Bourque F, van der Ven E, Malla A. A meta-analysis of the risk for psychotic disorders among first- and second-generation immigrants. Psychol Med. 2011;41:897–910.
Veling W, Selten JP, Veen N, Laan W, Blom JD, Hoek HW. Incidence of schizophrenia among ethnic minorities in the Netherlands: a four-year first-contact study. Schizophr Res. 2006;86:189–93.
Achenbach TM, Rescorla LA. Manual for the ASEBA School-Age Forms and Profiles. Burlington: University of Vermont; 2001.
De Los RA, Kazdin AE. Informant discrepancies in the assessment of childhood psychopathology: a critical review, theoretical framework, and recommendations for further study. Psychol Bull. 2005;131:483–509.
Ruchkin V, Schwab-Stone ME, Vermeiren R. Social and Health Assessment (SAHA): Psychometric development summary. New Haven: Yale University; 2004.
Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, et al. Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry. 1997;36:980–8.
The Netherlands Institute of Social Research. Statusscores: rangorde naar sociale status van postcodegebieden in Nederland. 2010. http://www.scp.nl/content.jsp?objectid=default:20133. Accessed 18 Sept 2012.
Brus BT, Voeten MJM. Een-minuut test, vorm A en B: verantwoording en handleiding. Nijmegen: Swets Test Publishers; 1979.
Adriaanse M, Veling W, Doreleijers T, van Domburgh L. The link between ethnicity, social disadvantage and mental health problems in a school-based multiethnic sample of children in The Netherlands. Eur Child Adolesc Psychiatry. 2014;23:1103–13.
Paalman CH, Van DL, Stevens GW, Doreleijers TA, Paalman CH, van Domburgh DL, et al. Individual, family and offence characteristics of high risk childhood offenders: comparing non-offending, one-time offending and re-offending Dutch-Moroccan migrant children in the Netherlands. Child Adolesc Psychiatry Ment Health. 2011;5:33.
Schwab-Stone M, Koposov R, Vermeiren R, Ruchkin V. Cross-cultural findings on community violence exposure and internalizing psychopathology: comparing adolescents in the United States, Russia, and Belgium. Child Psychiatry Hum Dev. 2013;44:516–24.
Stadler C, Feifel J, Rohrmann S, Vermeiren R, Poustka F. Peer-victimization and mental health problems in adolescents: are parental and school support protective? Child Psychiatry Hum Dev. 2010;41:371–86.
Poulton R, Caspi A, Moffitt TE, Cannon M, Murray R, Harrington H. Children’s self-reported psychotic symptoms and adult schizophreniform disorder: a 15-year longitudinal study. Arch Gen Psychiatry. 2000;57:1053–8.
Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H, et al. A children’s global assessment scale (CGAS). Arch Gen Psychiatry. 1983;40:1228–31.
Fleiss JL. Statistical methods for rates and proportions. New York: John Wiley; 1981.
Youthinmind. SDQ frequency distribution for British 11–15 year olds, both sexes. In: SDQ: Normative School-Age SDQ Data from Britain. 2001. http://www.sdqinfo.com/norms/UKNorm9.pdf. Accessed 12 Oct 2013.
Zwirs BWC, Burger H, Buitelaar JK, Schulpen TWJ. Ethnic differences in parental detection of externalizing disorders. Eur Child Adolesc Psychiatry. 2006;15:418–26.
Ivert AK, Svensson R, Adler H, Levander S, Rydelius PA, Levander MT. Pathways to child and adolescent psychiatric clinics: a multilevel study of the significance of ethnicity and neighbourhood social characteristics on source of referral. Child Adolesc Psychiatry Ment Health. 2011;5:1–12.
Ingoldsby EM. Review of interventions to improve family engagement and retention in parent and child mental health programs. J Child Fam Stud. 2010;19:629–45.
Verhulst FC, van der Ende J, Ferdinand RF, Kasius MC. The prevalence of DSM-III-R diagnoses in a national sample of Dutch adolescents. Arch Gen Psychiatry. 1997;54:329–36.
Goodman R, Renfrew D, Mullick M. Predicting type of psychiatric disorder from Strengths and Difficulties Questionnaire (SDQ) scores in child mental health clinics in London and Dhaka. Eur Child Adolesc Psychiatry. 2000;9:129–34.
Statistics Netherlands. Bevolking; niet-westerse derde generatie, 1 januari. 2010. http://statline.cbs.nl/Statweb/selection/?VW=T&DM=SLNL&PA=70688ned&D1=1-2&D2=0&D3=l&D4=10&HDR=T%2cG2&STB=G1%2cG3. Accessed 16 Jan 2014.
This work was supported by a grant from the Department of Integration and Society of the Ministry of Social Affairs and Employment of the Government of the Netherlands. The authors gratefully acknowledge all participating children and teachers, and all research assistants and interviewers involved.
The authors declare that they have no competing interests.
MA carried out the study and drafted the manuscript. LvD and WV participated in its design and helped to draft the manuscript. TD conceived of the study, participated in its design and revised the manuscript critically. BZ helped to interpretate the data and revised the manuscript critically. All authors read and approved the final manuscript.
About this article
Cite this article
Adriaanse, M., van Domburgh, L., Zwirs, B. et al. School-based screening for psychiatric disorders in Moroccan-Dutch youth. Child Adolesc Psychiatry Ment Health 9, 13 (2015). https://doi.org/10.1186/s13034-015-0045-8
- Externalizing disorders
- Internalizing disorders