IQ as a moderator of outcome in severity of children’s mental health status after treatment in outpatient clinics
© Mathiassen et al.; licensee BioMed Central Ltd. 2012
Received: 13 December 2011
Accepted: 7 June 2012
Published: 7 June 2012
Psychotherapy is an effective treatment for mental health disorders, but even with the most efficacious treatment, many patients do not experience improvement. Moderator analysis can identify the conditions under which treatment is effective or whether there are factors that can attenuate the effects of treatment.
In this study, linear mixed model analysis was used to examine whether the Full Scale IQ (FSIQ), Performance IQ (PIQ) and Verbal IQ (VIQ) on the Wechsler Intelligence Scale for Children – Third Edition, moderated outcomes in general functioning and symptom load. A total of 132 patients treated at three outpatient child and adolescent mental health services (CAMHS) were assessed at three different time points. The Children’s Global Assessment Scale (CGAS) and the Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA) were used to measure the severity of impairments in general functioning and symptom load. IQ was assessed at the start of treatment.
Moderator analysis revealed that the FSIQ × time interaction predicted changes in CGAS scores (p < .01), and that the PIQ × time interaction predicted changes in HoNOSCA scores (p < .05). The slopes and intercepts in HoNOSCA scores covaried negatively and significantly (p < .05). The same pattern was not detected for the CGAS scores (p = .08).
FISQ and PIQ moderated change in general functioning and symptom load, respectively. This implies that patients with higher IQ scores had a steeper improvement slope than those with lower scores. The patients with the highest initial symptom loads showed the greatest improvement, this pattern was not found in the improvement of general functioning.
Numerous studies have shown that psychotherapy is an efficacious treatment for mental health disorders among children and adolescents , but even with the most efficacious interventions, many patients do not experience therapeutic improvement. In clinical decision-making, the ability to recognise these patients is crucial when determining which type of psychotherapy a patient should be offered. Moderator analysis, a method that can be used to examine this question, can reveal the conditions under which a treatment is effective or whether there are factors that are attenuating the effects of treatment . Examples of factors moderating the effects of therapy are comorbidities, parental depression, a family’s need for public assistance and gender [3, 4]. Developmental factors are recognised as a potentially important moderator of psychotherapy, but few studies have used measures of children’s and adolescents’ cognitive developmental levels to examine whether they have a moderating effect .
Low IQ is a risk factor for mental health disorders. Approximately one third of children with an intellectual disability have mental health disorders [6–9]. A study of Australian children also showed that borderline intellectual functioning (IQs in the range of 70–85) increased the risk of mental health disorders . In spite of the finding that low IQ is a risk factor for mental health disorders, only a small number of studies have investigated whether patients’ IQs moderate the effects of therapy. In a study of cognitively based treatment of children with antisocial and aggressive behaviour, it was discovered that low IQs predicted a worse outcome for girls but not boys . In the Multimodal Treatment Study of Children with Attention Deficit/Hyperactivity Disorder (ADHD), it was found that among children with severe ADHD whose parents had depressive symptoms, those with an IQ ≥ 100 responded better to both medical treatment and combined medical and behavioural treatment than those with an IQ < 100 .
The Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA)  and the Children’s Global Assessment Scale (CGAS)  are designed to assess different aspects of children’s mental health status. The HoNOSCA primarily measures symptom load, whereas the CGAS measures general functioning. Scores on the HoNOSCA and the CGAS are highly correlated [14, 15], indicating that they measure much of the same construct. Several studies have found that both the HoNOSCA [14, 16, 17] and the CGAS  are able to detect changes in the mental health status of children with mental health problems. A positive correlation has been found between initial severity and changes in HoNOSCA scores, indicating that higher initial severity predicts larger changes in outcome [14, 19].
Studies examining IQ as a predictor of HoNOSCA and CGAS scores have yielded mixed results. The results of a study of IQ as a predictor of HoNOSCA scores showed that IQ predicted an additional 6 % of the variance after controlling for age and gender . Results from the same study revealed that IQ did not predict CGAS scores. A correlation has been observed between IQ and CGAS score among children admitted to a psychiatric inpatient unit . Furthermore, low IQ predicted CGAS scores in the clinical range in a study comparing the offspring of depressed and non-depressed parents . In a study of youth with schizophrenia and bipolar disorder at a psychiatric inpatient unit, no significant associations were found between IQ and HoNOSCA scores at admission or at follow up six years later . To our knowledge, no study has reported whether a patient’s IQ moderates outcome in terms of general functioning and symptom load as measured by the CGAS and the HoNOSCA.
The objective of this study was to examine changes in symptom load and general functioning in an outpatient sample using the HoNOSCA and the CGAS as outcome measures. Participants were assessed with these instruments at three different time points. We also examined whether a patient’s cognitive functioning level (as assessed with the Wechsler Intelligence Scale for Children—Third Edition (WISC-III) IQ test) predicted changes in HoNOSCA and CGAS scores over these time points. We examined this relationship for both patients on a waiting list and patients in active treatment. Based on results from studies indicating that children with borderline intellectual functioning have a significantly increased risk for developing mental health problems compared to normally developing peers [10, 24], we hypothesised that patients with higher IQ scores on the WISC-III IQ scales Full Scale IQ (FSIQ), Performance IQ (PIQ) and Verbal IQ (VIQ) would have better outcomes and faster improvements than patients with lower IQ scores.
Descriptive Data for the Total Sample
M (SD; n)
12.35 (5.29; n = 128)
11.11 (4.41; n = 118)
7.91 (4.34; n = 97)
67.66 (11.17; n = 128)
68.49 (10.22; n = 109)
75.28 (9.53; n = 94)
WISC-III IQ scores
84.77 (19.02; n = 132)
83.81 (17.45; n = 132)
89.52 (20.92; n = 132)
3.38 (2.43; n = 132)
2.33 (1.88; n = 132)
5.44 (2.86; n = 132)
Peer relationship problems
2.73 (2.04; n = 132)
7.58 (2.06; n = 132)
13.87 (5.84; n = 132)
The Wechsler Intelligence Scale for Children—Third Edition (WISC-III), Norwegian version , is an intelligence test for children aged 6–16 years. The test consists of 13 subtests that are combined into three IQ scores: Full Scale IQ (FSIQ), Verbal IQ (VIQ), and Performance IQ (PIQ). Both the split-half and test-retest reliability of the WISC-III IQ scores are high (r xx > .93) .
The Strengths and Difficulties Questionnaire (SDQ)  is a behavioural screening questionnaire designed for children and adolescents aged 3–16 years. It has been widely used for research in the Nordic countries . There are separate SDQ forms for youths, parents and teachers. In this study, the parent version was used. Each form consists of 25 items divided into the following scales: emotional symptoms, conduct problems, hyperactivity/inattention, peer relationship problems and pro-social behaviour. The factor structure of the SDQ has been replicated using confirmatory factor analysis in a sample of Norwegian children .
The Children’s Global Assessment Scale (CGAS)  is a rating scale that measures general functioning in children aged 4–16 years with a range from 1 (needs constant supervision) to 100 (superior functioning). The most impaired level of functioning during the previous month was rated. The CGAS has been evaluated in several studies and is widely used to assess the severity of mental health problems and outcomes [18, 31]. A study of inter-rater reliability  among clinicians working in the Norwegian outpatient CAMHS revealed an intraclass correlation coefficient (ICC) of .61. A similar ICC was found in a comparable cross-national study .
The Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA)  consists of 15 scales that are rated from 0 (no problem) to 4 (severe to very severe problem) by clinicians. In this study, only the first 13 scales were used, and the total score was used as a measure of the overall severity of mental health problems (range 0–52). The HoNOSCA has been evaluated in several studies and has been found to be easy to use, reliable, valid and sensitive to change [14, 16, 17, 32–34] A study of inter-rater reliability  among clinicians working in the Norwegian child and adolescent mental health service revealed an ICC of .81, and in a comparable cross-national study , the ICC was found to be .84.
The participants were assessed by clinicians using the HoNOSCA and CGAS at three different time points: at the intake session (T0), at the start of treatment (T1) and after 6 months of treatment (T2) or at the end of treatment if treatment lasted less than 6 months. The mean waiting list time (the number of days from T0 to T1) was 140.5 days (SD = 70.1), and the mean treatment time (the number of days from T1 to T2) was 179.3 days (SD = 71.4). The WISC-III assessment was performed at T1.
There was some variation in the time at which the parent SDQ was completed: 77.3 % (n = 102) of the questionnaires were filled in at T1 and 33.7 % (n = 30) at T0. Examinations of differences between the questionnaires completed at T0 and T1 were performed with independent sample t-tests independently for scales measuring emotional symptoms, conduct problems, hyperactivity/inattention, peer relationship problems and pro-social behaviour. There was a small significant difference (t(130) = 2.59, p = .01, r = .22) between emotional scales completed at T0 (M = 4.37, SD = 2.79) and T1 (M = 3.09, SD = 2.24). No significant differences were found for the other scales.
This study was carried out in ordinary outpatient clinics with an unscreened patient population. The clinics had an eclectic approach to therapy and interventions, and were staffed with clinical psychologists, child psychiatrists and social workers. Most of the employees were specialist in their profession or under specialization. The specialization programs for psychologist and physicians last for five years after six years of university education, and includes compulsory seminars and supervision from a specialist.
This study was approved by The Regional Committee for Medical and Health Research Ethics, North Norway.
All statistical analyses were performed using SPSS version 16.0. Some participants assessed at the intake session had missing data at later time points, and there were some differences in assessment time points. Repeated measures analyses of variance or regression analyses with dummy variables would have necessitated the exclusion of participants with missing data. Additionally, these statistical methods assume that all participants have been assessed at the same time points. To overcome these problems, linear mixed model analyses were used . In a repeated measures design analysed with linear mixed model statistics, participants with missing data can be included in the analysis, the time points of assessment can vary and it is possible to specify the best variance-covariance structure for the data . The results can be interpreted in the same way as a regression analysis results.
To test whether there were differences between the HoNOSCA and CGAS scores at different time points, time was treated as a fixed factor. Bonferroni post-hoc comparisons were used to adjust for multiple comparisons. The effect size of the different time points was examined by calculating r based on the results from an independent samples t-test. An interpretation of the effect sizes was performed according to the guidelines suggested by Cohen . Effect sizes of r = .10 were interpreted as small, r = .30 as moderate, and r = .50 as large.
The models examining repeated HoNOSCA and CGAS measures, with the different WISC IQ scales as moderator variables, were constructed in a stepwise fashion. To test whether entering new variables into the model increased the model fit, changes in −2 log likelihood were used. The differences were examined with chi-squared statistics. The first independent variable entered in the model was time (the three time points) and the next variable was the WISC IQ score. Entering the different FSIQ-, PIQ- and VIQ-time interaction terms as the final variable in the mixed-model analysis was performed to examine the different WSIC IQ as moderators. The repeated measures of HoNOSCA and CGAS were entered at level 1 (data for individual patients) in the model, whereas the different WISC IQ scales were entered at level 2 (differences between patients). Time and the IQ scales were treated as covariates. An unstructured covariance structure was used.
Characteristics of the sample
Of the 132 participants included in the study, 26.9 % (n = 35) dropped out or had missing data before the final HoNOSCA assessment was completed. We examined whether the patients with missing data were different from those with full data sets. To accomplish this, we compared patients with and without HoNOSCA scores at the final assessment with independent sample t-tests examining the following variables: HoNOSCA and CGAS score at the intake assessment, age, FSIQ, VIQ, PIQ and mental health as measured by the SDQ questionnaire. An examination of differences in gender distribution was performed with a Pearson chi-squared test. There were no significant differences between the participants with and without complete data from all assessments. This result indicates that even though some of the participants dropped out or had missing data after the first assessment, the results from the final assessment are representative of the whole sample.
Symptom load measured by HoNOSCA
Parameters in the final models with HoNOSCA and CGAS as dependent variables
HoNOSCA as dependent variable
CGAS as dependent variable
95 % CI
95 % CI
FSIQ as moderator
FSIQ × Time
PIQ as moderator
PIQ × Time
VIQ as moderator
VIQ × Time
Post-hoc comparisons indicated that the mean HoNOSCA score at T0 (M = 12.35, SD = 5.29) was significantly (p = .01) higher than that at T1 (M = 11.11, SD = 4.42) and that the score at T2 (M = 7.91, SD = 4.42) was significantly (p < .01) lower than that at T1. The effect size of the reduction of HoNOSCA scores from T0 to T1 for the whole sample was small and non-significant (r = . 12; t(237,78) = 1.95, p = .06), whereas the reduction from T1 to T2 was moderate (r = .34; t(209) = 5.17, p < .01).
The change in HoNOSCA scores across the three time points showed a significant variance in intercepts (var(u 0j ) = 29.12, p < .01) but not in slopes (var( u1j ) = 2.30, p = .06) across participants. The slopes and intercepts covaried negatively and significantly (cov(u 0j , u 1j ) = −7.14, p = .01). This result indicates that the participants with the highest initial HoNOSCA scores showed a greater improvement across the time points compared to the participants with the lowest scores.
General functioning measured by CGAS
The mean CGAS scores for the three different time points were significantly different (F(2, 328) = 16.43, p < .01). Time predicted changes in CGAS scores (b = −3.74, t(104.11) = 6.33, p < .01). The different WISC IQ scores were examined in separate models. Neither entering the PIQ×time (χ 2 (1) = 3.53, p > .05) or the VIQ×time (χ 2 (1) = 2.66, p > .01) interactions did increased model fit. Adding the FSIQ×time interaction (χ 2 (1) = 8.63, p < .01) did increase model fit, indicating that FSIQ moderated the outcome in CGAS scores. The interaction term FSIQ × time predicted changes in the CGAS score (b = 0.46, t(107.28) = 1.86, p < .01). The parameters of the final model are presented in Table 2.
Post-hoc comparisons indicated that the mean CGAS score at T0 (M = 67.66, SD = 11.17) was not significantly (p = 1.00) different from that at T1 (M = 68.49, SD = 19.22) and that the score at T2 (M = 75.28, SD = 9.53) was significantly (p < .01) higher than that at T1. The effect size of the increase in CGAS from T1 to T2 was moderate (r = .32; t(201) = −4.87, p < .01).
The change in CGAS scores across the three time points showed significant variance in intercepts (var(u 0j ) = 118.38, p < .01) across participants. There was no significant variance in slopes (var( u1j ) = 9.02, p = .20) or in the covariation between slopes and intercepts (cov(u 0j , u 1j ) = −27.25, p = .08).
The main objective of this study was to examine if the different WISC-III IQ scales moderates changes in symptom load and general functioning among children and adolescents referred to mental health outpatient clinics. The results indicated that the patients’ symptom loads and general functioning, as measured by HoNOSCA and CGAS, respectively, improved for the entire sample.
Symptom load showed a decrease from the start of treatment to the 6-month follow-up assessment, and the effect size of this change was moderate. The patients with the highest initial HoNOSCA scores showed the greatest improvement. This result is consistent with previous research . The results indicated that PIQ moderated changes in HoNOSCA from the intake session to the follow-up assessment, indicating that the improvement slopes for patients with high PIQ were steeper than those with lower PIQ. There were no gender differences in the moderating effect of PIQ. FSIQ and VIQ did not moderate the outcome in HoNOSCA scores.
General functioning, as measured by the CGAS, improved from the start of treatment to the 6-month follow-up assessment. The effect size of this change was moderate. There was no significant variance across the participants in the intercept or slope of the change in CGAS scores across the measurements performed at the intake session, start of treatment or at the 6-month follow-up assessment. The results indicated that FSIQ moderated changes in CGAS scores and imply that the general functioning improvement slope for patients with high FSIQ were steeper than those with lower scores. There were no gender differences in the moderating effect of FSIQ. PIQ and VIQ did not moderate outcome.
In addition to psychometrical differences between the HoNOSCA and CGAS scales, distinct properties of the WISC-III IQ-scales may explain the differences in the predictability of outcome. In addition to measuring different cognitive abilities, the heritability of the WISC-III IQ-scales is dissimilar. The heritability of FSIQ, VIQ and PIQ in early adolescent is 65 %, 51 % and 72 %, respectively . The environments influence the development of the WISC-III IQ score in different ways. Common environment influences on FSIQ, VIQ and PIQ in early adolescent are 18 %, 26 % and 0 %, respectively .
Although the CGAS and the HoNOSCA measure different aspects of mental health impairment, there is a large correlation between these measures . This correlation indicates that the CGAS and the HoNOSCA measure much of the same psychological construct. In our study different WISC-III IQ scales moderated the outcome in general functioning measured and symptom load measured with the CGAS and the HoNOSCA. This difference could be explained by the different construction of the HoNOSCA and the CGAS. The HoNOSCA total score is the sum of 13 scales, including one question related to scholastic and language skills, which are areas that have a high correlation with IQ , whereas the CGAS consists of just one scale.
The identification of IQ as a moderator of changes in general functioning and symptom load does not explain the mechanism behind the relationship between IQ and outcome. The cognitive reserve model has been proposed as an explanation for the association between IQ and the development of mental health disorders [25, 39]. This model postulates that “cognitive reserve” (CR), operationalized as, for example, education, occupational attainment and IQ, is a proxy measure of brain reserve capacity . It could be that in addition to explaining the increased risk for mental health disorders, the CR model also explains why the patients in our study with higher IQ scores had a larger improvement in general functioning than the patients with lower scores. Because IQ is associated with both brain size  and other neuroanatomical and neurophysiological factors , it could be that the patients with the largest cognitive reserve had a greater capacity to benefit from the help they received at the outpatient clinic.
The rate of dropout and missing data in this study was 26.5 %. Compared to other clinical studies, this was a small dropout rate. A meta-analysis across 125 studies of psychotherapy revealed a mean dropout rate of 46.9 %  Even if there were no significant differences between the participants with complete and missing data, there could potentially be relevant differences between these groups that were not examined.
The main methodological strength of our study is that it is carried out in ordinary outpatient clinics without low IQ as an exclusion criterion. In mental health research most outcome studies have been conducted under controlled experimental conditions with strict sample control selection . This limits the external validity of the results. The methodological strength of this study is also the main limitation. In an ordinary outpatient clinic with an unselected patient population it is difficult to obtain information about the reason for dropout, an exact overview of the number of eligible patients, therapist competence and caseload, type of intervention and other potential relevant factors. In our study this could potentially have biased the sample due to attrition. If we had collected these data, the results could to some degree have been statistically corrected for these factors.
The main clinical implications of the present study are that IQ moderates outcome as measured with CGAS and that patients with the highest initial HoNOSCA scores show the greatest improvements. These results are potentially important as background information when interpreting changes in CGAS and HoNOSCA scores in ordinary clinical practice.
In spite of the findings that low IQ is a risk factor for mental health disorders [6–10], most intervention studies use IQ < 80 as an exclusion criterion [44–46]. In a psychodynamic psychotherapy study on child internalizing disorders, the cut off for exclusion was as high as IQ < 90 . Since children and adolescents with low IQ systematically have been excluded form most outcome studies, there is a limited knowledge of whether they benefit from treatment in outpatient clinics or not. To make sure that children with low IQ receive effective help for their mental health problems, it is particularly important to apply systematic outcome evaluations on this group of children and adolescents to evaluate the effect of treatment.
The results from the present study showed that both symptom load and general functioning among children and adolescents receiving treatment in the outpatient clinics improved. FSIQ and PIQ was a moderator of change in general functioning and symptom load, respectively. This implies that patients with higher IQ scores had a steeper improvement slope than those with lower scores. The patients with the highest initial symptom loads showed the greatest improvement, this pattern was not found in the improvement of general functioning.
The Health of the Nation Outcome Scales for Children and Adolescents
The Children’s Global Assessment Scale
The Wechsler Intelligence Scale for Children—Third Edition
Full Scale IQ
The Strength and Difficulties Questionnaire.
The authors thank Bjørn Helge Handegård at the Regional Centre for Child and Adolescent Mental Health, North Norway Department of Clinical Medicine, Faculty of Medicine for useful advice on the linear mixed model analysis.
- Weisz JR, Weiss B, Han SS, Granger DA, Morton T: Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies. Psychol Bull. 1995, 117: 450-468.View ArticlePubMed
- Baron RM, Kenny DA: The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. J Personal Soc Psychol. 1986, 51: 1173-1182.View Article
- Lavigne JV, LeBailly SA, Gouze KR, Cicchetti C, Jessup BW, Arend R, Pochyly J, Binns HJ: Predictor and moderator effects in the treatment of oppositional defiant disorder in pediatric primary care. J Pediatr Psychol. 2008, 33: 462-472.View ArticlePubMed
- Owens EB, Hinshaw SP, Kraemer HC, Arnold LE, Abikoff HB, Cantwell DP, Conners CK, Elliott G, Greenhill LL, Hechtman L, Hoza B, Jensen PS, March JS, Newcorn JH, Pelham WE, Severe JB, Swanson JM, Vitiello B, Wells KC, Wigal T: Which treatment for whom for ADHD? Moderators of treatment response in the MTA. J Consult Clin Psychol. 2003, 71: 540-552.View ArticlePubMed
- Holmbeck GN, Greenley RN, Franks EA: Developmental issues and considerations in research and practice. 2003, New York, NY: Guilford Press; US
- Emerson E, Hatton C: Contribution of socioeconomic position to health inequalities of British children and adolescents with intellectual disabilities. Am J Ment Retard. 2007, 112: 140-150. 10.1352/0895-8017(2007)112[140:COSPTH]2.0.CO;2.View ArticlePubMed
- Emerson E: Hatton C; Mental health of children and adolescents with intellectual disabilities in Britain. Br J Psychiatry. 2007, 191: 493-499. 10.1192/bjp.bp.107.038729.View ArticlePubMed
- Linna S-L, Moilanen I, Ebeling H, Piha J, Kumpulainen K, Tamminen T, Almqvist F: Psychiatric symptoms in children with intellectual disability. European Child & Adolescent Psychiatry. 1999, 8: 77-82. 10.1007/PL00010704.View Article
- Stromme P, Diseth TH: Prevalence of psychiatric diagnoses in children with mental retardation: Data from a population-based study. Developmental Medicine & Child Neurology. 2000, 42: 266-270. 10.1017/S0012162200000451.View Article
- Emerson E, Einfeld S, Stancliffe RJ: The mental health of young children with intellectual disabilities or borderline intellectual functioning. Social Psychiatry and Psychiatric Epidemiology. 2010, 45: 579-587. 10.1007/s00127-009-0100-y.View ArticlePubMed
- Kazdin AE, Crowley MJ: Moderators of treatment outcome in cognitively based treatment of antisocial children. Cogn Ther Res. 1997, 21: 185-207. 10.1023/A:1021832729480.View Article
- Gowers SG, Harrington RC, Whitton A, Lelliott P, Beevor A, Wing J, Jezzard R: Brief scale for measuring the outcomes of emotional and behavioural disorders in children. Health of the Nation Outcome Scales for children and Adolescents (HoNOSCA). Br J Psychiatry. 1999, 174: 413-416. 10.1192/bjp.174.5.413.View ArticlePubMed
- Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H, Aluwahlia S: A children's global assessment scale (CGAS). Arch Gen Psychiatry. 1983, 40: 1228-1231. 10.1001/archpsyc.1983.01790100074010.View ArticlePubMed
- Garralda ME, Yates P, Higginson I: Child and adolescent mental health service use: HoNOSCA as an outcome measure. Br J Psychiatry. 2000, 177: 52-58. 10.1192/bjp.177.1.52.View ArticlePubMed
- Yates P, Garralda M, Higginson I: Paddington Complexity Scale and Health of the Nation Outcome Scales for children and adolescents. Br J Psychiatry. 1999, 174: 417-423. 10.1192/bjp.174.5.417.View ArticlePubMed
- Bilenberg N: Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA): Results of a Danish field trial. European Child & Adolescent Psychiatry. 2003, 12: 298-302. 10.1007/s00787-003-0343-1.View Article
- Brann P, Coleman G, Luk E: Routine outcome measurement in a child and adolescent mental health service: An evaluation of HoNOSCA. Australian and New Zealand Journal of Psychiatry. 2001, 35: 370-376. 10.1046/j.1440-1614.2001.00890.x.View ArticlePubMed
- Schorre BEH, Vandvik IH: Global assessment of psychosocial functioning in child and adolescent psychiatry: A review of three unidimensional scales (CGAS, GAP, GAPD). European Child & Adolescent Psychiatry. 2004, 13: 273-286. 10.1007/s00787-004-0390-2.View Article
- Hanssen-Bauer K, Heyerdahl S, Hatling T, Jensen G, Olstad P, Stangeland T, Tinderholt T: Admissions to acute adolescent psychiatric units: a prospective study of clinical severity and outcome. Int J Ment Heal Syst. 2011, 5: 1-10.1186/1752-4458-5-1.View Article
- Mathiassen B, Brøndbo PH, Waterloo K, Martinussen M, Hanssen-Bauer K, Eriksen M, Kvernmo S: IQ as a Predictor of Clinician-Rated Mental Health Problems in Children and Adolecents. Br J Clin Psychol. 2011, 10.1111/j.2044-8260.2011.02023.x.
- Green B, Shirk S, Hanze D, Wanstrath J: The Children's Global Assessment Scale in clinical practice: An empirical evaluation. Journal of the American Academy of Child & Adolescent Psychiatry. 1994, 33: 1158-1164. 10.1097/00004583-199410000-00011.View Article
- Weissman MM, Warner V, Fendrich M: Applying impairment criteria to children's p sychiatric diagnosis. Journal of the American Academy of Child & Adolescent Psychiatry. 1990, 29: 789-795. 10.1097/00004583-199009000-00019.View Article
- Pogge DL, Insalaco B, Bertisch H, Bilginer L, Stokes J, Cornblatt BA, Harvey PD: Six-year outcomes in first admission adolescent inpatients: Clinical and cognitive characteristics at admission as predictors. Psychiatry Research. 2008, 160: 47-54. 10.1016/j.psychres.2007.06.024.View ArticlePubMed
- Koenen KC, Moffitt TE, Roberts AL, Martin LT, Kubzansky L, Harrington H, Poulton R, Caspi A: Childhood IQ and adult mental disorders: A test of the cognitive reserve hypothesis. Am J Psychiatry. 2009, 166: 50-57. 10.1176/appi.ajp.2008.08030343.PubMed CentralView ArticlePubMed
- Goodman R: Psychometric properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry. 2001, 40: 1337-1345. 10.1097/00004583-200111000-00015.View Article
- Sonnander S, Ramund B, Smedler A-C: WISC-III : Svensk versjon. Psykologiförlaget AB. 1998
- Wechsler D: Wechsler Intelligence Scale for Childern - Third Edition. 1992, London: The Psychological Corporation
- Goodman R: The Strengths and Difficulties Questionnaire: A research note. J Child Psychol Psychiatry. 1997, 38: 581-586. 10.1111/j.1469-7610.1997.tb01545.x.View ArticlePubMed
- Obel C, Heiervang E, Rodriguez A, Heyerdahl S, Smedje H, Sourander A, Gudmundsson OO, Clench-Aas J, Christensen E, Heian F, Mathiesen KS, Magnusson P, Njardvik U, Koskeliainen M, Rønning JA, Stormark KM, Olsen J: The Strengths and Difficulties Questionnaire in the Nordic countries. European Child & Adolescent Psychiatry. 2004, 13: 32-39. 10.1007/s00787-004-2006-2.View Article
- Ronning JA, Handegaard BH, Sourander A, Morch W-T: The Strengths and Difficulties Self-Report Questionnaire as a screening instrument in Norwegian community samples. European Child & Adolescent Psychiatry. 2004, 13: 73-82. 10.1007/s00787-004-0356-4.View Article
- Rey JM, Starling J, Wever C, Dossetor DR, Plapp JM: Inter-rater reliability of global assessment of functioning in a clinical setting. J Child Psychol Psychiatry. 1995, 36: 787-792. 10.1111/j.1469-7610.1995.tb01329.x.View ArticlePubMed
- Hanssen-Bauer K, Aalen O, Ruud T, Heyerdahl S: Inter-rater Reliability of Clinician-rated Outcome Measures in Child and Adolescent Mental Health Services. Administration and Policy in Mental Health and Mental Health Services Research. 2007, 34: 504-512. 10.1007/s10488-007-0134-y.View ArticlePubMed
- Hanssen-Bauer K, Gowers S, Aalen OO, Bilenberg N, Brann P, Garralda E, Merry S: Heyerdahl: Cross-national reliability of clinician-rated outcome measures in child and adolescent mental health services. Administration and Policy in Mental Health and Mental Health Services Research. 2007, 34: 513-518. 10.1007/s10488-007-0135-x.View ArticlePubMed
- Pirkis JE, Burgess PM, Kirk PK, Dodson S, Coombs TJ, Williamson MK: A review of the psychometric properties of the Health of the Nation Outcome Scales (HoNOS) family of measures. Health & Quality of Life Outcomes. 2005, 3: 76-10.1186/1477-7525-3-76.View Article
- Norusis MJ: SPSS 13.0 Advanced Statistical Procedures Companion. Prentice Hall, Inc. 2004
- Cohen JW: Statistical power analysis for the behvioral sciences (2 ed.). Hillsdale, NJ: Lawrence Erlbaum Associates. 1998
- Van Soelen IL, Brouwer RM, van Leeuwen M, Kahn RS, Hulshoff Pol HE, Boomsma DI: Heritability of verbal and performance intelligence in a pediatric longitudinal sample. Twin Research and Human Genetics. 201, 14: 119-28. 10.1375/twin.14.2.119.View Article
- Neisser U, Boodoo G, Bouchard TJ, Boykin AW, Brody N, Ceci SJ, Halpern DF, Loehlin JC, Perloff R, Sternberg RJ, Urbina S: Intelligence: Knowns and unknowns. Am Psychol. 1996, 51: 77-101. 10.1037/0003-066x.51.2.77.View Article
- Barnett JH, Salomond CH, Jones PB, Sahakian BJ: Cognitive reserve in neuropsychiatry. Psychol Med. 2006, 36: 1053-1064. 10.1017/S0033291706007501.View ArticlePubMed
- Stern Y: Cognitive reserve. Neuropsychologia. 2009, 47: 2015-2028.PubMed
- McDaniel MA: Big-brained people are smarter: A meta-analysis of the relationship between in vivo brain volume and intelligence. Intelligence. 2005, 33: 337-346. 10.1016/j.intell.2004.11.005.View Article
- Wierzbicki M, Pekarik G: A meta-analysis of psychotherapy dropout. Professional Psychology: Research and Practice. 1993, 24: 190-195. 10.1037/0735-7028.24.2.190.View Article
- Weisz JR, Jensen PS: Efficacy and Effectiveness of Child and Adolescent Psychotherapy and Pharmacotherapy. Ment Heal Serv Res. 1999, 10.1023/A:1022321812352.
- Compton SN, Walkup JT, Albano AM, Piacentini JC, Birmaher B, Sherrill JT, Ginsburg GS, Rynn MA, McCracken JT, Waslick BD, Iyengar S, Kendall PC, March JS: Child/Adolescent Anxiety Multimodal Study (CAMS): rationale, design, and methods. Child and Adolescent Psychiatry and Mental Health. 2010, 4: 1-10.1186/1753-2000-4-1.PubMed CentralView ArticlePubMed
- The MTA Cooperative Group: A 14-month randomized clinical trial of treatment strategies for attention-deficit/hyperactivity disorder. Arch Gen Psychiatry. 1999, 56: 1073-1086. 10.1001/archpsyc.56.12.1073.View Article
- Treatment for Adolescents with Depression Stud Team: Treatment for Adolescents with Depression Study (TADS): rationale, design, and methods. Journal of the American Academy of Child & Adolescent Psychiatry. 2003, 42: 531-542.View Article
- Muratori F, Picchi L, Bruni G, Patarnello M, Romagnoli G: A two-year follow-up of psychodynamic psychotherapy for internalizing disorders in children. Journal of the American Academy of Child & Adolescent Psychiatry. 2003, 42: 331-338. 10.1097/00004583-200303000-00014.View Article
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.