The Questionnaire for Social Anxiety and Social Competence Deficits for Adolescents (SASKO-J) was developed as an instrument for clinical diagnostics of social anxiety disorder in youths by measuring social anxiety and social deficits in two separate dimensions. The study provides an initial assessment of the scale’s psychometric properties in a clinical sample.
Method
The reliability and validity of the SASKO-J were assessed in a mixed clinical sample of 12- to 19-year-old German adolescents (N = 85; mean age 15.71 years; SD = 1.92; 62.4 % girls). In a second step, the diagnostic validity was evaluated in a clinical sample of 31 adolescent patients with social anxiety disorder (mean age 16.10 years; SD = 1.54; 74.2 % girls) and a sample of 115 German high school students (mean age 15.84 years; SD = 1.65; 60.9 % girls) via Receiver Operating Characteristic (ROC) analysis.
Results
The internal consistencies of the total scale and the subscales were good to excellent (0.80 ≤ α ≤ 0.96), and the results indicated a good convergent and divergent validity. The ROC analysis revealed a satisfying area under curve (AUC = 0.866), and a cutoff of 41.5 for the SASKO-J total score represented the best balance of sensitivity (0.806) and specificity (0.826).
Conclusions
The results of this pilot study provide initial support for the clinical use of the SASKO-J in the diagnostic process. Future research should address the question of psychometric properties in a social anxiety disorder sample as well as the questionnaire’s sensitivity for detecting change in symptoms during therapy.
Keywords
Social anxiety disorderSocial anxietySocial competence deficitsAdolescentsClinical diagnosticsQuestionnaire
Background
Social anxiety disorder is one of the most challenging disorders in adolescence [1–3]. During this age, the incidence of social anxiety increases notably [4–6]. Adolescence is an important developmental stage with regard to emotional, cognitive, biological, and social changes [7, 8] where youths are confronted with many psychologically relevant challenges. For example, they have to deal with questions of identity and self-perception as well as with increasing autonomy and responsibility. At the same time, relationships with peers and romantic partners get more important and influence the development of self-esteem and social competencies [9, 10]. In addition, the significance and frequency of achievement at school and during leisure time also increases [11]. Since cognitive abilities increase in adolescence, reflections and self-evaluations become more detailed and often more critical [12]. As a consequence, the time of adolescence is characterized by high self-awareness and self-criticism and thus, can result in high vulnerability especially with regard to social anxiety and social problems [7, 13].
Symptoms of social anxiety disorder are often stable through adolescence [14, 15] and can persist into adulthood [16]. Besides the risk of chronicity, there is a large amount of accompanying psychosocial risk that can hinder the psychological, emotional, and social development of adolescents [16–19]. Youths who suffer from social anxiety disorder often have problems at school or work and difficulties that are related to interactions with peers and intimate partners [20–25]. Moreover, comorbid disorders as depression, other anxiety disorders, and/or alcohol abuse often develop [16, 26–28]. As a consequence, socially anxious youths have a lower educational level, are more often unemployed, are less socially integrated, and are less often in partnerships compared to their healthy peers [16, 25, 29]. Because of these risks, an early and adequate identification as well as an appropriate intervention for social anxiety are desirable.
Beyond the characteristic symptoms of social anxiety disorder like intensive fear and avoidance of social situations on the basis of evaluation anxiety or anxiety of being in the focus of attention [30, 31], some patients also suffer from social competence deficits [32–35]. Social competence deficits can be unobservable, e.g., deficits in social cognition, regulation of attention, decoding and interpretation of information, empathy, and regulation of behavior, but can also be observable in motor and verbal behavior, e.g., frequency and duration of eye contact, gestures, and initialization of a conversation [36]. Adolescents with such deficits often worry about not meeting social expectations [21, 37]. Since peer relations are very important in adolescence [9], deficits in social competence might endanger important developmental progress by leading to difficulties in establishing and maintaining adequate social contacts.
Several studies have shown that youths with social anxiety disorder have less social competencies than healthy controls. These youths evaluated their own behavior worse than their peers and were rated more incompetent by independent observers. For example, Spence et al. [38] documented those children aged 7–14 years with social anxiety disorder seldom initialized social interactions, interacted less with others, and gave short answers. Inderbitzen-Nolan et al. [39] identified poorer evaluations of social anxious adolescents (12–16 years) than of their healthy partners during role play in different categories, e.g., self-confidence, social competence, and assertiveness. These results were replicated in the studies of Alfano et al. [40], Beidel et al. [41], and Miers et al. [35]. Difficulties in empathy and interpretation of facial expressions also were found in this group [40]. However, not all youths with social anxiety disorder showed social deficits [42–45]. Hence, differences in the frequency and occurrence of social competence deficits in youths with social anxiety disorder can be expected.
In clinical settings, the co-occurrence of social anxiety and social competence deficits is often observed; however, the presence of deficits is not an integral part of the diagnostic criteria for social anxiety disorder according to the ICD-10 or DSM IV [30, 31]. However, social competence deficits can maintain or exacerbate symptoms of this disorder; therefore, they should not be disregarded [36]. Since a significant relationship between the constellation of symptoms and the severity of the disorder must be assumed, an appropriate clarification about individually relevant symptoms prior to therapy is required [46]. Thus, at the beginning of therapy, it should be assessed if—and if yes, what type of—social deficits exist beyond symptoms of social anxiety. Only on this basis can an adequate and individual therapy with regard to duration, focus, and intensity of therapy be developed [47, 48], which in turn should lead to a better outcome.
Nowadays, social competence training is often provided as an optional part in manuals for the therapy of social anxiety disorder and as a consequence, is often integrated into therapy [47–49]. However, some studies have shown that such trainings are not always effective [50]. One reason for this finding can be seen in the general behavioral focus of social competence trainings [51], although different types of social problems in patients with social anxiety disorder (e.g., cognitive deficits, communication deficits, performance deficits) occur [36]. Moreover, the diagnostic basis of the decision to include or not to include a module with focus on social competence is difficult since an adequate measure of social deficits has not been available [52]. There are some well-accepted questionnaires for social anxiety disorder in youth [53, 54], for example the Social Anxiety Scale for Adolescents (SAS-A) [55], the Social Anxiety Scale for Children-Revised (SASC-R; La Greca) [55], the Social Phobia and Anxiety Inventory for Children (SPAI-C) [56], and the Social Anxiety and Avoidance Scale for Adolescents (SAASA) [57]. All of these mainly measure symptoms of anxiety, avoidant behavior, and dysfunctional cognitions; however, items regarding deficits in social competence are neglected. Thus, a questionnaire that explicitly measures such deficits and separates them from social anxiety has not yet been developed. Such an instrument would be essential for clinicians to be able to improve their decisions on whether competence training is warranted and if yes, what competencies should be emphasized. Hence, this type of instrument could improve current practices regarding therapeutic decisions.
A few years ago, Kolbeck and Maß [36] published the Questionnaire for Social Anxiety and Social Competence Deficits (SASKO) for adults as the component of deficits had also been lost [37]. The key feature of the SASKO is the separate measurement of social anxiety and social competence deficits as two distinct dimensions. The authors argued that social anxiety and social deficits interact with each other and thus cannot be regarded isolated. Rather, they should be considered as different components of social anxiety disorder [36]. This assumption aligns with the model of Wlazlo (1989; cited in Kolbeck and Maß [36]) who described social anxiety and social deficits as central components of the disorder. In addition, through the differentiation of behavioral and cognitive competencies within the deficit dimension, the SASKO allows a deeper insight into possible deficits [36].
As the SASKO has proved consistently good psychometric properties [36], it was adapted for use with adolescents (SASKO-J) [58]. The conceptual separation and the underlying five-factor structure of the questionnaire for adults (i.e., two anxiety scales, two deficit scales, and one additional scale that measures loneliness) has been confirmed for the SASKO-J [58]. The results of an unselected sample of 228 German students showed satisfactory to good consistencies (0.77 ≤ α ≤ 0.94) and retest-reliabilities (0.56 ≤ rtt ≤ 0.87) for the subscales and the total scale [58]. Additionally, in a sample of 115 German students, good convergent (0.39 ≤ r ≤ 0.80) and divergent (0.19 ≤ r ≤ 0.31) validity of the SASKO-J was documented for the total scale and the majority of subscales [58]. Thus, there is strong evidence that the questionnaire can be used with adolescent samples. However, because the SASKO-J was predominantly developed for application in patients, evaluation of its feasibility and diagnostic quality in clinical samples is still lacking.
In the first step of the present pilot study, the reliability and validity of the SASKO-J was tested in a mixed clinical sample1 of adolescents aged 12–19 years. Since the SASKO-J is supposed to improve the diagnosing of social anxiety disorder, it is important to examine its accuracy in differentiating individuals with or without social anxiety disorder. Thus, in the second step, we tested the sensitivity and the specificity of the SASKO-J. For this purpose, a specific clinical sample was recruited consisting only of adolescent patients who suffered from social anxiety disorder. Furthermore, a sample of non-selected high school students was assessed that provided the comparison sample. On this basis, a cutoff was computed to determine the critical value that allows an accurate classification and differentiation of adolescents with and without a possible social anxiety disorder diagnosis.
With regard to the first aim and based on the results from previous studies on the SASKO-J [58], we expected good reliability (internal consistency) of the SASKO-J in the mixed clinical sample. Furthermore, we assumed good convergent and divergent validity of the SASKO-J in this sample. We expected that the anxiety scales would be more strongly associated with the convergent measurement of social anxiety disorder than the deficit scales due to their conceptual similarity. With regard to the second aim, when comparing high school students (non-clinical sample) with adolescent patients (clinical social anxiety disorder sample), we assumed that the patients would have significantly higher scores on all scales of the SASKO-J than the students. Concerning the accuracy, we expected that the questionnaire would adequately discriminate between these two groups and present high sensitivity and specificity.
Methods
Participants and procedure
Clinical samples
The recruitment of adolescent patients was conducted from spring to autumn in 2013 via contacts with several psychotherapeutic/psychiatric clinics, outpatient services, and practices in different cities in the northern part of Germany. These institutions were considered to be common clinical settings for the treatment of adolescents with psychiatric disorders (e.g., social anxiety disorder). An information letter explaining the aim of the study was sent to all institutions. Moreover, further information was offered via a personal meeting. From the 100 institutions originally contacted, only 36 answered. From these, 19 institutions agreed to participate in the study. Seventeen institutions refused participation, e.g., for reasons of expected high work load. The particular assessment procedure varied slightly over the different institutions regarding the distribution and collection of questionnaires but the basics of the procedures were equal.
The questionnaires were taken to the institutions by the research assistant or were sent via post. The therapists in the institutions handed out the questionnaire package (four questionnaires) to their adolescent patients and then collected them. The patients completed the questionnaires during their therapeutic session. In the clinical settings, group tests were administered by the research assistant. The study was accepted by the Ethic Commission of the Psychological Institute of the University of Göttingen. Every full-age adolescent received an information letter and the informed consent, which they signed after agreeing to participate in the study. Parents of minors also received an information letter and the consent form. We guaranteed the data would be anonymous and that participants could resign in any phase of the study. Each therapist was asked to complete a short data entry form for each of his or her patients (information about diagnosis, process of diagnosis, type(s) of medication, length of psychotherapy, age, language, and IQ). Adolescents were included in the study if they were between 12 and 19 years old, had a psychiatric diagnosis, sufficient knowledge of the German language, and an IQ ≥85. In addition, patients diagnosed with social anxiety disorder were excluded if they took anxiolytic drugs.
In the first step of the study, we recruited a mixed clinical sample of adolescents. The final sample consisted of 85 adolescents (mixed clinical sample; mean age 15.71 years, SD = 1.92, range 12–19 years, 62.4 % girls). Almost half of the patients were in inpatient treatment (45.9 %), about one-third (37.6 %) in outpatient treatment, and 16.5 % in day care treatment. The diagnosis was based on the ICD-10 [31]. The majority of youths had an anxiety disorder (41.2 %, thereof, 17.6 % had a social anxiety disorder) as their main diagnosis; the second largest group showed an affective disorder (25.9 %). Another large group of adolescents showed a behavioral or emotional disorder with onset in childhood and adolescence (21.2 %; e.g., ADHD, conduct disorder, separation anxiety disorder). A disorder of the schizophrenic spectrum was presented by 8.2 %, and respectively 1 % of the sample showed anorexia nervosa, substance abuse, or dysfunctional impulse control as their main diagnosis. More than half of the patients presented a comorbid disorder (55.3 %). The diagnostic procedures varied in the different institutions, but all adolescents were diagnosed on the basis of an expert opinion. Half of them were additionally diagnosed through a diagnostic interview (e.g., K-DIPS, CIDI). Almost one-third of the patients (n = 28) were in pharmacological treatment at the time of assessment [16 antidepressants, 10 neuroleptics, and 1 anxiolytics (this patient did not suffer from social anxiety disorder); data were available only for n = 27]. Almost all adolescents (n = 84) attended psychotherapy; however, no statement about mean duration of therapy can be given as data was only available from half of the sample (50 %). Inpatients, outpatients, and patients in day care did not differ significantly with regard to age (0.39 < p < 0.55), sex (0.10 < p < 0.68), main diagnostic categories (anxiety disorders, affective disorders, disorders with onset in childhood; 0.06 < p < 0.75) or with regard to comorbidity (0.14 < p < 0.52). More inpatients than outpatients were in pharmacological treatment (p < 0.001), but the other groups did not differ significantly in this regard (ps ≥ 0.11).
Because only 15 of the 85 patients were diagnosed with social anxiety disorder in the mixed clinical sample, we restarted the recruitment to enlarge this subsample for our second aim. The procedure was comparable to that of the previous one. Finally, a total sample of 31 youths with social anxiety disorder was available (social anxiety disorder sample; mean age 16.1 years, SD = 1.54, range 12–19 years, 74.2 % girls). The majority (74 %) had social anxiety disorder (F40.1) as their main diagnosis and 10 % as a secondary. Five additional adolescents (16 %) had the diagnosis of social anxiety in childhood (F93.2). These youths are also referred to as socially anxious patients. Most of these adolescents (65 %) had a comorbid disorder. All therapists based the diagnosis on their expertise. In addition, more than half of the therapists (58.11 %) based their diagnoses on diagnostic interviews (e.g., K-DIPS, CIDI). Half of the sample was inpatients (51.6 %), more than one-third (38.7 %) were outpatients, and 9.7 % were in day care. The majority of adolescents (n = 29) were treated by psychotherapy with a mean duration of 29.62 weeks (SD = 36.09). Nine patients also underwent pharmacological treatment (7 antidepressants, 1 neuroleptic, and 1 psychostimulant).
Student sample
The procedure for the sample of students was similar to that of the clinical sample; however, we adapted the information letters and letters of agreement for this sample. This part of the study was also accepted by the Ethic Commission of the Psychological Department of the University of Göttingen. The nonclinical sample was recruited from two schools in northern Germany. Teachers and students in grades 7th to 11th were informed about the research project by the research assistant and were asked for cooperation. Students and their parents received an informed consent form. All students (n = 118) returned the signed consent form to their teachers. The package of four questionnaires was given to them one week later. After completing the questionnaires at home, they returned them to their teachers. Three students had to be excluded: one was out of the age range and two questionnaires were rated as invalid. The final sample consisted of 115 students (mean age 15.84, SD = 1.65, range 12–19 years, 61 % girls). The majority of students attended a grammar school2 (46 %) or a comprehensive school (44.3 %), whereas about 10 % visited a secondary general school or secondary modern school.
Measures
SASKO-J
The Questionnaire for Social Anxiety and Social Competence Deficits for Adolescents (SASKO-J) [58] is a German-language self-report measure for adolescents aged 12–19 years. It differentially measures social anxiety and social deficits. It consists of 44 items (4-point scale; 0 = never to 3 = always) that represent five factors. The two anxiety scales focus on fear of talking and fear of being in the focus of attention (TALK; 12 items: e.g., “I get nervous when I am the focus of attention”) and fear of rejection (REJECT; 10 items: e.g., “For me it is hard to make a fool of myself”). Two deficit scales include interaction deficits (INTERAC; 10 items: e.g., “For me it is difficult to have a casual conversation with others”) and information-processing deficits (INFORMAT; 8 items: e.g., “I don’t know how others see my behavior”). One additional scale measures loneliness (LONELY; 4 items: e.g., “I suffer from having little contact with others”). The LONELY scale is excluded from the total scale (40 items). The psychometric properties in a sample of German students were satisfying [58].
Validity measures
For the evaluation of the convergent validity, the German version of the Social Phobia and Anxiety Inventory for Children (SPAIK) [59] was used. It is an established self-report measurement consisting of 26 items that measure cognitive, behavioral, and somatic symptoms in the context of social anxiety (3-point scale; 0 = never to 2 = always). The items mainly focus on interaction and achievement situations. The SPAIK shows a good internal consistency and retest reliability as well as a good convergent and factorial validity [59, 60]. In the current study, the internal consistency of the total scale was very high in the mixed clinical sample (α = 0.96).
For the examination of the divergent validity, the German version of the Youth Self Report (YSR) [61] was used. It is a well-established self-report questionnaire for behavioral, emotional, and somatic symptoms in youths. The original version includes 112 items (3-point scale; 0 = not true to 2 = usually true), which can be divided into eight syndrome scales. Due to economic reasons, a shortened version of the YSR (YSR-K) was used in the present study. The YSR-K consists of 32 items and only a total score was calculated. Its psychometric properties had not been evaluated previously. However, the YSR mainly matches with the Child Behavior Checklist (CBCL) [62] as the corresponding parental questionnaire. The short form of the CBCL has been consistent in its applicability. Lemanek et al. [63] found good internal consistency for the internal and external scale. In addition, a satisfying relationship between the original and the shortened form was demonstrated [63]. In the present study, the internal consistency of the total score of the YSR-K in the mixed clinical sample was high (α = 0.88).
The Depression Inventory for Children and Adolescents (DIKJ) [64] served as an additional instrument for the evaluation of divergent validity. The DIKJ is a self-report questionnaire for the measurement of depressive symptoms in youths. It consists of 26 items and measures the occurrence of different symptoms on a 3-point scale (0 = symptom is non-existent to 2 = symptom is highly pronounced). The questionnaire has good psychometric properties [64]. In the present study, the internal consistency in the mixed clinical sample was very high (α = 0.91).
Statistical analyses
The statistical analyses were conducted using SPSS 20 for Windows. In all analyses, missing values were replaced by means. This procedure is acceptable as the frequencies of missing values in all samples were below 5 %. With regard to the validity measures, the mean scores of the total scales were used. The additional scale, LONELY, of the SASKO-J was considered in all analyses; however, in accordance to the procedure of Kolbeck [46] and Fernandez Castelao [58], it was not included in the computation of the total scale.
The means, standard deviations, mean item difficulties, indices of selectivity, and internal consistencies of the subscales of the SASKO-J are presented in Table 1. The internal consistency of the total scale was very high (α = 0.96) and the subscales showed good to very good reliabilities (0.80 ≤ α ≤ 0.91). The relationships among the subscales showed moderate relationships (between r = 0.42 and r = 0.65); their correlations with the total scale were higher (0.50 ≤ r ≤ 0.81).
Table 1
Characteristics and reliabilities of the subscales and the total scale of the SASKO-J
Scale
M (range)
SD
P
rit (i)
α
TALK
13.80 (0–31)
7.65
38.25
0.83
0.91
REJECT
12.10 (0–28)
6.95
40.20
0.78
0.90
INTERAC
8.87 (0–24)
5.74
29.50
0.82
0.85
INFORMAT
7.76 (0–17)
3.98
32.13
0.77
0.80
LONELY
3.19 (0–10)
3.01
26.57
0.66
0.83
TOTAL
42.52 (0–91)
21.82
35.02
0.80
0.96
Results are based on the mixed clinical sample (N = 85)
M mean, SD standard deviation, P mean item difficulty, rit(i) mean selectivity (part-whole corrected), α Cronbach’s alpha, TALK scale “fear of talking and fear of being in the focus of attention”, REJECT scale “fear of rejection”, INTERAC scale “interaction deficits”, INFORMAT scale “information-processing deficits”, LONELY scale “loneliness”, TOTAL total scale
Validity of the SASKO-J
The total scale and all subscales of the SASKO-J were significantly associated with the SPAIK total score (all p ≤ 0.01, see Table 2). The two anxiety scales TALK and REJECT showed very good (r = 0.80 and 0.90) convergent correlations. The relationships with the two deficit scales INTERAC and INFORMAT were lower (r = 0.76 and r = 0.68) but they still exceeded the critical value of r = 0.60 that characterizes a coefficient as satisfactory for convergent correlations [65]. The significant correlation with the additional scale, LONELY, was below the critical value (r = 0.54). To examine if the correlation coefficients of the anxiety and deficit scales differed significantly from each other, we calculated Fisher-Z transformations. All comparisons differed significantly with higher correlations for the anxiety scales (REJECT-SPAIK vs. INFORMAT-SPAIK: z = 1.887, p = 0.049; TALK-SPAIK vs. INTERAC-SPAIK: z = 3.560, p < 0.001; TALK-SPAIK vs. INFORMAT-SPAIK: z = 4.650, p < 0.001) except for the comparison REJECT-SPAIK vs. INTERAC-SPAIK (z = 0.618, p = 0.536).
Table 2
Correlations between the SASKO-J subscales and the validation instruments
Scale
Dimension
SPAIKa
YSR-Kb
DIKJb
TALK
Anxiety
0.902**
0.335**
0.426**
REJECT
Anxiety
0.795**
0.380**
0.483**
INTERAC
Deficit
0.760**
0.369**
0.462**
INFORMAT
Deficit
0.676**
0.356**
0.470**
LONELY
Additional scale
0.544**
0.296**
0.384**
TOTAL
Anxiety/deficit
0.885**
0.405**
0.511**
Results are based on the mixed clinical sample (N = 85)
TALK scale “fear of talking and fear of being in the focus of attention”, REJECT scale “fear of rejection”, INTERAC scale “interaction deficits”, INFORMAT scale “information-processing deficits”, LONELY scale “loneliness”, TOTAL total scale, SPAIK Social Anxiety Disorder and Anxiety Inventory for Children, YSR-K Youth Self Report-Short form, DIKJ Depression Inventory for Children and Adolescents
** p < 0.01
aCorrelation by Spearman-Rho (5 % level, two-sided)
bCorrelation by Kendall (5 % level, two-sided)
When assessing divergent validity, the total scale and all subscales of the SASKO-J were significantly associated with the divergent measures (all p ≤ 0.01, see Table 2). However, both anxiety scales showed coefficients below the recommended critical value of r < 0.40 for divergent correlations [66] with the YSR-K (r = 0.34, r = 0.38). This was also true for the subscale INFORMAT of the deficit measures (r = 0.36) and the additional scale, LONELY (r = 0.29). However, the INTERAC scale of the deficit dimension was barely above the critical threshold (INTERAC r = 0.40) as was the total scale (r = 0.41). With regard to the DIKJ, all scales of the SASKO-J except LONELY (r = 0.38) showed correlations slightly above the recommended cutoff (0.43 ≤ r ≤ 0.48).
Differences between the social anxiety disorder sample and the student sample
The patients with the diagnosis of social anxiety disorder showed significantly higher values in the SASKO-J total scale (M = 60.75, SD = 22.54, range 8–94) than the students (M = 29.85, SD = 14.69, range 2–83; t(35.77) = −7.52, p < 0.001, r = 0.64). We also found significant differences with regard to all subscales of the SASKO-J with effect sizes ranging from moderate to high (TALK: t(40) = −7.28, p < 0.001, r = 0.57; REJECT: t(40) = −5.78, p < 0.001, r = 0.48; INFORMAT: t(37.66) = −4.67, p < 0.001, r = 0.43; INTERAC: U = 382, z = −6.73, p < 0.001, r = −0.55; LONELY: U = 807, z = −4.82, p < 0.001, r = −0.39). The social anxiety disorder patients also showed significantly higher values in the SPAIK (M = 31.41, SD = 7.32, range 12–45) than the students (M = 11.49, SD = 7.49, range 0–35; t(133) = −12.04, p < 0.001, r = 0.72).
Sensitivity and specificity
Sensitivity and specificity were computed via receiver operating characteristic (ROC) analysis [67]. The main objective was to find a balanced cutoff value that would identify as many adolescents with social anxiety disorder as possible as true positives, and at the same time, indicate youths without social anxiety disorder as true negatives (the students were all considered as having no social anxiety disorder). A high area under the curve (AUC) indicates a high differentiating power [68]. To allow for best comparability with the adult version of the questionnaire, the results for the total scale and for all subscales of the SASKO-J are presented. Figure 1a shows the ROC-curve for the SASKO-J total scale with a good AUC [AUC = 0.866, 95 % CI (0.783, 0.950), p < 0.001]. The results for the subscales of the SASKO-J were similar (TALK: AUC = 0.856, p < 0.001; REJECT: AUC = 0.804, p < 0.001; INFORMAT: AUC = 0.782, p < 0.001; INTERAC: AUC = 0.893, p < 0.001; LONELY: AUC = 0.774, p < 0.001).
Fig. 1
a ROC-curve of the SASKO-J total scale with the complete student sample; b ROC-curve of the SASKO-J total scale after SPAIK selection of the student sample
On the basis of the coordinates of the ROC-curve and the consideration of the Youden-index [69], a cutoff value of 41.5 was suggested for the total scale (see Table 3). The sensitivity (0.806) and the specificity (0.826) were above the recommended value of 0.70 [46]. The absolute values of true and false decisions for the cutoff at 41.5 are presented in Table 4. With regard to the subscales, the sensitivities were between 0.613 (LONELY) and 0.839 (INFORMAT). The values of specificity ranged between 0.617 (INFORMAT) and 0.870 (TALK; LONELY). The cutoff values were the following: 16.5 (TALK), 11.5 (REJECT), 6.5 (INFORMAT), 8.5 (INTERAC), and 2.5 (LONELY).
Table 3
Coordinates of the ROC-Curves of the SASKO-J
SASKO-J without SPAIK selectiona
SASKO-J with SPAIK selectionb
Value
Sensitivity
1-Specificity
Youden index
Sensitivity
1-specificity
Youden index
39.5
0.806
0.271
0.535
0.806
0.137
0.669
40.5
0.806
0.191
0.615
0.806
0.105
0.701
41.5
0.806
0.174
0.632
0.806
0.084
0.722
42.5
0.774
0.157
0.617
0.774
0.063
0.681
43.5
0.742
0.148
0.594
0.742
0.063
0.679
The total scale of the SASKO-J was used for this computation
SPAIK Social Anxiety Disorder and Anxiety Inventory for Children
aOriginal sample of students: N = 115 students, N = 31 patients with social anxiety disorder
bSubsample of students who did not reach the cut-off in the SPAIK: N = 95 students, N = 31 patients with social anxiety disorder diagnosis
Table 4
Sensitivity and specificity: Hit rate of the SASKO-J
Patients (N = 31)
Studentsa (N = 115)
Studentsb (N = 95)
Cutoff 41.5
6 false positive (19 %)
95 true negative (83 %)
87 true negative (92 %)
25 true positive (81 %)
20 false negative (17 %)
8 false negative (8 %)
The total scale of the SASKO-J was used for this computation. All patients had a diagnosis of social anxiety disorder
aOriginal sample of students: N = 115 students
bSubsample of students who did not reach the cut-off in the SPAIK: N = 95 students
The underlying assumption of the above analysis, indicating that none of the students in the sample had a social anxiety disorder diagnosis, is questionable. Thus, we reanalyzed the sample by including only those students who scored under the critical value of 20 in the SPAIK (n = 95) [59]. Using this procedure, the AUC was somewhat higher than that in the first analysis [AUC = 0.896, 95 % CI (0.815, 0.975), p < 0.001]. Similar improvements were apparent with regard to the subscales (TALK: AUC = 0.888, p < 0.001; REJECT: AUC = 0.844, p < 0.001; INFORMAT: AUC = 0.805, p < 0.001; INTERAC: AUC = 0.913, p < 0.001; LONELY: AUC = 0.781, p < 0.001). The optimal cutoff-value was again located at 41.5 with equal sensitivity (0.806) but higher specificity (0.916; see Tables 3, 4). The corresponding values of accuracy for the subscales also increased with regard to specificity (0.789–0.926); the cutoff only changed for INFORMAT (from 6.5 to 8.5).
When applying the cutoff of 41.5 to the three samples of our study, the following percentages were found. In the subsample of patients with a social anxiety disorder diagnosis, 81 % were above the cutoff, whereas in the mixed clinical sample, there were only 53 % and in the student sample, only 17 % showed scores above the critical value.
Discussion
The aim of the present pilot study was (a) to assess the reliability and validity of the SASKO-J in a clinical sample, and (b) to examine its sensitivity and specificity as a diagnostic instrument. As expected, the internal consistencies of the total scale and subscales of the SASKO-J were all very good and provide initial evidence that the questionnaire is a reliable measuring instrument. Although the subscale INFORMAT showed an unsatisfying internal consistency in a sample of students [58], it seems to adequately measure deficits in information processing in our mixed clinical sample of adolescents. The total scale demonstrated a very good internal consistency (α = 0.96). Compared to the established measures we used for validation (SPAIK: α = 0.96; YSR-K and DIKJ: α = 0.88), the SASKO-J has an equal or even a slightly better internal consistency.
The scale inter-correlations are predominantly moderate and comparable to those of the study of Kolbeck [46] with adults. To ensure the intention of the SASKO-J (measuring different aspects of social anxiety disorder), we would have preferred lower inter-correlations between the subscales. However, since the different scales are thought to present different aspects of one underlying disorder, and since anxiety and deficits interact, this result is not surprising [36]. The interaction between those symptoms might play a significant role, particularly within a clinical sample, which could explain why Fernandez Castelao [58] found lower correlations in a student sample.
Regarding the total scale and subscales of the SASKO-J, the convergent validity was supported by the positive association with an established psychometric instrument for the assessment of social anxiety in youths, the SPAIK. When directly comparing the correlations of the anxiety and the deficit scales of the SASKO-J with the SPAIK, in three of the four cases, the correlations with the deficit scales were significantly lower than with the anxiety scales. Kolbeck [46] found similar results in her clinical sample of adults. However, it should be emphasized that there are no adequate instruments available to evaluate the convergent validity of the deficit scales.
In sum, the results regarding the convergent validity suggest that the conceptualization of social anxiety and social deficits as different dimensions of social anxiety disorder—which represents the conceptual basis of the SASKO [36]—is also true for adolescents. However, our findings should only be interpreted as an initial evidence of the validity of the described conceptualization since this study is a pilot. The reasons for the co-occurrence of social competence deficits and symptoms of social anxiety cannot clearly be specified yet. Other explanations for this co-occurrence are also possible, for example, the comorbidity with another disorder or environmental factors (e.g., the lack of experiences). Nonetheless, since anxiety as well as deficits can play an important role in social anxiety disorder, both aspects should be considered to guide intervention strategy decisions.
To evaluate the divergent validity, we computed correlations of the SASKO-J with two different established instruments. In accordance with the hypothesis, the correlation with the YSR-K was low enough to document an adequate divergent validity of the SASKO-J [66]. This finding is especially relevant as the YSR-K, in part, also measures anxiety and social aspects, for example, social insecurity and withdrawal, which overlap with some items of the SASKO-J. Regarding the DIKJ, a somewhat higher correlation was found. This result is not surprising when considering social anxiety and depressive symptoms are not independent constructs. Social anxiety disorder and depressive disorders show high comorbidity [19, 26, 70, 71]. In consideration of these circumstances, the documented associations reflect a sufficiently divergent validity of the SASKO-J.
In sum, the findings provide initial support for very good to good psychometric properties of the SASKO-J when applied in a mixed clinical sample. On this basis, we examined the diagnostic accuracy of the questionnaire in the next step.
As expected, the adolescents with diagnosis of social anxiety disorder showed significantly higher scores in the SASKO-J than the students. The ROC-curve analysis also demonstrated good classification accuracy. It yielded a cutoff of 41.5 resulting in high sensitivity (80 %) and high specificity (82 %), implying high rates of correctly identifying adolescents with social anxiety disorder and of correctly rejecting youths without this disorder. Thus, this pilot study suggests that the SASKO-J can support the clinical diagnostics of social anxiety disorder in the daily routine of therapists as an alternative or additional instrument. In contrast to existing measurements, it also focuses directly on social competence deficits. Moreover, in consideration of the values of sensitivity and specificity of other instruments [57, 59] the discriminant ability of the SASKO-J seems to be promising. After excluding those students from the sample, who according to their scores showed symptoms of social anxiety, the specificity of the SASKO-J increased even more to 91 %, indicating a further reduction of the rate of false positive decisions. However, it should be stressed that this exclusion may have resulted in an overestimation of sensitivity and specificity due to an artificially low ceiling of values in the sample of students. In sum, the findings of Kolbeck and Maß [36] with regard to the diagnostic accuracy are similar to that of the SASKO-J.
Since the total scale does not allow a statement about the individual constellation of anxiety and deficits, the cutoff values of the subscales should also be considered by clinicians for their therapy decisions [36]. This possibility of differentiated information is the main characteristic of the SASKO-J. The adequate assessment of different symptoms and deficits is especially important in adolescence since they can hinder important social interactions in this developmental stage [7, 9]. In addition, social anxiety disorder and accompanying problems in adolescence can lead to problems with peers and can finally result in loneliness. Loneliness in turn might play an especially significant role in the maintenance and chronicity of social anxiety disorder [9] and thus, should also be considered with regard to therapeutic decisions.
Strengths and limitations
One of the biggest strengths of this pilot study is that it provides first information about the psychometric qualities of a new diagnostic instrument. This instrument sets itself apart from existing social anxiety disorder measures by also focusing on social deficits. A further strength can be seen in the characteristics of the clinical samples. Since adolescents were recruited from different types of institutions in various cities, and differed in their comorbidities, the diversity of patients is well represented. Thus, the generalization of results to German adolescents (aged 12–19 years) with psychiatric diagnoses is possible.
The study also has limitations. The majority of youths from the mixed clinical sample did not have a diagnosis of social anxiety disorder but had other psychiatric disorders. Since the social anxiety disorder sample was too small, an adequate evaluation of psychometric properties in a “pure” social anxiety disorder sample was not possible. Thus, the generalization to individuals with social anxiety disorder is limited. Moreover, the study should be considered as a pilot study that provides only initial support for reliability and validity. Also, the quality of given diagnoses and with this, the results of the ROC curve and group differences, must be interpreted with caution since only half of the therapists based them on a clinical interview. Due to temporal and organizational reasons, it was not possible for the researchers to perform diagnostic interviews with the student sample. However, we reduced the possibility that many students were actually “hidden” social anxiety disorder patients by reanalyzing the ROC-curve after eliminating those showing high scores in the SPAIK. In addition, the duration of therapy and the fact that some patients were taking drugs could have influenced the level of symptoms and thus, the results. The results regarding convergent validity of the deficit scales must be interpreted with caution as no measures were used that examined social competence deficits.
Clinical implications and future research
The SASKO-J was developed to support the clinical diagnostics and the planning of therapy. Since different constellations of social anxiety and social deficits may implicate a different therapeutic approach, the explicit clarification of symptoms at an early point in treatment is desirable. It can offer recommendations for the focus of therapy, e.g., regarding the usefulness of specific social competence training, especially when considering that deficits in social skills and social cognition are related to a higher level of symptoms and adverse development of the disorder over time [72].
On the basis of the present results, future studies should evaluate the psychometric properties of the SASKO-J in a social anxiety disorder sample. In this context, the diagnostic accuracy should also be analyzed using a clinical sample in addition to that of a student sample and it should be assessed whether social anxiety disorder can be distinguished from other anxiety disorders. Moreover, the retest-reliability and the sensitivity for changes in symptomatology should be examined to document the questionnaire’s utility for the therapeutic process.
Conclusion
Past research has only marginally focused on social deficits within the context of social anxiety disorder; however, clear suggestions to clarify their existence can be found [46–48]. Nevertheless, appropriate diagnostic instruments have been missing [73]. Different diagnostic means, such as the observation of behavior in role play and behavioral experiments, provide information about the visual social performance but they do not offer insight into conscious and unconscious processes of social perception and cognition or information processing. Since these latter aspects are also important aspects of social competence deficits [46], they should not be neglected during the diagnostic process. These important aspects are part of the SASKO-J. Thus, the SASKO-J can be seen as a first step to close the gap between the theoretical consideration of two separate dimensions of social anxiety disorder and its practical implementation in the diagnostic and therapeutic process. The results of the present pilot study and the previous study [58] are promising but they offer only initial evidence to designate this questionnaire as a reliable, valid, and highly differentiating instrument. To draw a final conclusion, more comprehensive evidence is needed.
Since it was very difficult to recruit adolescents with social anxiety disorder, the corresponding sample was rather small. To obtain meaningful results, a mixed clinical sample was therefore used for analyses of reliability and validity.
In Germany, students attend grammar school from fifth to twelfth grade and finish with qualifications for university admission or matriculation. Students who attend a secondary general school do so from fifth to tenth grade and finish with the General Certificate of Secondary Education, which qualifies them for further education or job training. Graduation from a secondary modern school (grade 5 to grade 9) results in the Certificate of Secondary Education that allows for job training. A comprehensive school combines these types of schooling.
The results of reliability and validity refer to the mixed clinical sample (N = 85). For the computation of mean differences and the examination of sensitivity and specificity, the social anxiety disorder sample (N = 31) and the student sample (N = 115) were used.
Since the focus of the present paper was on the reliability and validity of the SASKO-J in a clinical sample, the results concerning the factor structure and the item characteristics are not presented here but can be requested from the corresponding author.
Declarations
Authors’ contributions
CFC and UR made substantial contributions to the conception and design of the study as well as to interpretation of data. CFC also drafted the manuscript. KN and SA collected the data and contributed to the statistical analyses and interpretation of data. BKH participated in the conception and design of the study and critically revised the manuscript. All authors read and approved the final manuscript.
Acknowledgements
This Research is supported by the Open Access Publication Funds of the University of Göttingen. We would like to thank the adolescents and the psychotherapists/psychiatrists for their participation in the study. Special thanks go to the authors of the SASKO, Sabine Kolbeck and Reinhard Maß, for their cooperation and valuable suggestions.
Compliance with ethical guidelines
Competing interests The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Authors’ Affiliations
(1)
Department of Clinical Psychology and Psychotherapy, Georg-August-University of Göttingen
References
Beidel DC, Bunnell BE. Assessment and treatment of social anxiety disorder and selective mutism in children and adolescents. Direct Psychiat. 2014;43:55–62.Google Scholar
Petermann F. Lehrbuch der Klinischen Kinderpsychologie [Textbook of clinical child psychology]. Göttingen: Hogrefe; 2013.Google Scholar
Rosselini AJ, Rutter LA, Bourgeois ML, Emmert-Aronson BO, Brown TA. The relevance of age of onset to the psychopathology of social phobia. J Psychopathol Behav Assess. 2013;35:356–65.View ArticleGoogle Scholar
Fehm L, Pelissolo A, Furmark T, Wittchen HU. Size and burden of social phobia in Europe. Eur Neuropsychopharmacol. 2005;15:453–62.View ArticlePubMedGoogle Scholar
Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey replication. Arch Gen Psychiatry. 2005;62:593–602.View ArticlePubMedGoogle Scholar
Schreiber F, Höfling V, Stangier U, Bohn C, Steil R. A cognitive model of social phobia: applicability in a large adolescent sample. Int J Cogn Ther. 2012;5:341–58.View ArticleGoogle Scholar
Blumenthal H, Leen-Feldner EW, Babson KA, Gahr JL, Trainor CD, Frala J. Elevated social anxiety among early maturing girls. Dev Psychol. 2011;47:1133–40.PubMed CentralView ArticlePubMedGoogle Scholar
Groen G, Petermann F. Depressive Kinder und Jugendliche [Depressive children and adolescents]. Göttingen: Hogrefe; 2002.Google Scholar
La Greca AM, Harrison HM. Adolescent peer relations, friendships, and romantic relationships: do they predict social anxiety and depression? J Clin Child Adolesc Psychol. 2005;34:49–61.View ArticlePubMedGoogle Scholar
Nangle DW, Erdley CA, Newman JE, Mason CA, Carpenter EM. Popularity, friendship quantity, and friendship quality: interactive influences on children’s loneliness and depression. J Clin Child Adolesc Psychol. 2003;32:546–55.View ArticlePubMedGoogle Scholar
Melfsen S, Warnke A. Soziale Phobie [Social phobia]. In: Schneider S, Margraf J, editors. Lehrbuch der Verhaltenstherapie. Band 3: Störungen im Kindes- und Jugendalter [Textbook of behavioral psychotherapy, vol. 3: Disorders in childhood and adolescence]. Heidelberg: Springer; 2009. p. 531–53.Google Scholar
Alfano CA, Beidel DC, Turner SM. Cognition in childhood anxiety: conceptual, methodological, and developmental issues. Clin Psychol Rev. 2002;22:1209–38.View ArticlePubMedGoogle Scholar
Deardorff J, Hayward C, Wilson KA, Bryson S, Hammer LD, Agras S. Puberty and gender interact to predict social anxiety symptoms in early adolescence. J Adolesc Health. 2007;41:102–4.PubMed CentralView ArticlePubMedGoogle Scholar
Nelemans SA, Hale WW, Branje SJT, Raaijmakers QAW, Frijns T, van Lier PAC, et al. Heterogeneity in development of adolescent anxiety disorder symptoms in an 8-year longitudinal community study. Dev Psychopathol. 2014;26:181–202.View ArticlePubMedGoogle Scholar
Wittchen HU, Stein MB, Kessler RC. Social fears and social phobia in a community sample of adolescents and young adults: prevalence, risk factors and co-morbidity. Psychol Med. 1999;29:309–23.View ArticlePubMedGoogle Scholar
Wittchen HU, Fehm L. Epidemiology and natural course of social fears and social phobia. Acta Psychiatr Scand. 2003;108:4–18.View ArticleGoogle Scholar
Hoyer J, Braeuera D, Crawcoura S, Klumbies E, Kirschbaum C. Depersonalization/derealization during acute social stress in social phobia. J Anxiety Disord. 2013;27:178–87.View ArticlePubMedGoogle Scholar
Stein MB, Kean YM. Disability and quality of life in social phobia: epidemiologic findings. Am J Psychiatry. 2000;157:1606–13.View ArticlePubMedGoogle Scholar
Wittchen HU, Fuetsch M, Sonntag H, Müller N, Liebowitz M. Disability and quality of life in pure and comorbid social phobia. Findings from a controlled study. Eur Psychiatry. 2000;15:46–58.View ArticlePubMedGoogle Scholar
Greco LA, Morris TL. Factors influencing the link between social anxiety and peer acceptance: contributions of social skills and close friendships during middle childhood. Behav Ther. 2005;36:197–205.View ArticleGoogle Scholar
Hebert KR, Fales J, Nangle DW, Papadakis AA, Grover R. Linking social anxiety and adolescent romantic relationship functioning: indirect effects and the importance of peers. J Youth Adolesc. 2013;42:1708–20.View ArticlePubMedGoogle Scholar
Mattejat F, Eimecke S, Pauschardt J. Ängste, Phobien und Kontaktstörungen [Anxiety, phobia, and contact disorders]. In: Esser G, editor. Lehrbuch der Klinischen Psychologie und Psychotherapie bei Kindern und Jugendlichen [Textbook of clinical psychology and psychotherapy in children and adolescents]. 4th ed. Stuttgart: Thieme; 2011. p. 211–42.Google Scholar
Ranta K, Kaltiala-Heino R, Rantanen P, Marttunen M. Social phobia in Finnish general adolescent population: prevalence, comorbidity, individual and family correlates, and service use. Depress Anxiety. 2009;26:528–36.PubMedGoogle Scholar
Rao PA, Beidel DC, Turner SM, Ammerman TR, Crosby LE, Sallee FR. Social anxiety disorder in childhood and adolescence: descriptive psychopathology. Behav Res Ther. 2007;45:189–201.View ArticleGoogle Scholar
Chartier MJ, Walker JR, Stein MB. Considering comorbidity in social phobia. Soc Psychiatry Psychiatr Epidemiol. 2003;38:728–34.View ArticlePubMedGoogle Scholar
Tomlinson KL, Cummins KM, Brown SA. Social anxiety and onset of drinking in early adolescence. J Child Adolesc Subst Abuse. 2013;22:163–77.PubMed CentralView ArticlePubMedGoogle Scholar
Zehe JM, Colder CR, Read JP, Wieczorek WF, Lengua LJ. Social and generalized anxiety symptoms and alcohol and cigarette use in early adolescence: the moderating role of perceived peer norms. Addict Behav. 2013;38:1931–9.PubMed CentralView ArticlePubMedGoogle Scholar
Kristensen H, Torgersen S. Is social anxiety disorder in childhood associated with developmental deficit/delay? Eur Child Adolesc Psychiatry. 2008;17:99–107.View ArticlePubMedGoogle Scholar
APA. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. DSM-IV-TR. 4th ed. Washington, DC: American Psychiatric Publishing; 2000.Google Scholar
World Health Organization, WHO. Tenth revision of the international classification of diseases, Chapter V(F): mental and behavioural disorders. Diagnostic Criteria for Research. Geneva: World Health Organization; 2006.Google Scholar
Banerjee R, Henderson L. Social-cognitive factors in childhood social anxiety: a preliminary investigation. Soc Dev. 2001;10:558–72.View ArticleGoogle Scholar
Beidel DC, Turner SM, Morris TL. Psychopathology of childhood social phobia. J Am Acad Child Adolesc Psychiatry. 1999;38:643–50.View ArticlePubMedGoogle Scholar
Simonian SJ, Beidel DC, Turner SM, Berkes J, Long JH. Recognition of facial affect by children and adolescents diagnosed with social phobia. Child Psychiatry Hum Dev. 2001;32:137–44.View ArticlePubMedGoogle Scholar
Miers AC, Blöte AW, Westenberg PM. Peer perceptions of social skills in socially anxious and nonanxious adolescents. J Abnorm Child Psychol. 2010;38:33–41.PubMed CentralView ArticlePubMedGoogle Scholar
Kolbeck S, Maß R. SASKO—Fragebogen zu sozialer Angst und sozialen Kompetenzdefiziten. Testmanual- und materialien [SASKO—Questionnaire for social anxiety and social competence deficits. Manual and material]. Göttingen: Hogrefe; 2009.Google Scholar
Fydrich T. Soziale Kompetenz und soziale Performanz bei Sozialer Phobie [Social competence and social performance in social phobia]. In: Stangier U, Fydrich T, editors. Soziale Phobie und Soziale Angststörung. Psychologische Grundlagen, Diagnostik und Therapie [Social phobia and social anxiety disorder. Psychological background, clinical diagnostics, and therapy]. Göttingen: Hogrefe; 2002. p. 181–203.Google Scholar
Spence SH, Donovan C, Brechman-Toussaint M. Social skills, social out-comes, and cognitive features of childhood social phobia. J Abnorm Psychol. 1999;108:211–21.View ArticlePubMedGoogle Scholar
Inderbitzen-Nolan HM, Anderson ER, Johnson HS. Subjective versus objective behavioral ratings following two analogue tasks: a comparison of socially phobic and non-anxious adolescents. J Anxiety Disord. 2007;21:76–90.View ArticlePubMedGoogle Scholar
Alfano CA, Beidel DC, Turner SM. Cognitive correlates of social phobia among children and adolescents. J Abnorm Child Psychol. 2006;34:182–94.View ArticleGoogle Scholar
Beidel DC, Turner SM, Young BJ, Ammerman RT, Sallee FR, Crosby L. Psychopathology of adolescent social phobia. J Psychopath Behav Assess. 2007;29:46–53.View ArticleGoogle Scholar
Cartwright-Hatton S, Tschernitz N, Gomersall H. Social anxiety in children: social skills deficit, or cognitive distortion? Behav Res Ther. 2005;43:131–41.View ArticlePubMedGoogle Scholar
Erath SA, Flanagan KS, Bierman KL. Social anxiety and peer relations in early adolescence: behavioral and cognitive factors. J Abnorm Child Psychol. 2007;35:405–16.View ArticlePubMedGoogle Scholar
Miers AC, Blöte AW, Bokhorst C, Westenberg MP. Negative self-evaluations and the relation to performance level in socially anxious children and adolescents. Behav Res Ther. 2009;47:1043–9.View ArticlePubMedGoogle Scholar
Morgan J, Banerjee R. Social anxiety and self-evaluation of social performance in a nonclinical sample of children. J Clin Child Adolesc Psychol. 2006;35:292–301.View ArticlePubMedGoogle Scholar
Kolbeck S. Zur psychometrischen Differenzierbarkeit von sozialen Ängsten und sozialen Defiziten. Eine empirische Studie an nichtklinischen und klinischen Stichproben [Toward the psychometric differentiability of social anxiety and social deficits. An empirical study on non-clinical and clinical sample]. Unpublished dissertation, Department of Psychology, University of Hamburg, Germany; 2008.Google Scholar
Melfsen S, Schwieger J, Kühnemund M, Stangier U, Stadler C, Poustka F, et al. Die Behandlung sozialer Ängste im Kindes- und Jugendalter [The therapy of social anxiety in childhood and adolescence]. Z Kinder Jug Psych. 2006;3:203–14.View ArticleGoogle Scholar
Scharfstein L. Behavioral and cognitive-behavioral treatments for youth with social phobia. J Exp Psychopath. 2011;2:615–28.View ArticleGoogle Scholar
Seligman LD, Ollendick TH. Cognitive behavioral therapy for anxiety disorders in youth. Child Adolesc Psychiatr Clin N Am. 2011;20:217–38.PubMed CentralView ArticlePubMedGoogle Scholar
Fedoroff IC, Taylor S. Psychological and pharmacological treatments of social phobia: a meta-analysis. J Clin Psychopharmacol. 2001;21:311–24.View ArticlePubMedGoogle Scholar
Öst LG, Cederlund R, Reuterskiöld L. Behavioral treatment of social phobia in youth: does parent education training improve the outcome? Behav Res Ther. 2015;67:19–29.View ArticlePubMedGoogle Scholar
Tulbure BT, Szentagotai A, Dobrean A, David D. Evidence based clinical assessment of child and adolescent social phobia: a critical review of rating scales. Child Psychiatry Hum Dev. 2012;43:795–820.View ArticlePubMedGoogle Scholar
Heidenreich T, Stangier U. Selbstbeurteilungsinstrumente und Verhaltensdiagnostik bei sozialer Phobie [Self-report measurements and diagnostic of behavior in social phobia]. In: Stangier U, Fydrich T, editors. Soziale Phobie und Soziale Angststörung. Psychologische Grundlagen, Diagnostik und Therapie [Social phobia and social anxiety disorder. Psychological basics, diagnostic, and therapy]). Göttingen: Hogrefe; 2002. p. 66–86.Google Scholar
Kuusikko S, Pollock-Wurman R, Ebeling H, Hurtig T, Joskitt L, Mattila ML, et al. Psychometric evaluation of social phobia and anxiety inventory for children (SPAI-C) and social anxiety scale for children-revised (SASC-R). Eur Child Adolesc Psychiatry. 2009;18:116–24.View ArticlePubMedGoogle Scholar
La Greca AM. Manual and instructions for the SASC, SASC-R, SAS-A (Adolescents), and parent versions of the scales. Coral Gables: University of Miami; 1999.Google Scholar
Beidel DC, Turner SM, Morris TL. Social phobia and anxiety inventory for children (SPAI-C). User´s manual. Multi-Health Systems Inc, North Tonawanda; 1998.Google Scholar
Cunha M, Gouveia JP, do Céu Salvador M. Social fears in adolescence. The Social Anxiety and Avoidance Scale for Adolescents. Eur Psychol. 2008;13:197–213.View ArticleGoogle Scholar
Fernandez Castelao C, Ruhl U, Janßen AL, Kolbeck S, Kröner-Herwig B, Hach I. An adaptation of the questionnaire for social anxiety and social competence deficits (SASKO) for adolescents and its evaluation in a German student sample. J Child Adolesc Behav. 2014;2:174.Google Scholar
Melfsen S, Florin I, Warnke A. Sozialphobie- und Angstinventar für Kinder (SPAIK) [Social phobia and anxiety inventory for children]. Göttingen: Hogrefe; 2001.Google Scholar
Ogliari A, Scaini S, Kofler MJ, Lampis V, Zanoni A, Pesenti-Gritti P, et al. Psychometric properties of the Social Phobia and Anxiety Inventory for Children (SPAI-C): a sample of Italian school-aged children from the general population. Eur J Psychol Assess. 2012;28:51–9.View ArticleGoogle Scholar
Achenbach TM. Manual for the youth self-report and 1991 profile. Burlington: Department of Psychiatry, University of Vermont; 1991.Google Scholar
Achenbach TM. Manual for the child behavior checklist/4–18 and 1991 profile. Burlington: Department of Psychiatry, University of Vermont; 1991.Google Scholar
Lemanek K, Moore S, Gresham FM, Williamson DA, Kelley ML. Psychological adjustment of children with sickle cell anemia. J Pediatr Psychol. 1986;11:397–410.View ArticlePubMedGoogle Scholar
Stiensmeier-Pelster J, Schürmann M, Duda K. Depressions-Inventar für Kinder und Jugendliche. Handanweisung und Fragebogen [Depression inventory for children and adolescents. Instruction and questionnaire]. 2nd ed. Göttingen: Hogrefe; 2000.Google Scholar
Lienert GA, Raatz U. Testaufbau und Testanalyse [Structure and analysis of tests]. 5th ed. Weinheim: Beltz; 1994.Google Scholar
Fisseni HJ. Lehrbuch der psychologischen Diagnostik: Mit Hinweisen zur Intervention [Textbook of psychological diagnostics: With advices for intervention]. 2nd ed. Göttingen: Hogrefe; 1997.Google Scholar
Mehdi T. Kernel smoothing for ROC curve and estimation for thyroid stimulating hormone. Int J Public Health Res. 2011; Special issue:239–242.Google Scholar
Cummings CM, Caporino NE, Kendall PC. Comorbidity of anxiety and depression in children and adolescents: 20 years after. Psychol Bull. 2014;140:816–45.PubMed CentralView ArticlePubMedGoogle Scholar
Kessler RC, Stang P, Wittchen HU, Stein MB, Walters EE. Lifetime comorbidities between social phobia and mood disorders in the US National Comorbidity Survey. Psychol Med. 1999;173:29–34.Google Scholar
Miers AC, Blöte AW, de Rooij M, Bokhorst CL, Westenberg PM. Trajectories of social anxiety during adolescence and relations with cognition, social competence, and temperament. J Abnorm Child Psychol. 2013;41:97–110.PubMed CentralView ArticlePubMedGoogle Scholar
Büch M, Döpfer M. Diagnostik von sozialen Ängsten [Clinical diagnostics of social anxiety]. In: Büch M, Döpfer M, editors. Soziale Ängste: Therapieprogramm für Kinder und Jugendliche mit Angst- und Zwangsstörung [Social anxiety: Therapy program for children and adolescents with anxiety and obsessive-compulsive disorder]. Göttingen: Hogrefe; 2011.Google Scholar
