- Open Access
Misrecognition of facial expressions in delinquents
Child and Adolescent Psychiatry and Mental Health volume 3, Article number: 27 (2009)
Previous reports have suggested impairment in facial expression recognition in delinquents, but controversy remains with respect to how such recognition is impaired. To address this issue, we investigated facial expression recognition in delinquents in detail.
We tested 24 male adolescent/young adult delinquents incarcerated in correctional facilities. We compared their performances with those of 24 age- and gender-matched control participants. Using standard photographs of facial expressions illustrating six basic emotions, participants matched each emotional facial expression with an appropriate verbal label.
Delinquents were less accurate in the recognition of facial expressions that conveyed disgust than were control participants. The delinquents misrecognized the facial expressions of disgust as anger more frequently than did controls.
These results suggest that one of the underpinnings of delinquency might be impaired recognition of emotional facial expressions, with a specific bias toward interpreting disgusted expressions as hostile angry expressions.
In recent years, increasing attention has been focused on the high rate of delinquency, which is a serious social problem in some countries . To address this problem, it is important to clarify the psychological mechanisms underlying conduct problems in youths. Some clinical observations and questionnaire surveys have revealed deficits in emotional communication among children and adolescents with conduct problems (e.g., ).
One crucial component of emotional communication is the recognition of emotional facial expressions of other individuals. Facial expressions indicate moment-to-moment changes in inner emotional states  and/or communicative intentions . People often use the information communicated by emotional facial expressions as cues for modulating social behaviors . In particular, the recognition of others' facial expressions has been shown to modulate aggressive behaviors . This finding suggests that there may be a relationship between facial expression recognition and conduct problems involving aggression.
Consistent with this notion, some previous studies have revealed that delinquents are impaired in their recognition of facial expressions of emotion [7–9]. However, the types of emotion they have difficulty recognizing have not been clearly identified. For example, McCown et al.  investigated the recognition of facial expressions of six basic emotions (anger, disgust, fear, happiness, sadness, and surprise; cf. ) among incarcerated juvenile delinquents. They found that, compared with control youths, juvenile delinquents were less accurate in the recognition of facial expressions of disgust, sadness, and surprise. On the other hand, Cadesky et al.  investigated the recognition of facial and vocal expressions of anger, fear, happiness, and sadness in children with conduct problems. They reported that these children were impaired in the recognition of fear, happiness, and sadness. In summary, although the previous studies have consistently indicated the impairment of facial expression recognition in delinquents, it remains unclear whether there is a specific pattern of impairment.
Cadesky et al. , in their subsequent analysis, examined the error patterns that suggested poor emotion recognition among delinquent participants. By conducting visual inspections of their data, they found that participants with conduct problems tended to mislabel other emotions as anger. Because they did not conduct statistical analyses, their conclusion should be regarded as tentative. This finding, however, seems to provide an important clue regarding how delinquents misperceive others' emotional expressions. Several researchers have reported a similar tendency among children with conduct problems to misperceive benign social situations as hostile [10–12].
In the present study, we investigated facial expression recognition in adolescent/young adult delinquents in greater detail than have previous studies, comparing delinquents with age- and gender-matched controls. We examined participants' recognition of facial expressions conveying the six basic emotions previously examined by McCown et al.  and conducted error analyses for each emotion. We predicted that delinquents would recognize facial expressions of some emotions less accurately than would control participants, with a bias toward the misinterpretation of emotions as anger. Given that some previous studies have reported cultural differences in expression recognition (e.g., ), we used facial-expression stimuli from two different cultures.
Twenty-four male adolescent/young adult delinquents (mean age ± SD, 18.3 ± 1.3 years) participated in this study. They were incarcerated in two correctional facilities in Japan, A (n = 13) and H (n = 11). Statistical data have suggested that Japan's rate of delinquency is comparable to those of some Western countries (e.g., France) . In Japan, however, the proportion of delinquents who are incarcerated in correctional facilities is very low; in 2004, only 0.05% of delinquents who had been arrested were incarcerated in correctional facilities . The fact that the participants of this study were in correctional facilities indicates that they had severe conduct problems. Results of the Japanese version of the Child Behavior Checklist (CBCL) [15, 16] completed by their teachers have confirmed severe conduct problems in our participants (Table 1). We found no significant differences between the two facilities in subscale or total scores on the CBCL (t -test, P s > 0.1). The mean full-scale intelligence quotient (IQ) of these delinquents, measured by the revised Wechsler Adult Intelligence Scale (WAIS-R) or revised Wechsler Intelligence Scale for Children (WISC-R), was in the normal range (mean ± SD full-scale IQ = 85.1 ± 11.3; mean ± SD verbal IQ = 84.7 ± 10.9; mean ± SD performance IQ = 87.9 ± 11.6).
Twenty-four age- and gender-matched participants (mean age ± SD, 17.4 ± 3.5 years; t-test, t(46) = 1.54, P > 0.1; all males) served as controls. They were recruited through advertisements and participated in the experiment as volunteers. Their IQs were also measured by the WAIS-R or WISC-R (mean ± SD full-scale IQ = 108.6 ± 18.3; mean ± SD verbal IQ = 113.1 ± 21.8; mean ± SD performance IQ = 101.4 ± 13.8). The IQs of control participants were significantly higher than were those of delinquent participants (t(46) = 5.62, P < 0.001).
All participants were born in Japan, and their first language was Japanese. All participants had normal or corrected-to-normal visual acuity. All participants gave informed consent to participate in this study, which was conducted in accordance with the ethical provisions of the institution and the Declaration of Helsinki. No candidate refused to participate in the experiment.
A total of 48 photographs of facial expressions depicting six basic emotions (anger, disgust, fear, happiness, sadness, and surprise) were used as stimuli. Half of these pictures consisted of Caucasian models and the remaining half consisted of Japanese models. The pictures of Caucasian and Japanese models were chosen from the standard facial image sets of Ekman and Friesen  and Matsumoto and Ekman , respectively.
The events were controlled by SuperLab Pro 2.0 (Cedrus), implemented on a laptop Windows computer (Inspiron 8000, Dell).
A label-matching paradigm used by a previous neuropsychological study  was employed to assess recognition of facial expressions. Pictures of people whose faces expressed various emotions were presented on the monitor one by one in a random order. Verbal labels identifying the six basic emotions were presented next to each photograph. Participants were asked to select the label that best described the emotion shown in each photograph. They were instructed to consider all six alternatives carefully before responding. No time limits were set, and no feedback was provided about performance during the test trials. Participants saw each emotional expression eight times, resulting in a total of 48 trials for each participant.
To confirm adequate understanding of the emotional labels, we interviewed participants before testing began, asking them to provide examples of situations that would elicit each of the emotions. All participants were able to give appropriate examples without difficulty. After this interview, participants completed five practice trials to become familiarized with the procedure.
The data were analyzed using SPSS 10.0J (SPSS Japan). The percentages of accurate responses were analyzed with a 2 (group) × 6 (facial emotion) × 2 (stimulus type) design. Full-scale IQ and age were included in the analysis as covariates. To appropriately process the violation of the sphericity assumption for the repeated-measures design, data in the levels of the within-subjects independent variables were viewed as separate dependent variables, and a multivariate analysis of covariance (MANCOVA) was conducted (cf. ). For significant interactions related to the group factor, follow-up multivariate analyses of variance (MANOVAs) were conducted with Bonferroni's correction; the α level was divided by the number of statistical tests performed (i.e., 6 for facial emotions). The adjusted P values were reported (cf. ). Similar follow-up analyses were also conducted for other significant main effects and interactions. For these multivariate analyses, Wilks' λ criterion was used. The percentages of erroneous responses were analyzed for facial emotions that showed a significant effect of group. The percentage of erroneous responses for each emotional label was calculated as the rate of erroneously selected labels in all trials for that facial expression. Based on our prediction, a t-test comparing groups was conducted for selections of the anger label. Because the aforementioned follow-up MANOVAs on the accuracy of recognition did not show any significant interactions between group and stimulus type, the factor of stimulus type was collapsed.
The MANCOVA for the percentages of accurate responses (Table 2; Figure 1) revealed a significant interaction of group × facial emotion × stimulus type (F [5, 40] = 3.65, P < 0.01), which was the only significant effect found with respect to the group factor (cf. main effect of group: F [1, 44] = 1.44; interaction of group × facial emotion: F [5, 40] = 0.50; interaction of group × stimulus type: F [1, 44] = 1.89; P s > 0.1). We also found a significant main effect of emotion (F [5, 40] = 4.40, P < 0.005), a significant interaction of emotion × stimulus type × IQ (F [5, 40] = 2.68, P < 0.05), and a significant interaction of emotion × stimulus type × age (F [5, 40] = 3.30, P < 0.05). Trends toward significance were found for the main effect of age (F [1, 44] = 3.64, P < 0.1) and the interaction of emotion × stimulus type (F [5, 40] = 2.15, P < 0.1). Other main effects or interactions were not significant (P s > 0.1).
As follow-up analyses on the interaction of group × facial emotion × stimulus type, we conducted an analysis with the factors of group and stimulus type for each facial emotion using a MANOVA with Bonferroni's correction (α = 0.008). The results revealed that the main effect of group was significant for the facial expressions depicting disgust, indicating less accurate recognition in delinquents than in control participants (F [1, 46] = 8.93, adjusted P < 0.05). The main effect of stimulus type was also significant for expressions of disgust, indicating more accurate recognition in response to Caucasian than to Japanese faces (F [1, 46] = 8.96, adjusted P < 0.05). Other main effects or interactions were not significant (adjusted P s > 0.1).
Follow-up analyses were conducted for the main effect of facial emotion to clarify overall patterns of expression recognition. The Bonferroni-corrected (α = 0.003) MANOVAs showed the following significant differences (F s [1, 47] > 14.60, adjusted P s < 0.01): happy and surprised expressions were recognized with greater accuracy than were other expressions; sad and angry expressions were recognized with greater accuracy than were disgusted and fearful expressions.
To test whether additional factors influenced the recognition of facial expressions of disgust, follow-up analyses were conducted for the other significant three-way interactions. We conducted a two-way analysis with Bonferroni's correction (α = 0.008) for each facial emotion. For the interaction of facial emotion × stimulus type × IQ, the main effect of stimulus type and the interaction of stimulus type × IQ were significant for surprised expressions (F s [1, 46] = 15.27 and 14.44, respectively, adjusted P s < 0.01), and no other significant main effects or interactions were found (adjusted P s > 0.1). For the interaction of facial emotion × stimulus type × age, no significant main effects or interactions were found (adjusted P s > 0.1). In summary, factors other than group and stimulus type had no significant effect on the recognition of disgusted expressions.
The t-test showed that delinquents selected anger as the label to describe disgusted expressions more frequently than did control participants (Figure 2; t  = 2.30, P < 0.05).
Our results revealed that adolescent/young adult delinquent participants were less accurate in recognizing facial expressions of disgust than were control participants. The problems in the facial expression recognition among delinquents are consistent with findings of previous studies [7–9]. More specifically, the present results are consistent with a previous study in identifying impairment in the recognition of disgust . Despite methodological differences among studies, such as differences in the cultural background of participants, the present study is compatible with previous studies in suggesting that delinquents have impaired ability to recognize emotional facial expressions.
Our results on errors revealed that delinquents had a tendency to misrecognize facial expressions of disgust as anger. Although this type of error was also prominent in control participants, which is plausible because angry and disgusted facial expressions are similar with respect to featural changes and both express negative emotional states , delinquents showed a much greater tendency than did control participants to exhibit this misrecognition. Although the difference in error rates between groups was not large (17.2%), such errors can provide valuable information regarding impairments in expression recognition (e.g., ). This error pattern is consistent with the suggestion by Cadesky et al.  that children with conduct problems tend to perceive other emotions as anger. The present results also agree with previous reports that participants with conduct problems misperceived social situations as hostile [10–12], although those studies did not focus on the recognition of facial expressions. Extending these previous findings, the present study provides the first clear evidence that delinquents have a bias toward the misrecognition of others' disgusted expressions as anger.
Delinquents' misperception of facial expressions of disgust as anger is important when we consider the social functions of these emotions. Although both angry and disgusted facial expressions induce negative emotional states in perceivers, angry expressions induce higher arousal than do disgusted expressions . Furthermore, disgusted facial expressions suggest withdrawal motivation on the part of the sender, whereas angry expressions indicate approach motivation . Specifically, angry facial expressions imply the occurrence of subsequent hostile behaviors . These data suggest that the misrecognition of disgusted facial expressions as angry expressions might induce relatively more intense emotionally aroused states in the receiver, and might result in anticipation of relatively more dangerous behavior on the part of the sender than would accurate recognition. These misperceptions of facial expressions might therefore contribute to aggressive behaviors in delinquents.
The bias toward misrecognizing other emotions as anger is particularly significant because anger appears to play an important role in delinquency. It has been pointed out that children with conduct problems are quicker to become angry and their anger tends to be more intense . Plattner et al.  confirmed that delinquents experienced higher state and trait negative emotions, including anger, than did control participants. A previous self-report study also found that anger was the reason most often given for interpersonal delinquency . In addition, some previous studies reported that the perceivers' own emotional states influenced the recognition of others' emotional facial expressions (e.g., ). Taken together, the data suggest that delinquents might be projecting their own heightened angry emotions onto others when they misperceive others' negative, but not hostile, emotional states as anger.
Promising directions for further investigation include efforts to understand the developmental mechanisms for the impaired recognition of facial expressions in delinquents. One possible mechanism suggested by some studies involves a link between child maltreatment and subsequent delinquency [29, 30]. Interestingly, consistent with our finding, Pollak et al.  found that maltreated children demonstrated impaired recognition of facial expressions of disgust, along with a misrecognition bias toward anger. Also, in keeping with previous findings for delinquents [10–12], studies have shown that maltreated children exhibited a bias toward attributing hostile intent to others [32, 33]. The parallel between findings from these earlier studies and results of the present study suggest that impaired facial expression recognition in delinquents may be, at least in part, attributable to experiences of abuse during childhood.
Our results revealed differences in recognition accuracy in response to Caucasian and Japanese faces selected from standard stimulus sets [17, 18]. This result suggests the possibility that cultural differences underpinned the finding that facial expressions depicting disgust were accurately recognized more frequently in response to Caucasian rather than Japanese models among both Japanese delinquent and control participants. However, we must note that the stimuli differed not only with regard to cultural dimensions but also with regard to some other properties. For example, whereas Caucasian stimuli included both young and middle-aged models, Japanese stimuli consisted solely of young models. Future studies might be necessary to confirm the cultural differences in expression recognition among delinquents.
Some potential limitations in the present study must be acknowledged. First, the mean IQ of the delinquents in this study was near the bottom of the normal range, raising the possibility that these delinquents showed impaired expression recognition partly because the task was too difficult for them. However, the MANCOVA revealed no significant influence of IQ on group differences. Furthermore, there was no significant group difference with respect to the recognition of fear, which is generally the most difficult to correctly recognize among emotions (cf., ). Consistent with this finding, previous studies investigating expression recognition in individuals with subnormal intelligence did not find specific impairment in the recognition of facial expressions of disgust or a misrecognition bias toward angry expressions . These findings indicate that the impaired expression recognition in delinquents found in this study was attributable to a bias that was independent of intelligence level.
Second, the reaction times of responses were not recorded and analyzed in the present study. It is possible that different recognition performances derived from different cognitive processes, which could have been reflected in reaction times. Studies investigating reaction times will provide clues regarding the cognitive processes underlying expression recognition in delinquents.
Finally, confounding factors might have contributed to differences in expression recognition. For example, previous studies have shown that psychiatric disorders (e.g., schizophrenia ) and socio-economic status (e.g., economic disadvantages ) can influence expression recognition. In this study we were not able to access information on these issues due to the policies of the ministry that administrates the facilities. Furthermore, other studies have shown that the emotional states (e.g., state anxiety ) and personality traits (e.g., empathy ) of participants can affect expression recognition. These factors might have also influenced expression recognition in delinquents. Future research incorporating these factors should provide additional insights regarding expression recognition in delinquents.
In summary, we found that the adolescent/young adult delinquents were impaired in their recognition of facial expressions of disgust. Their error patterns showed that they had a tendency to misrecognize facial expressions depicting disgust as anger. These results suggest that one factor underlying delinquency might be impairment in understanding emotions communicated by disgusted facial expressions, especially a tendency toward hostile interpretations.
Research and Training Institute of the Ministry of Justice of Japan: White paper on crime 2005. 2005, Tokyo, Ministry of Justice of Japan
Cohen D, Strayer J: Empathy in conduct-disordered and comparison youth. Dev Psychol. 1996, 32: 988-998. 10.1037/0012-1622.214.171.1248.
Ekman P, Friesen WV: Unmasking the face: A guide to recognizing emotions from facial clues. 1975, Englewood Cliffs, Prentice-Hall
Fridlund A: The new ethology of human facial expressions. The psychology of facial expression. Edited by: Russell JA, Fernandez-Dols JM. 1997, New York, Cambridge University Press, 103-129.
Frijda NH: Facial expression processing. Aspects of Face Processing. Edited by: Ellis H, Jeeves MA, Newcombe F, Young A. 1986, Dordrecht, Martinus Nijhoff, 319-325.
Savitsky JC, Izard CE, Kotsch WE, Christy L: Aggressor's response to the victim's facial expression of emotion. J Res Pers. 1974, 7: 346-357. 10.1016/0092-6566(74)90056-7.
Cadesky EB, Mota VL, Schachar RJ: Beyond words: How do children with ADHD and/or conduct problems process nonverbal information about affect?. J Am Acad Child Adolesc Psychiatry. 2000, 39: 1160-1167. 10.1097/00004583-200009000-00016.
Carr MB, Lutjemeier JA: The relation of facial affect recognition and empathy to delinquency in youth offenders. Adolescence. 2005, 40: 601-619.
McCown W, Johnson J, Austin S: Inability of delinquents to recognize facial affect. J Soc Behav Pers. 1986, 1: 489-496.
Dodge KA, Price JM, Bachorowski J-A, Newman JP: Hostile attributional biases in severely aggressive adolescents. J Abnorm Psychol. 1990, 99: 385-392. 10.1037/0021-843X.99.4.385.
Halligan SL, Cooper PJ, Healy SJ, Murray L: The attribution of hostile intent in mothers, fathers and their children. J Abnorm Child Psychol. 2007, 35: 594-604. 10.1007/s10802-007-9115-6.
Nasby W, Hayden B, DePaulo BM: Attributional bias among aggressive boys to interpret unambiguous social stimuli as displays of hostility. J Abnorm Psychol. 1980, 89: 459-468. 10.1037/0021-843X.89.3.459.
Shioiri T, Someya T, Helmeste D, Tang SW: Misintepretation of facial expression: A cross-cultural study. Psychiatry Clin Neurosci. 1999, 53: 45-50. 10.1046/j.1440-1819.1999.00469.x.
Research and Training Institute of the Ministry of Justice of Japan: White paper on crime 1990. 1990, Tokyo, Ministry of Justice of Japan
Achenbach TM: Manual for the Child Behavior Checklist/4-18 and 1991 Profile. 1991, Burlington, University of Vermont, Department of Psychiatry
Itani T, Kanbayashi Y, Nakata Y, Kita M, Fujii H, Kuramoto H, Negishi T, Tezuka M, Okada A, Natori H: Standardization of the Japanse version of the Child Behavior Checklist/4-18. Seishin Shinkeigaku Zasshi. 2001, 41: 243-252.
Ekman P, Friesen WV: Pictures of Facial Affect. 1976, Palo Alto, Consulting Psychologist
Matsumoto D, Ekman P: Japanese and Caucasian facial expressions of emotion. 1988, San Francisco, Intercultural and Emotion Research Laboratory, Department of Psychology, San Francisco State University
Sato W, Kubota Y, Okada T, Murai T, Yoshikawa S, Sengoku A: Seeing happy emotion in fearful and angry faces: Qualitative analysis of the facial expression recognition in a bilateral amygdala damaged patient. Cortex. 2002, 38: 727-742. 10.1016/S0010-9452(08)70040-6.
Keselman HJ, Algina J, Kowalchuk RK: The analysis of repeated measures designs: A review. Br J Math Stat Psychol. 2001, 54: 1-20. 10.1348/000711001159357.
Wright SP: Adjusted p-values for simultaneous inference. Biometrics. 1992, 48: 1005-1013. 10.2307/2532694.
Johnsen BH, Thayer JF, Hugdahl K: Affective judgment of the Ekman faces: A dimensional approach. J Psychophysiol. 1995, 9: 193-202.
Coan JA, Allen JJ, Harmon-Jones E: Voluntary facial expression and hemispheric asymmetry over the frontal cortex. Psychophysiology. 2001, 38: 912-925. 10.1111/1469-8986.3860912.
Frijda NH, Tcherkassof A: Facial expressions as modes of action readiness. The Psychology of Facial Expression. Edited by: Russell JA, Fernandez-Dols JM. 1997, New York, Cambridge University Press, 78-102.
Cole PM, Zahn-Waxler C: Emotional dysregulation in disruptive behavior disorders. Developmental perspectives on depression. Edited by: Cicchetti D, Toth SL. 1992, Rochester, University of Rochester Press, 173-209.
Plattner B, Karnik N, Jo B, Hall RE, Schallauer A, Carrion V, Feucht M, Steiner H: State and trait emotions in delinquent adolescents. Child Psychiatry Hum Dev. 2007, 38: 155-169. 10.1007/s10578-007-0050-0.
Pfefferbaum B, Wood PB: Self-report study of impulsive and delinquent behavior in college students. J Adolesc Health. 1994, 15: 295-302. 10.1016/1054-139X(94)90602-5.
Richards A, French CC, Calder AJ, Webb B, Fox R, Young AW: Anxiety-related bias in the classification of emotionally ambiguous facial expressions. Emotion. 2002, 2: 273-287. 10.1037/1528-35126.96.36.1993.
Stouthamer-Loeber M, Loeber R, Homish DL, Wei E: Maltreatment of boys and the development of disruptive and delinquent behavior. Dev Psychopathol. 2001, 13: 941-955.
Wolfe DA, Scott K, Wekerle C, Pittman AL: Child maltreatment: Risk of adjustment problems and dating violence in adolescence. J Am Acad Child Adolesc Psychiatry. 2001, 40: 282-289. 10.1097/00004583-200103000-00007.
Pollak SD, Cicchetti D, Hornung K, Reed A: Recognizing emotion in faces: Developmental effects of child abuse and neglect. Dev Psychol. 2000, 35: 679-688. 10.1037/0012-16188.8.131.529.
Dodge KA, Bates JE, Pettit GS: Mechanisms in the cycle of violence. Science. 1990, 250: 1678-1683. 10.1126/science.2270481.
Price JM, Glad K: Hostile attributional tendencies in maltreated children. J Abnorm Child Psychol. 2003, 31: 329-343. 10.1023/A:1023237731683.
Rapcsak SZ, Galper SR, Comer JF, Reminger SL, Nielsen L, Kaszniak AW, Verfaellie M, Laguna JF, Labiner DM, Cohen RA: Fear recognition deficits after focal brain damage: A cautionary note. Neurology. 2000, 54: 575-581.
Rojahn J, Gerhards F, Matlock ST, Kroeger TL: Reliability and validity studies of the Facial Discrimination Task for emotion research. Psychiatry Res. 2000, 95: 169-181. 10.1016/S0165-1781(00)00169-4.
Fullam R, Dolan M: Emotional information processing in violent patients with schizophrenia: Association with psychopathy and symptomatology. Psychiatry Res. 2006, 141: 29-37. 10.1016/j.psychres.2005.07.013.
Smith M, Walden T: Developmental trends in emotion understanding among a diverse sample of African-American preschool children. J Appl Dev Psychol. 1998, 19: 177-197. 10.1016/S0193-3973(99)80035-5.
Marsh AA, Kozak MN, Ambady N: Accurate identification of fear facial expressions predicts prosocial behavior. Emotion. 2007, 7: 239-251. 10.1037/1528-35184.108.40.206.
This study was supported by funds from the Meiji Yasuda Mental Health Foundation and by a Research Fellowship of the Japan Society for the Promotion of Science.
The authors declare that they have no competing interests.
WS, NM, and MT designed this research. WS, SU, and NM collected the data. WS and SU analyzed data. WS, SU, and MT wrote the manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Sato, W., Uono, S., Matsuura, N. et al. Misrecognition of facial expressions in delinquents. Child Adolesc Psychiatry Ment Health 3, 27 (2009). https://doi.org/10.1186/1753-2000-3-27
- Conduct Problem
- Facial Expression
- Control Participant
- Stimulus Type
- Intelligence Quotient