Ethnic bias in the recognition of facial expressions

Ethnic bias in the recognition of facial expressions was assessed by having college students from the United States and Zambia assign emotion labels to facial expressions produced by imitation by United States and Zambian students. Bidirectional ethnic bias was revealed by the fact that Zambian raters labeled the Zambian facial expressions with less uncertainty than the U.S. facial expressions, and that U.S. raters labeled the U.S. facial expressions with less uncertainty than the Zambian facial expressions. In addition, the Facial Action Coding System was used to assess accuracy in the imitation of facial expressions. These results and the results of other analyses of recognition accuracy are reported.Portions of this paper were presented at the annual meeting of the Society for Cross-Cultural Research, Philadelphia, Pennsylvania, February 1980 (Note 1).     

The Effects of Early Institutionalization on the Discrimination of Facial Expressions of Emotion in Young Children

The current study examined the effects of institutionalization on the discrimination of facial expressions of emotion in three groups of 42‐month‐old children. One group consisted of children abandoned at birth who were randomly assigned to Care‐as‐Usual (institutional care) following a baseline assessment. Another group consisted of children abandoned at birth who were randomly assigned to high‐quality foster care following a baseline assessment. A third group consisted of never‐institutionalized children who were reared by their biological parents. All children were familiarized to happy, sad, fearful, and neutral facial expressions and tested on their ability to discriminate familiar versus novel facial expressions. Contrary to our prediction, all three groups of children were equally capable of discriminating among the different expressions. Furthermore, in contrast to findings at 13–30 months of age, these same children showed familiarity rather than novelty preferences toward different expressions. There were also asymmetries in children’s discrimination of facial expressions depending on which facial expression served as the familiar versus novel stimulus. Collectively, early institutionalization appears not to impact the development of the ability to discriminate facial expressions of emotion, at least when preferential looking serves as the dependent measure. These findings are discussed in the context of the myriad domains that are affected by early institutionalization.     

Maternal Sensitivity and Infant Emotional Reactivity

SUMMARY

Although the construct of infant reactivity is thought to be a temperamental dimension, investigators have been interested in the relation between emotional reactivity and maternal behaviors. In this study, infants' emotional reactivity to frustrating stimuli and maternal sensitivity and intrusiveness were observed at 5 and 10 months of age. Cluster analysis of infants' emotional expressions revealed three patterns of expressive behavior emerged at both ages: (1) frequent anger and negative (distress) expressions, (2) intense anger expressions, and (3) frequent happy expressions. Results demonstrated that patterns of emotional reactivity at 5 and 10 months differed by maternal interactive style. In addition, patterns of emotional reactivity at 10 months of age could be predicted by differences in maternal caregiving, and conversely, 5-month infant reactivity was predictive of 10-month maternal behavior. Conclusions are made regarding ways that mothers socialize emotions and the bi-directional nature of mother-infant interactions.     

Cross-Cultural Judgments of Spontaneous Facial Expressions of Emotion

We report data concerning cross-cultural judgments of emotion in spontaneously produced facial expressions. Americans, Japanese, British, and International Students in the US reliably attributed emotions to the expressions of Olympic judo athletes at the end of a match for a medal, and at two times during the subsequent medal ceremonies. There were some observer culture differences in absolute attribution agreement rates, but high cross-cultural agreement in differences in attribution rates across expressions (relative agreement rates). Moreover, we operationalized signal clarity and demonstrated that it was associated with agreement rates similarly in all cultures. Finally, we obtained judgments of won-lost match outcomes and medal finish, and demonstrated that the emotion judgments were associated with accuracy in judgments of outcomes. These findings demonstrated that members of different cultures reliably judge spontaneously expressed emotions, and that across observer cultures, lower absolute agreement rates are related to noise produced by non-emotional facial behaviors. Also, the findings suggested that observers of different cultures utilize the same facial cues when judging emotions, and that the signal value of facial expressions is similar across cultures.     

Does the Organization of Emotional Expression Change Over Time? Facial Expressivity From 4 to 12 Months

Differentiation models contend that the organization of facial expressivity increases during infancy. Accordingly, infants are believed to exhibit increasingly specific facial expressions in response to stimuli as a function of development. This study tested this hypothesis in a sample of 151 infants (83 boys and 68 girls) observed in 4 situations (tickle, sour taste, arm restraint, and masked stranger) at 4 and 12 months of age. Three of the 4 situations showed evidence of increasing specificity over time. In response to tickle, the number of infants exhibiting joy expressions increased and the number exhibiting interest, surprise, and surprise blends decreased from 4 to 12 months. In tasting a sour substance, more infants exhibited disgust and fewer exhibited joy and interest expressions, and fear and surprise blends over time. For arm restraint, more infants exhibited anger expressions and anger blends and fewer exhibited interest and surprise expressions and surprise blends over time. In response to a masked stranger, however, no evidence of increased specificity was found. Overall, these findings suggest that infants increasingly exhibit particular expressions in response to specific stimuli during the 1st year of life. These data provide partial support for the hypothesis that facial expressivity becomes increasingly organized over time.     

Multiple Messages: Facial Recognition Advantage for Compound Expressions

The impact of singular (e.g. sadness alone) and compound (e.g. sadness and anger together) facial expressions on individuals' recognition of faces was investigated. In three studies, a face recognition paradigm was used as a measure of the proficiency with which participants processed compound and singular facial expressions. For both positive and negative facial expressions, participants displayed greater proficiency in processing compound expressions relative to singular expressions. Specifically, the accuracy with which faces displaying compound expressions were recognized was significantly higher than the accuracy with which faces displaying singular expressions were recognized. Possible explanations involving the familiarity, distinctiveness, and salience of the facial expressions are discussed.     

The Mirror to Our Soul? Comparisons of Spontaneous and Posed Vocal Expression of Emotion

It has been the subject of much debate in the study of vocal expression of emotions whether posed expressions (e.g., actor portrayals) are different from spontaneous expressions. In the present investigation, we assembled a new database consisting of 1877 voice clips from 23 datasets, and used it to systematically compare spontaneous and posed expressions across 3 experiments. Results showed that (a) spontaneous expressions were generally rated as more genuinely emotional than were posed expressions, even when controlling for differences in emotion intensity, (b) there were differences between the two stimulus types with regard to their acoustic characteristics, and (c) spontaneous expressions with a high emotion intensity conveyed discrete emotions to listeners to a similar degree as has previously been found for posed expressions, supporting a dose–response relationship between intensity of expression and discreteness in perceived emotions. Our conclusion is that there are reliable differences between spontaneous and posed expressions, though not necessarily in the ways commonly assumed. Implications for emotion theories and the use of emotion portrayals in studies of vocal expression are discussed.     

The Nonverbal Decoding Ability of Children Exposed to Family Violence or Maltreatment: Prospective Evidence from a British Cohort

The prospective association between exposure to family violence or maltreatment in the first four years of life and nonverbal decoding ability at age 8.5 years was examined in a British birth cohort. Overall differences were very minor, except it was found that children exposed to maternal victimization were less accurate in decoding low intensity expressions of fear, than were children from nonviolent homes. Children from violent homes were also more likely to identify expressions of anger, fear, and sadness as happiness. Maltreated children showed a global deficit in decoding emotions, but only when presented as high intensity expressions. Whilst these results point to longitudinal associations between these variables, they do not discount the potential impact of third variables. Results are discussed in relation to current theoretical positions, and the need for further research.     

Emotion Recognition in Nonverbal Face-to-Face Communication

The perception of emotional facial expressions may activate corresponding facial muscles in the receiver, also referred to as facial mimicry. Facial mimicry is highly dependent on the context and type of facial expressions. While previous research almost exclusively investigated mimicry in response to pictures or videos of emotional expressions, studies with a real, face-to-face partner are still rare. Here we compared facial mimicry of angry, happy, and sad expressions and emotion recognition in a dyadic face-to-face setting. In sender-receiver dyads, we recorded facial electromyograms in parallel. Senders communicated to the receivers—with facial expressions only—the emotions felt during specific personal situations in the past, eliciting anger, happiness, or sadness. Receivers mostly mimicked happiness, to a lesser degree, sadness, and anger as the least mimicked emotion. In actor-partner interdependence models we showed that the receivers’ own facial activity influenced their ratings, which increased the agreement between the senders’ and receivers’ ratings for happiness, but not for angry and sad expressions. These results are in line with the Emotion Mimicry in Context View, holding that humans mimic happy expressions according to affiliative intentions. The mimicry of sad expressions is less intense, presumably because it signals empathy and might imply personal costs. Direct anger expressions are mimicked the least, possibly because anger communicates threat and aggression. Taken together, we show that incidental facial mimicry in a face-to-face setting is positively related to the recognition accuracy for non-stereotype happy expressions, supporting the functionality of facial mimicry.     

The effect of expression sequence and expressor identity on judgments of the intensity of facial expression

Subjects were exposed to a sequence of facial expression photographs to determine whether viewing earlier expressions in a sequence would alter intensity judgments of a final expression in the sequence. Results showed that whether the preceding expressions were shown by the same person who displayed the final expression, or different people, intensity ratings of both sad and happy final expressions were enhanced when preceded by a sequence of contrasting as opposed to similar or identical facial expressions. Results are discussed from the perspective of adaptation-level theory.     

Facial expressions of emotion influence interpersonal trait inferences

Theorists have argued that facial expressions of emotion serve the interpersonal function of allowing one animal to predict another's behavior. Humans may extend these predictions into the indefinite future, as in the case of trait inference. The hypothesis that facial expressions of emotion (e.g., anger, disgust, fear, happiness, and sadness) affect subjects' interpersonal trait inferences (e.g., dominance and affiliation) was tested in two experiments. Subjects rated the dispositional affiliation and dominance of target faces with either static or apparently moving expressions. They inferred high dominance and affiliation from happy expressions, high dominance and low affiliation from angry and disgusted expressions, and low dominance from fearful and sad expressions. The findings suggest that facial expressions of emotion convey not only a target's internal state, but also differentially convey interpersonal information, which could potentially seed trait inference.This article constitutes a portion of my dissertation research at Stanford University, which was supported by a National Science Foundation Fellowship and an American Psychological Association Dissertation Award. Thanks to Nancy Alvarado, Chris Dryer, Paul Ekman, Bertram Malle, Susan Nolen-Hoeksema, Steven Sutton, Robert Zajonc, and more anonymous reviewers than I can count on one hand for their comments.     

Motion Increases Recognition of Naturalistic Postures but not Facial Expressions

Journal of Nonverbal Behavior - Although emotion expressions are typically dynamic and include the whole person, much emotion recognition research uses static, posed facial expressions. In this...     

Judging Facial Emotion Expressions in Context: The Influence of Culture and Self-Construal Orientation

We assessed the impact of social context on the judgment of emotional facial expressions as a function of self-construal and decoding rules. German and Greek participants rated spontaneous emotional faces shown either alone or surrounded by other faces with congruent or incongruent facial expressions. Greek participants were higher in interdependence than German participants. In line with cultural decoding rules, Greek participants rated anger expressions less intensely and sad and disgust expressions more intensely. Social context affected the ratings by both groups in different ways. In the more interdependent culture (Greece) participants perceived anger least intensely when the group showed neutral expressions, whereas sadness expressions were rated as most intense in the absence of social context. In the independent culture (Germany) a group context (others expressing anger or happiness) additionally amplified the perception of angry and happy expressions. In line with the notion that these effects are mediated by more holistic processing linked to higher interdependence, this difference disappeared when we controlled for interdependence on the individual level. The findings confirm the usefulness of considering both country level and individual level factors when studying cultural differences.     

Recognition of Facial Expressions of Negative Emotions in Romantic Relationships

Previous research has demonstrated that individuals who were accurate at recognizing facial expressions of emotions reported better relationships with family and friends. The purpose of the present study was to test whether the ability to recognize facial expressions of negative emotions predicted greater relationship satisfaction with their romantic relationships and whether this link was mediated by constructive responses to conflict. Participants currently involved in a romantic relationship completed a validated performance measure of recognition of facial expressions and afterwards reported on the responses they engaged in during conflict with their romantic partner and rated their romantic relationship satisfaction. Results showed that accurate recognition of facial expressions of negative emotions (anger, contempt, disgust, fear, and sadness) predicted less conflict engaging behaviors during conflict with their romantic partners (but not positive problem solving and withdrawal), which in turn predicted greater relationship satisfaction. The present study is the first to show that the ability to recognize facial expressions of negative emotions is related to romantic relationship satisfaction and that constructive responses to conflict such as less conflict engaging behaviors, mediate this process.     

Emotional displays in children's television programming

The facial expressions of emotion and the circumstances under which the expressions occurred in a sample of the most popular children's television programs were investigated in this study. Fifteen-second randomly selected intervals from episodes of five television programs were analyzed for displays of happiness, sadness, anger, fear, disgust, and surprise. In addition, the contexts in which the emotions occurred were examined. Results indicated that particular emotional expressions occurred at significantly different frequencies and that there was an association between emotional displays and emotion-contexts. The high rate of emotional displays found in television shows has implications for the development of knowledge regarding emotional display rules in viewers.We are grateful to Sharon Galligan for assistance in coding part of the data and to Carolyn Saarni and Amy Halberstadt for helpful comments on an earlier draft of this paper. This research was supported in part by a grant from the National Institute of Disabilities and Rehabilitation Research, #GOO85351. The opinions expressed herein do not necessarily reflect the position or policy of the U.S. Department of Education.     

How Real is that Smile? Mood Effects on Accepting or Rejecting the Veracity of Emotional Facial Expressions

Does mood influence people’s tendency to accept observed facial expressions as genuine? Based on recent theories of affect and cognition, two experiments predicted and found that negative mood increased and positive mood decreased people’s skepticism about the genuineness of facial expressions. After a mood induction, participants viewed images of faces displaying (a) positive, neutral, and negative expressions (Exp. 1), or (b) displays of six specific emotions (Exp. 2). Judgments of genuineness, valence, and confidence ratings were collected. As predicted, positive affect increased, and negative affect decreased the perceived genuineness of facial expressions, and there was some evidence for affect-congruence in judgments. The relevance of these findings for everyday nonverbal communication and strategic interpersonal behavior are considered, and their implications for recent affect-cognition theories are discussed.     

Depressed and Well Mothers' Emotion Interpretation Accuracy and the Quality of Mother—Infant Interaction

The inadequate parenting associated with mothers' depression may be related to mothers' problems in interpreting infants' emotional expressions. The relations between depressed and well mothers' accuracy at interpreting babies' facial expressions and the quality of the mothers' interactions with their infants were examined. In partial support of our hypotheses, depressed mothers' level of depressive symptoms was associated with less accuracy, especially regarding positive emotions. Contrary to expectations, depressed mothers did not differ from well mothers in terms of their emotion accuracy. Furthermore, depressed mothers' accuracy at interpreting infants' emotions was not significantly related to the quality of their interaction with their infants; in contrast, well mothers' accuracy for infants' negative emotions was associated with better interaction quality. These findings provide new information about depressed mothers' emotional interpretations and their parenting. The different pattern of findings for depressed and well mothers suggests that other mediating factors are important, which are discussed.     

Spontaneous Facial Expressions Reveal New Action Units for the Sad Experiences

Facial expressions related to sadness are a universal signal of nonverbal communication. Although results of many psychology studies have shown that drooping of the lip corners, raising of the chin, and oblique eyebrow movements (a combination of inner brow raising and brow lowering) express sadness, no report has described a study elucidating facial expression characteristics under well-controlled circumstances with people actually experiencing the emotion of sadness itself. Therefore, spontaneous facial expressions associated with sadness remain unclear. We conducted this study to accumulate important findings related to spontaneous facial expressions of sadness. We recorded the spontaneous facial expressions of a group of participants as they experienced sadness during an emotion-elicitation task. This task required a participant to recall neutral and sad memories while listening to music. We subsequently conducted a detailed analysis of their sad and neutral expressions using the Facial Action Coding System. The prototypical facial expressions of sadness in earlier studies were not observed when people experienced sadness as an internal state under non-social circumstances. By contrast, they expressed tension around the mouth, which might function as a form of suppression. Furthermore, results show that parts of these facial actions are not only related to sad experiences but also to other emotional experiences such as disgust, fear, anger, and happiness. This study revealed the possibility that new facial expressions contribute to the experience of sadness as an internal state.     

Adult Perceptions of Positive and Negative Infant Emotional Expressions

Adults' perceptions provide information about the emotional meaning of infant facial expressions. This study asks whether similar facial movements influence adult perceptions of emotional intensity in both infant positive (smile) and negative (cry face) facial expressions. Ninety‐five college students rated a series of naturally occurring and digitally edited images of infant facial expressions. Naturally occurring smiles and cry faces involving the co‐occurrence of greater lip movement, mouth opening, and eye constriction, were rated as expressing stronger positive and negative emotion, respectively, than expressions without these 3 features. Ratings of digitally edited expressions indicated that eye constriction contributed to higher ratings of positive emotion in smiles (i.e., in Duchenne smiles) and greater eye constriction contributed to higher ratings of negative emotion in cry faces. Stronger mouth opening contributed to higher ratings of arousal in both smiles and cry faces. These findings indicate a set of similar facial movements are linked to perceptions of greater emotional intensity, whether the movements occur in positive or negative infant emotional expressions. This proposal is discussed with reference to discrete, componential, and dynamic systems theories of emotion.     

Mapping the boundaries of courtship disorder

The courtship disorder hypothesis maintains that voyeurism, exhibitionism, toucheurism‐frotteurism, and the preferential rape pattern are expressions of the same disorder (courtship disorder). Earlier studies had shown that with the exception of the preferential rape pattern these paraphilias co‐occur to a reasonably high degree. The present study (1) demonstrated that the preferential rape pattern co‐occurs with the above reasonably well established expressions of courtship disorder to a higher degree than other main paraphilic activity patterns do and (2) supported the conjecture that in addition to an erotic preference for unfamiliarity of target person‐or‐object (noted by earlier authors), three other paraphilic target‐person or object preferences may be connected with courtship disorder, though they are not at all virtually obligatory as is erotic unfamiliarity. These are choosing children and adults alike as target persons of the paraphilic activities, non‐gender dysphoric transvestism, and fetishism.