Patterns of Nonverbal Behavior Associated with Truth and Deception: Illustrations from Three Experiments

The digital age has brought with it new and powerful computer-based methods of analyzing heretofore elusive patterns of nonverbal behavior. C-BAS (Meservy 2010) is a computer-assisted behavioral observation tool for identifying and tracking nonverbal behaviors from video. THEME (Magnusson, The hidden structure of interaction: from neurons to culture patterns, IOS Press, Amsterdam, pp 4–22, 2005) is a software program that discovers patterns among discrete events in time-ordered data. Together, these tools enable more precise measurement and analysis of nonverbal behavioral dynamics. Applications to three corpora derived from interpersonal deception experiments reveal unique nonverbal patterns that distinguish deceptive from nondeceptive interactions. The first and second experiments produced serial, hierarchically related patterns of behaviors that differed in length and complexity between truthful and deceptive participants during interviews about a theft and cheating, respectively. The third experiment produced differential patterns by and among group members completing a task. Deceivers were inclined toward strategic initiations and interactional control, whereas suspicious group members adopted a more passive, possibly watchful stance. Discovery of these patterns challenges the prevailing view that nonverbal behaviors are too faint and inconsistent to identify deceptive communication. Results have numerous implications regarding the following: the development of new measurement tools locating significant effects of nonverbal behaviors, support for theory that coherent and repetitive relationships exist within and among interactants’ communication, demonstration of the role of nonverbal behaviors in deceptive communication and the dynamic and strategic nature of deception.     

Nonverbal Behavior in the Digital Age: Explorations in Internet Social Communication

This Special Issue of the Journal of Nonverbal Behavior explores nonverbal issues in the digital age, with an emphasis on how information is communicated and received on social networking sites such as Facebook. In addition to showing that a variety of user characteristics play an important role in the exchange of information, the featured articles also reveal the impact of different types of nonverbal cues individuals use to create and manage impressions.     

Nonverbal cues to deception among intimates,friends, and strangers

Buller and Burgoon (in press) propose that deceivers attempt to encode strategically nonverbal cues which indicate nonimmediacy and project a positive image. At the same time, deceivers leak arousal and negative affect via their nonverbal display. This experiment tested these predictions, while examining the influence of relational history on deception cues and the stability of deception cues within deceptive conversations. The nonverbal behavior of 130 strangers, friends, and intimates was measured. Results indicated that deceivers signalled nonimmediacy, arousal, and negative affect, but they did not appear to project a positive image. Deception cues were mediated by relational history and showed considerable temporal variation. Strangers leaked more arousal and negative affect than friends and intimates. Further, deceivers, particularly deceiving friends and intimates, seemed to monitor and control their nonverbal behavior during deception by suppressing arousal and negative affect cues and moderating nonimmediate behavior.     

Nonverbal exchange: Past,present, and future

This paper provides a broad review and evaluation of the research on nonverbal exchange. The development of theoretical approaches to this research is traced over time and discussed. Relative strengths and weaknesses of past and present models are analyzed. Finally, specific recommendations are made for future research that will, we hope, extend our understanding of nonverbal exchange and its basic role in social interaction.     

The Interaction of Sex,Verbal, and Nonverbal Cues in Same-Sex First Encounters

This experiment examined sex differences in responses to various combinations of verbal and nonverbal content during a same-sex interaction. Fifty men and thirty women participated in a same-sex interview task with a confederate posing as another participant. Confederates disclosed either superficial or emotional information, and they faced away from or toward the participant, when answering questions. Results revealed that men attended to verbal information to evaluate the appropriateness of their own personal disclosure, whereas women attended to both verbal and nonverbal cues to evaluate the conversation partner and the appropriateness of their own personal disclosure.     

Patterns of Nonverbal Behavior and Sensivity in the Context of Attachment Relations

Nonverbal behavior and sensitivity to a relationship partner’s nonverbal behavior importantly influence the quality of interpersonal interactions and relationships, including attachment relationships. The abilities to encode, or express, and to decode, or understand, nonverbal cues are crucial to effective communication of emotions and are associated with social adjustment and relationship satisfaction. One important social context for the development and use of nonverbal encodingand decoding abilities is what Bowlby (1969/1982, Attachment and loss: Vol.1.Attachment (2nd ed.). New York: Basic Books) called attachment relationships—interpersonal relationships in which one person’s emotional security depends on another person’s sensitive, responsive caregiving and support. In this paper, we present theoretical ideas, review relevant research, and propose new avenues of research dealing with associations between attachment-related processes and patterns of nonverbal behavior and sensitivity in adulthood, two domains of research that have not previously been adequately connected.     

Nonverbal behaviors as indices of arousal: Extension to the psychotherapy context

In an investigation guided by the premise that overt nonverbal indices may often be practical and valid indicators of arousal, Burgoon, Kelley, Newton, and Keeley-Dyreson (1989) found different nonverbal behaviors associated with arousal intensity and with positively and negatively valenced arousal. The current investigation extends that research to a new context, examining (1) the ability of a global measure of observed arousal and specific nonverbal indices of arousal intensity and valence to detect presumed nonlinear arousal changes during psychotherapy, (2) the differential impact of nonverbal indicators across phases of a therapy session, and (3) the relationship of nonverbal indicators to therapy outcome. Raters judged all-channel global arousal or specific kinesic and vocalic nonverbal behaviors during Focused Expressive Psychotherapy (FEP) sessions, during which high levels of negative arousal are evoked. Manifest global arousal, random movement/self-adaptors, and kinesic pleasantness conformed to hypothesized nonlinear patterns across time within therapy sessions. Nonverbal correlates of manifest global arousal varied across therapy phases. Moderate manifest arousal, especially random movement/self-adaptors and vocal tension, and high vocal expressiveness during the middle of the therapy work session were most predictive of patients' self-reported resolution at the end of therapy.Portions of this research were supported through grant no. MH-R01-39859 from the National Institute of Mental Health and were presented in an earlier version to the annual meeting of the Speech Communication Association, Chicago, November 1990.     

Nonverbal Social Sensing in Action: Unobtrusive Recording and Extracting of Nonverbal Behavior in Social Interactions Illustrated with a Research Example

Nonverbal behavior coding is typically conducted by “hand”. To remedy this time and resource intensive undertaking, we illustrate how nonverbal social sensing, defined as the automated recording and extracting of nonverbal behavior via ubiquitous social sensing platforms, can be achieved. More precisely, we show how and what kind of nonverbal cues can be extracted and to what extent automated extracted nonverbal cues can be validly obtained with an illustrative research example. In a job interview, the applicant’s vocal and visual nonverbal immediacy behavior was automatically sensed and extracted. Results show that the applicant’s nonverbal behavior can be validly extracted. Moreover, both visual and vocal applicant nonverbal behavior predict recruiter hiring decision, which is in line with previous findings on manually coded applicant nonverbal behavior. Finally, applicant average turn duration, tempo variation, and gazing best predict recruiter hiring decision. Results and implications of such a nonverbal social sensing for future research are discussed.     

Social Presence, Embarrassment, and Nonverbal Behavior

Nonverbal behaviors in response to viewing slides depicting nude males, nude females, erotic couples and neutral pictures, either alone or in the presence of two unfamiliar individuals, were studied in 22 female and 16 male university students. Participants were unaware of being videorecorded. Results revealed discrepancies between self-reported embarrassment and nonverbal behaviors supposedly expressive of embarrassment. Although self-reported embarrassment was higher when certain types of slides were viewed in the presence of others than when they were viewed alone, we observed significantly fewer lip movements, gaze shifts, face touches, downward gazes, and downward head movements in the presence of unfamiliar individuals than in the alone condition. We also compared behaviors during slide exposure and during the inter-slide intervals. For 9 out of 11 coded behaviors, frequencies were significantly higher during inter-slide intervals than during slide presentation. We argue that this is probably due to the fact that visual attention to the slides inhibited nonverbal behaviors. The results cast doubt on the possibility of inferring the internal state of an emotion such as embarrassment by analyzing nonverbal behaviors without taking account of the social setting in which such observations are made.     

KNOWLEDGE OF NONVERBAL CUES,GENDER, AND NONVERBAL DECODING ACCURACY

The Test of Nonverbal Cue Knowledge (TONCK), a paper and pencil test measuring explicit knowledge of nonverbal cue meanings and uses, was developed and found to be reliable and to have predictive ability. In four studies, participants were given the TONCK and one or more tests of accuracy in decoding nonverbal cues the adult faces and voices tests of the Diagnostic Analysis of Nonverbal Accuracy 2 (DANVA) and the video and audio tests of the Profile of Nonverbal Sensitivity (PONS), as well as a test of general cognitive ability (the Wonderlic Personnel Test). Results are reported for the four studies individually and also in a meta-analytic summary. Females scored higher than males on the TONCK and on the PONS, and the TONCK predicted accuracy on the PONS and DANVA. Knowledge of nonverbal cues did not account for the gender difference in decoding ability on the PONS. Cognitive ability was related to the TONCK but did not compromise relations with other variables. The future utility of the TONCK, content specificity of tests, as well as the automaticity of judging cues are discussed.The authors thank Crystal Mileti, Jenna Lavery, Erica Dempsey, and Jared Majerle for their assistance in conducting this research.     

FROM TEXT TO GESTURE ONLINE: A microethnographic analysis of nonverbal communication in the Second Life virtual environment

A transition from text-based computer-mediated communication (CMC) to online interaction that includes both textual and nonverbal discourse represents a new development in online communication and a significant challenge to prevailing models for the analysis of CMC. This paper presents results of a six-month-long ethnographic research of nonverbal communication (NVC) in the Second Life (SL) virtual environment. A set of 108 SL locations selected in a non-structured manner provided a wide range of communicative contexts for the analysis of naturally occurring user interaction. The study was focused on the analysis of proxemic and kinesic cues. The results have pointed to a significant difference between user-defined and predefined nonverbal cues, indicating that user-defined NVC has stronger potential to enhance online interaction.     

Nonverbal expressiveness and physical attractiveness as mediators of interpersonal perceptions

This research examines the impact of spontaneous nonverbal expressiveness and physical attractiveness on the formation of initial interpersonal impressions. It was hypothesized that in the absence of a relationship history with a person, those people who provide more spontaneous, uncensored, nonverbal information would be viewed as more interpersonally attractive. In addition, as a secondary focus of the study, data were analyzed to examine the relationship between physical attractiveness and nonverbal communication abilities. Results suggest that both physical attractiveness and nonverbal expressiveness independent of one another and in conjunction with one another positively impact on interpersonal perceptions. In addition, physical attractiveness was found to positively covary with nonverbal encoding accuracy but negatively covary with nonverbal decoding abilities.The authors wish to express their appreciation to Ross Buck and Robert Ryder for their helpful comments on an earlier draft of the paper.     

Automatically Detected Nonverbal Behavior Predicts Creativity in Collaborating Dyads

In the current study we administered a creative task in which two people collaboratively generated novel strategies to conserve resources. During this task, the nonverbal behavior of 104 participants in 52 pairs was tracked and recorded using the Kinect computer vision algorithm. We created a measure of synchrony by correlating movements between the two dyad members, and showed that synchrony occurred—that is, correlations decreased when we increased delay between the recorded movements of pair members. We also demonstrated a link between nonverbal synchrony and creativity, as operationalized by the number of new, valid ideas produced. Linear correlations demonstrated a significant relationship between synchrony and creativity. Finally, models using synchrony scores as input predicted whether dyads were high or low in creativity with a success rate as high as 86.7 % in the more exclusive subsets. We discuss implications for methodological approaches to measuring nonverbal behavior and synchrony, and suggest practical applications which can leverage the current findings.     

Intentionality behind nonverbal messages: A perceiver's perspective

This paper examines the ways in which people decide whether or not a nonverbal message is intentional. It was predicted that judgments of intentionality would be biased by an interactant's desire to protect his or her self image. Participants (N=163) in the study went to banks and discussed new accounts with an employee. They were then asked by a confederate to discuss the nonverbal messages perceived to be sent by the employee. The results indicated that respondents reported messages accompanied by attributions of intent at a rate greater than chance. In addition, positively labeled nonverbal messages usually received interpretations of intentionality. Negative messages were viewed most often as unintentional. In those instances where negative messages were seen as intentional, participants said that the employee had strong external pressures to act in a negative manner.The authors wish to thank reviewers Michael Motley and Patricia Noller for their helpful comments on earlier versions of this paper.     

A test among models of nonverbal immediacy reactions: Arousal-labeling,discrepancy-arousal,and social cognition

Individuals may respond to an increase in nonverbal immediacy by either increasing or decreasing the immediacy of their own behavior. To account for this, a number of models have been proposed, including arousal-labeling (Patterson, 1976), discrepancy-arousal (Cappella & Greene, 1982), and social cognition (e.g., Ellsworth, 1978). An experiment was designed to test the social cognition approach and, when combined with findings of previous studies, to serve as a test among three models. Individual male subjects discussed a moral dilemma with a male confederate at a seating distance of either 1.1 m (control group) or 0.3 m in two experimental groups (confederate intentional-close and confederate forced-close). Subjects in both experimental conditions showed less immediate nonverbal behavior, but only subjects in the intentional-close condition evaluated the confederate more negatively than subjects in the control group. These results, when combined with past research findings, suggest that social cognition alone may determine whether nonverbal compensation or reciprocation will occur, and that arousal-based explanations may be unnecessary. Other self-report findings of the study, however, create difficulties for all three models of nonverbal exchange.We thank Paul Baker, Larry Coutts, David Gartrell, Leslie Hayduk, Ron Hoppe, Eric Knowles, G. Alexander Milton, and an anonymous reviewer for their comments on earlier drafts.     

Rapport expressed through nonverbal behavior

Family Medicine residents were videotaped in interviews with a new and a return-visit patient. Two coders recorded nonverbal behavior performed by the residents for two, one-minute segments of each interview. Categories of movement included: proxemic behaviors of distance, orientation, and trunk lean, and head, hand/arm, and leg/foot movement, facial expression, and direction of gaze.Each of the 36 video segments were rated by a group of psychiatric nurses using bipolar adjective scales assessing dimensions of rapport. Significant differences in nonverbal behavior were found between high and low rapport doctors. Physicians were rated more positively when they sat directly facing the patient, with uncrossed legs, and arms in symmetrical, side-by-side positions. High rapport doctors also engaged in moderate, but less extensive eye contact, with the patient than low rapport doctors. Discussion focuses on the impact of nonverbal behavior on physician-patient communication and the establishment of rapport.This research was supported in part by a grant from the Department of Health and Human Services.     

Beyond words: Older people with dementia using and interpreting nonverbal behaviour

This article addresses a gap in research on nonverbal communication and dementia. It presents findings from a study that explored ways in which older people with dementia used and interpreted nonverbal behaviour within the context of social interactions. Two researchers, using an ethnographic approach, jointly observed nonverbal communicative behaviours occurring in a day-care centre. The findings show that older people with dementia used nonverbal behaviour in meaningful ways for others to interpret, and as a way of self-communication; and that they actively interpreted others' nonverbal behaviour. In specific situations, these people acted in the context of shared meanings, possessed a ‘self’, and took on the ‘role’ of others. This approach has implications for understanding the social experience of dementia and for the ways that care is organised. The role of nonverbal behaviour offers potential for carers to preserve older people's self-identity and improve their quality of life and care.     

The Power of a 😉: Emojis Reducing Ambiguity in Digitally Mediated Romantic Encounters

Digital technology has long provided new ways of initiating romantic relationships as people communicate through text messages, social media, and dating applications. Emojis have been widely adopted as a means of conveying nonverbal cues in digital communication. However, what role do platform-provided social cues, such as emojis, play in fostering or impeding clear communication and shared romantic expectations from a flirtatious text message conversation? In this study, 713 college students were randomly assigned to read a Snapchat conversation with or without emojis and, they were subsequently asked to infer the characters' thoughts and feelings, clarity of the characters' intentions, and indicate their own discomfort with receiving a similar Snapchat message. The results showed that emojis increase the clarity of the main character's intentions. Moreover, the participants' cognitive efforts, the extent to which they were emotionally affected by the conversation, and the presence of emojis reduced comfort level with receiving a similar Snapchat message. These findings suggest that emojis provide clarity to romantic conversations, which can amplify the interpersonal discomfort of receiving text-based sexual overtures.     

Outspoken Objects and Unspoken Myths: The Semiotics of Object-Mediated Communication

This interactionist study draws on the semiotics of Peirce and Barthes to theorize object-mediated communication, a nonverbal interpersonal technique in which individuals signal new information by using and orienting themselves to symbolically endowed material objects. Examining the case of door-mediated communication, it proposes that objects lie symbolically dormant until their deeper collective significance is activated through their use in interaction. The article expands the scope of interactionist inquiry on human–nonhuman relations by moving beyond the dominant scholarly focus on identity. The semiotic approach foregrounds a distinct human–object phenomenon, a novel category of nonverbal communication, and important meaning-making dynamics.     

Recent Improvements in Portraying Acts in Symbolic Interaction Behavioral Specimens

Behavioral specimens are slices of ongoing interaction that take particular behavioral observations from beginning to end and report the temporal sequence of the behaviors under investigation. This article takes the position that behavioral specimens as a symbolic interaction tool preserve the context of natural interaction in interpersonal relationships. Whereas this technique of data collection was first used by Barker and Wright in 1954, over 30 years ago, the format of the specimen presented here is new, because nonverbal behaviors are now recorded in a fashion that reflects the timing of the behaviors in relation to verbalizations. The intent of the new specimen format is to enhance the ecological validity of recordings through a more accurate representation of the contemporaneous nature of nonverbal behaviors and to convey a working knowledge of the actors under analysis.