Directions

Research Summary

  • Social interaction in naturalistic verbal contexts: We study neural and cognitive mechanisms during dynamic and active social interaction in diverse naturalistic verbal contexts, and how the altered neural patterns reflect changes in non-verbal and verbal behaviors.
  • ​Causal neural circuits in emotion regulation: We investigate the neural circuits and therapeutic mechanisms for emotion regulation in patients with mood disorders and brain lesions, aiming to guide targeting optimization in noninvasive neuromodulatory treatment.
  • Interdisciplinary neuroscience approach: We develop and utilize a variety of  neuroimaging and computational methods, e.g., fNIRS-based hyperscanning, concurrent eye-tracking/fMRI, concurrent TMS/fMRI, and lesion network mapping in both healthy and clinical populations. 

 Social interaction in naturalistic verbal contexts

 

Face-to-face communication has unique neural features.
​Although the human brain may have evolutionarily adapted to face-to-face communication, other ways of communication, e.g., telephone and e-mail, now increasingly dominate our daily social interaction. However, the unique neural features of face-to-face communication relative to other types of communications remain unknown. We developed a functional near-infrared spectroscopy (fNIRS)-based hyperscanning to simultaneously measure activities from two communicating brains. We identified a significant interpersonal neural synchronization (INS) increase in the inferior frontal cortex during a face-to-face dialogue between communicating partners but not during other conditions (i.e., face-to-face monologue, back-to-back dialogue, and back-to-back monologue). Moreover, this INS increase resulted primarily from the multisensory integration such as facial expressions during the face-to-face dialogue. These results suggest that face-to-face communication, particularly dialog, has special neural features that other types of communication do not have​. This study also contributes a naturalistic approach (fNIRS-based hyperscanning) and a novel neuromarker (INS) to the field of social neuroscience, catalyzing a new wave of research focusing on how multiple brains interact with each other under diverse face-to-face interaction settings.
  • ​Jiang J., Dai B., Peng D., Zhu C., Liu L., Lu C. (2012). Neural synchronization during face-to-face communication. Journal of Neuroscience, 32(45):16064 –16069.  [Link]
Face-to-face communication is special!
Interpersonal neural synchronization (INS) increases during face-to-face dialogue

Humans build relationships through interpersonal neural synchronization (INS)


Human society consists of different interpersonal relationships. One important relationship in both evolutionary past and modern society is the leader-follower relationship. However, little is known about how the leader-follower relationship emerges through INS during social interaction. We leveraged fNIRS-based hyperscanning to simultaneously measure brain activities from three-person groups during a dynamic leaderless group discussion (LGD). We found a significantly higher INS in the left temporoparietal junction between leaders and followers than between followers. This difference was mainly driven by leader-initiated interactions and was related to leaders’ communication skills and competence, but not their communication frequency, in favor of the "communication quality hypothesis" in leader emergence. The INS even predicted when this relationship emerged along the course of LGD. These findings together suggest that humans may build new relationships with others by synchronizing their brain activities with others. Leader-follower relationship emerges because leaders are able to say the right things at the right time.

  • Jiang J., Chen C., Dai B., Shi G., Liu L., Lu C. (2015). Leader emergence through interpersonal neural synchronization. Proceedings of the National Academy of Sciences of the United States of America, 112(14): 4274-4279. [Link]
Follow Leader
Babble

A hierarchical model for interpersonal verbal communication


The ability to use language makes us human. For decades, researchers have been racking their minds to understand the relation between language and the human brain. Nevertheless, most previous neuroscientific research has investigated this issue from a ‘single-brain’ perspective, thus neglecting the nature of interpersonal communication through language. With the development of modern hyperscanning techniques, researchers have begun probing the neurocognitive processes underlying interpersonal verbal communication and have examined the involvement of interpersonal neural synchronization (INS) in communication. However, in most cases, the neurocognitive processes underlying INS are obscure. To tentatively address this issue, we propose herein a hierarchical model based on the findings from a growing amount of hyperscanning research. We suggest that three levels of neurocognitive processes are primarily involved in interpersonal verbal communication and are closely associated with distinctive patterns of INS. Different levels of these processes modulate each other bidirectionally. Furthermore, we argued that two processes (shared representation and interpersonal predictive coding) might coexist and work together at each level to facilitate successful interpersonal verbal communication. We hope this model will inspire further innovative research in several directions within the fields of social and cognitive neuroscience.

  • Jiang J., Zheng L., Lu C. (2021). A hierarchical model for interpersonal verbal communication. Social Cognitive and Affective Neuroscienceinvited Special Issue, 16(1-2): 246-255. [Link]
nn

Altered neural patterns reflect changes in non-verbal and verbal behaviors


Eye contact is an important non-verbal cue for social interaction and occurs frequently and spontaneously in verbal communication. However, the brain circuitry underlying this behavior is unclear. We developed a novel paradigm to simulate eye contact in verbal communication. Using concurrent eye-tracking/fMRI, we simultaneously recorded participants’ eye movements and neural patterns while they were freely watching a pre-recorded speaker talking. We found an extensive network of brain regions showing specific responses and connectivity patterns to eye contact (Jiang et al., 2017, SCAN). Interestingly, the connectivity strength between brain areas involved in face processing was related to the level of autistic traits (Jiang et al., 2020, Scientific Reports).
Like reduced eye contact, stuttering is a common communication difficulty that affects social interaction. Using a sparse-sampling fMRI paradigm, we designed a speech production task to naturally elicit patients’ stuttering symptoms in the scanner and simultaneously measure their brain responses to various stuttering symptoms. Unique patterns of altered brain activity were noted for different stuttering symptoms. The findings have important theoretical and clinical implications for patients with distinct dominated stuttering symptoms (Jiang et al., 2012, PLoS ONE).

  • ​Jiang J., Borowiak K., Tudge L., Otto C., von Kriegstein K. (2017). Neural mechanisms of eye contact when listening to another person talking. Social Cognitive and Affective Neuroscience, 319–328. [Link]
  • ​Jiang J., von Kriegstein K., Jiang J. (2020). Brain Mechanisms of Eye Contact during Verbal Communication Predict Autistic Traits in Neurotypical Individuals. Scientific Reports, 10 (1): 14602. [Link]
  • Jiang J., Lu C., Peng D., Zhu C., Howell P. (2012). Classification of types of stuttering symptoms based on brain activity. PLoS ONE, 7(6): e39747. [Link]
Brain response patterns
Brain circuitry

Causal neural circuits in emotion regulation

The left dorsolateral prefrontal cortex causally regulates amygdala
Emotion regulation (ER) is a core affective ability that influences the quality of social interaction and is implicated in a variety of affective disorders. Evidence has shown that the left dorsolateral prefrontal cortex (dlPFC) is a key region involved in ER and an effective target for repetitive transcranial magnetic stimulation (rTMS) treatment in depression. Yet, our understanding of the causal regulatory role of the dlPFC and how rTMS to this region exerts its antidepressant effect is minimal. We performed a series of multimodal experiments in depression. Using concurrent TMS/fMRI, we observed an inhibitory effect of the dlPFC on the amygdala in healthy controls, but this effect was perturbed in depressed patients, indicating an altered dlPFC-amygdala circuit in depression. Our second experiment demonstrated this hypothesis by showing treatment with active but not sham rTMS to the dlPFC drove the dlPFC-amygdala connectivity pattern in patients towards to that seen in healthy controls. The findings together suggest that the rTMS may have improved the regulation of the dlPFC on the amygdala in depression, providing important clinical implications for treatment optimization.
  • Jiang J. #, Eshel N. #, Keller C. #, Wu W. #,  …, Etkin A. (2020). Global Connectivity and Local Excitability Changes Underlie Antidepressant Effects of Repetitive Transcranial Magnetic StimulationNeuropsychopharmacology, 45 (6): 1018-1025 (#: co-1st author). [Link]
Active rTMS
Causal Regulation

 


 

Emotion regulation maps to a network centered on the left ventrolateral prefrontal cortex


Lesions in multiple different brain locations have been associated with changes in emotion regulation (ER). However, it is unknown whether lesions causing ER impairment map to a connected brain network. We found that damage to these networks was associated with emotion regulation impairment in patients following focal brain injury (n = 167). Next, we used this lesion dataset to derive a de novo brain network for emotion regulation, which was defined by functional connectivity to the left ventrolateral prefrontal cortex (vlPFC). Finally, we used an independent lesion database (n = 629) to test whether damage to this lesion-derived network would increase the risk of neuropsychiatric conditions associated with emotion regulation impairment. We found that lesions causing mania, criminality, and depression intersected this network more than lesions causing other disorders. We conclude that emotion regulation maps to a connected brain network centered on the left vlPFC. Damage to this network impairs emotion regulation and may increase the risk of specific neuropsychiatric disorders.

  • Jiang J., Cohen A., Ferguson M., Grafman J., Fox M.: A lesion-derived brain network for emotion regulation. [Preprint].
Network and mood disorders
Lesion connectivity to the left vIPFC is associated with ER

Interdisciplinary approach 

 

Interdisciplinary neuroscience approach