Multimodal human communication 鈥?Targeting facial expressions, speech content and prosody

详细信息	查看全文 | 推荐本文 |

• 作者：Christina Regenbogen^a ; ^b ; ^{cregenbogen@ukaachen.de} ; Daniel A. Schneider^a ; ^b ; Raquel E. Gur^c ; Frank Schneider^a ; ^b ; ^c ; Ute Habel^a ; ^b ; Thilo Kellermann^a ; ^b
• 刊名：NeuroImage
• 出版年：2012
• 期刊代码：83_10538119
• 类别：neu
• 出版时间：1 May, 2012
• 卷：60
• 期：4
• 页码：2346-2356
• 文件大小：1023 K

摘要

Human communication is based on a dynamic information exchange of the communication channels facial expressions, prosody, and speech content. This fMRI study elucidated the impact of multimodal emotion processing and the specific contribution of each channel on behavioral empathy and its prerequisites.

Ninety-six video clips displaying actors who told self-related stories were presented to 27 healthy participants. In two conditions, all channels uniformly transported only emotional or neutral information. Three conditions selectively presented two emotional channels and one neutral channel. Subjects indicated the actors鈥?emotional valence and their own while fMRI was recorded.

Activation patterns of tri-channel emotional communication reflected multimodal processing and facilitative effects for empathy. Accordingly, subjects鈥?behavioral empathy rates significantly deteriorated once one source was neutral. However, emotionality expressed via two of three channels yielded activation in a network associated with theory-of-mind-processes. This suggested participants鈥?effort to infer mental states of their counterparts and was accompanied by a decline of behavioral empathy, driven by the participants鈥?emotional responses. Channel-specific emotional contributions were present in modality-specific areas.

The identification of different network-nodes associated with human interactions constitutes a prerequisite for understanding dynamics that underlie multimodal integration and explain the observed decline in empathy rates. This task might also shed light on behavioral deficits and neural changes that accompany psychiatric diseases.