|
|
|
| A new perspective of emotional perception：Integration of facial expressions and body expressions |
| LANG Xuemai1, GAO Jingwei2, LI Xinli1, LUO Lan1, ZHAO Jing1, DING Xiaobin1 |
1 Key Laboratory of Behavioral and Mental Health of Gansu Province, Lanzhou 730070;
2 People’s Procuratorate of Qinglong Manzu Autonomous County, Hebei Province, Qinhuangdao 066500 |
|
|
|
|
Abstract Previous studies of facial expressions have typically used facial stimuli without the body, while investigations of body expressions have universally used bodily stimuli that retain only the head outline （without facial features）. Researchers have sought to investigate the integration of facial and bodily expressions by altering the temporal variation and spatial arrangement of the face and somatic presentations, changing the target cues for emotion recognition. Compared to purely emotional face perception, face-body emotion integration showed significant emotion enhancement effects, plasticity in emotion perception, and individual differences in emotion processing strategies. Some current models with two separate processing pathways, dorsal and ventral, describe mechanisms of face-body integration but neglect the role of emotion and movement in integrated processing. In the future, there is a need to investigate further the characteristics of face-body integration at different stages of processing, to explore the characteristics of face-body emotion integration in individuals with emotion processing disorders; and to focus on individual differences in face-body emotion processing.
|
|
|
|
|
|
[1] 陈丽, 李伟霞, 张烨, 张庆林. (2015). 躯体知觉的认知神经机制.心理科学, 38(1), 85-92.
[2] 李萍, 张明明, 李帅霞, 张火垠, 罗文波. (2019). 面孔表情和声音情绪信息整合加工的脑机制.心理科学进展, 27(7), 1205-1214.
[3] 刘华孝, 周国梅. (2010). 面孔识别的整体/分析加工研究范式.心理科学, 33(2), 436-438.
[4] 王丽丽, 贾丽娜, 罗跃嘉. (2016). 情绪自动化加工的证据与争议.心理科学进展, 24(8), 1185-1197.
[5] Abo Foul Y., Eitan R., & Aviezer H. (2018). Perceiving emotionally incongruent cues from faces and bodies: Older adults get the whole picture.Psychology and Aging, 33(4), 660-666.
[6] Abramson L., Marom I., Petranker R., & Aviezer H. (2017). Is fear in your head? A comparison of instructed and real-life expressions of emotion in the face and body.Emotion, 17(3), 557-565.
[7] Abramson L., Petranker R., Marom I., & Aviezer H. (2021). Social interaction context shapes emotion recognition through body language, not facial expressions.Emotion, 21(3), 557-568
[8] Armstrong, T., & Olatunji, B. O. (2012). Eye tracking of attention in the affective disorders: A meta-analytic review and synthesis.Clinical Psychology Review, 32(8), 704-723.
[9] Aviezer H., Ensenberg N., & Hassin R. R. (2017). The inherently contextualized nature of facial emotion perception.Current Opinion in Psychology, 17, 47-54.
[10] Aviezer H., Hassin R. R., Ryan J., Grady C., Susskind J., Anderson A., et al. (2008). Angry, disgusted, or afraid? Studies on the malleability of emotion perception.Psychological Science, 19, 724-732.
[11] Aviezer H., Trope Y., & Todorov A. (2012a). Body cues, not facial expressions, discriminate between intense positive and negative emotions.Science, 338, 1225-1229.
[12] Aviezer H., Trope Y., & Todorov A. (2012b). Holistic person processing: Faces with bodies tell the whole story.Journal of Personality and Social Psychology, 103(1), 20-37.
[13] Bernstein M., Oron J., Sadeh B., Yovel G., 2014. An integrated face-Body representation in the fusiform gyrus but not the lateral occipital cortex michal.Journal of Cognition Neuroscience, 26(11), 2469-2478.
[14] Brewer R., Biotti F., Bird G., & Cook R. (2017). Typical integration of emotion cues from bodies and faces in autism spectrum disorder. Cognition, 165, 82-87.
[15] Chen X. H., Pan Z. H., Wang P., Yang X. H., Liu P., You X. Q., & Yuan J. J. (2016). The integration of facial and vocal cues during emotional change perception: EEG markers.Social Cognitive and Affective Neuroscience, 11(7), 1152-1161.
[16] Civile, C., & Obhi, S. S. (2015). Towards a mechanistic understanding of the effects of body posture on facial emotion categorization.American Journal of Psychology, 128(3), 367-377.
[17] Cox D., Meyers E., & Sinha. P. (2004). Contextually evoked object-specific responses in human visual cortex.Science, 304(5667), 115-117.
[18] de Borst, A. W., & de Gelder, B. (2016). Clear signals or mixed messages: Inter-individual emotion congruency modulates brain activity underlying affective body perception.Social Cognitive and Affective Neuroscience, 11(8), 1299-1309.
[19] de Gelder B., de Borst A. W., & Watson R. (2015). The perception of emotion in body expressions.Wiley Interdisciplinary Reviews: Cognitive Science, 6(20), 149-158.
[20] de Gelder B., Snyder J., Greve D., Gerard G., & Hadjikhani N. (2004). Fear fosters flight: A mechanism for fear contagion when perceiving emotion expressed by a whole body.Proceedings of the National Academy of Sciences, 101(47), 16701-16706.
[21] Ekman, P. (1993). Facial expression and emotion.American Psychologist, 48, 384-392.
[22] Ekman, P. (2007). Emotions revealed: Recognizing faces and feelings to improve communication and emotional life (2nd ed.). New York, NY: Henry Holt and Company.
[23] Fisher C., & Freiwald W. A., (2015). Whole-agent selectivity within the macaque face-processing system.Proceedings of the National Academy of Sciences of the United States of America, 112(47), 14717-14722.
[24] Goldberg H., Christensen A., Flash T., Giese M. A., & Malach R. (2015). Brain activity correlates with emotional perception induced by dynamic avatars.NeuroImage, 122, 306-317
[25] Gu Y., Mai X., & Luo Y. (2013). Do bodily expressions compete with facial expressions? Time course of integration of emotional signals from the face and the body.PLoS ONE, 8(7), e66762.
[26] Hadjikhani, N., & de Gelder, B. (2003). Seeing fearful body expressions activates the fusiform cortex and amygdala.Current Biology, 13(24), 2201-2205.
[27] Harry B. B., Umla-Runge K., Lawrence A. D., Graham K. S., & Downing P. E. (2016). Evidence for integrated visual face and body representations in the anterior temporal lobes.Journal of Cognition. Neuroscience, 28(8), 1178-1193.
[28] Hietanen, J. K., & Leppnen, J. M. (2010). Judgment of other people’s facial expressions of emotions is influenced by their concurrent affective hand movements.Scandinavian Journal of Psychology, 49(3), 221-230.
[29] Hu A., Baragchizadeh A., & O’Toole, A J. (2020). Integrating faces and bodies: Psychological and neural perspectives on whole person perception.Neuroscience and Biobehavioral Reviews, 112, 472-486.
[30] Jack, R. E., & Schyns, P. G. (2017). Toward a social psychophysics of face communication.Annual Review of Psychology, 68, 269-297.
[31] Jessen, S., & Kotz, S. A. (2011). The temporal dynamics of processing emotions from vocal, facial, and bodily expressions.Neuroimage, 58(2), 665-674.
[32] Kaiser D., Strnad L., Seidl K. N., Kastner S., Peelen M. V. (2014). Whole person-evoked fMRI activity patterns in human fusiform gyrus are accurately modeled by a linear combination of face- and body-evoked activity patterns.Journal of Neurophysiology, 111(1), 82-90
[33] Kret M. E., Karin R., Stekelenburg J. J., & de Gelder B. (2013). Emotional signals from faces, bodies and scenes influence observers’ face expressions, fixations and pupil-size.Frontiers in Human Neuroscience, 7.
[34] Kret M. E., Stekelenburg J. J., de Gelder B., & Roelofs K. (2017). From face to hand: Attentional bias towards expressive hands in social anxiety.Biological Psychology, 122, 42-50.
[35] Lecker M., Dotsch R., Bijlstra G., & Aviezer H. (2020). Bidirectional contextual influence between faces and bodies in emotion perception.Emotion, 20(7), 1154-1164.
[36] Lecker M., Shoval R., Aviezer H., & Eitam B. (2017). Temporal integration of bodies and faces: United we stand, divided we fall?Visual Cognition, 25, (4-6), 477-491.
[37] Manning C., Morgan M. J., Allen C. T. W., & Pellicano E. (2017). Susceptibility to Ebbinghaus and Muller-Lyer illusions in autistic children: A comparison of three different methods.Molecular Autism, 8(1), 16
[38] Martinez L., Falvello V. B., Aviezer H., & Todorov A. (2015). Contributions of facial expressions and body language to the rapid perception of dynamic emotions.Cognition and Emotion, 11(5), 1-14.
[39] Meeren H. K., van Heijnsbergen C. C., & de Gelder B. (2005). Rapid perceptual integration of facial expression and emotional body language.Proceedings of the National Academy of Sciences, 102(45), 16518-16523.
[40] Mondloch, C. J. (2012). Sad or fearful? The influence of body posture on adults’ and children’s perception of facial displays of emotion. Journal of Experimental Child Psychology, 111(2), 180-196.
[41] Mondloch C. J., Nelson N. L., & Horner M. (2013). Asymmetries of influence: Differential effects of body postures on perceptions of emotional facial expressions.PLoS ONE, 8(9), e73605.
[42] Morris J. P., Pelphrey K. A., McCarthy G. (2006). Occipitotemporal activation evoked by the perception of human bodies is modulated by the presence or absence of the face.Neuropsychologia, 44 (10), 1919-1927.
[43] Nakagawa Y., Hoshiyama M., Uemura J. I., & Jomori I. (2012). Auditory MEG mismatch responses modified by visual stimulation accompanying auditory stimulation.Neurophysiology, 44(3), 247-254.
[44] Noh, S. R., & Isaacowitz, D. M. (2013). Emotional faces in context: Age differences in recognition accuracy and scanning patterns.Emotion, 13, 238-249.
[45] Osborne Crowley, K. (2020). Social cognition in the real world: Reconnecting the study of social cognition with social reality, Review of General Psychology,24, 114-158.
[46] Palumbo R., D’Ascenzo S., & Tommasi L. (2015). Cross-category adaptation: Exposure to faces produces gender aftereffects in body perception.Psychological Research, 79(3), 380-388.
[47] Palermo, R., & Rhodes, G. (2007). Are you always on my mind? A review of how face perception and attention interact.Neuropsychologia, 45(1), 75-92.
[48] Poyo Solanas M., Zhan M., Vaessen M., Hortensius R., Engelen T., & de Gelder B. (2018). Looking at the face and seeing the whole body. Neural basis of combined face and body expressions.Social Cognitive and Affective Neuroscience, 13(1), 135-144.
[49] Reed A. E., Chan L., & Mikels J. A. (2014). Meta-analysis of the age-related positivity effect: Age differences in preferences for positive over negative information.Psychology and Aging, 29, 1-15
[50] Reschke P. J., Knothe J. M., Lopez L. D., & Walle E. A. (2017). Putting "context" in context: The effects of body posture and emotion scene on adult categorizations of disgust facial expressions.Emotion, 18(1), 153-158.
[51] Richards H. J., Benson V., Donnelly N., & Hadwin J. A. (2014). Exploring the function of selective attention and hypervigilance for threat in anxiety.Clinical Psychology Review, 34(1), 1-13.
[52] Robbins, R. A., & Coltheart, M. (2012). The effects of inversion and familiarity on face versus body cues to person recognition.Journal of Experimental Psychology Human Perception & Performance, 38(5), 1098-1104.
[53] Schmalzl L., Zopf R., Williams M. A., 2012. From head to toe: Evidence for selective brain activation reflecting visual perception of whole individuals.Frontiers Human Neuroscience, 6.
[54] Shah P., Bird G., & Cook R. (2016). Face processing in autism: Reduced integration of cross-feature dynamics.Cortex, 75, 113-119.
[55] Sinke C. B.A., Kret, M. E., & de Gelder, B. (2012). Body language: Embodied perception of emotion In B Berglund, G B Rossi, J T Townsend, & L R Pendrill (Eds), Measuring with persons: Theory, methods, and implementation areas(pp 335-352) London: Psychology Press Embodied perception of emotion. In B. Berglund, G. B. Rossi, J. T. Townsend, & L. R. Pendrill (Eds.), Measuring with persons: Theory, methods, and implementation areas(pp. 335-352). London: Psychology Press.
[56] Smith M. L., Cottrell G. W., Gosselin F., & Schyns P. G. (2005). Transmitting and decoding facial expressions.Psychological Science, 16(3), 184-189.
[57] Song Y., Luo Y. L. L., Li X., Xu M., & Liu A. J. (2013). Representation of contextually related multiple objects in the human ventral visual pathway.Journal of Cognitive Neuroscience, 25(8), 1261-1269.
[58] Susskind J. M., Littlewort G., Bartlett M. S., Movellan J., & Anderson A. K. (2007). Human and computer recognition of facial expressions of emotion.Neuropsychologia, 45, 152-162.
[59] Teufel C., Westlake, M F., Fletcherb, P C., & von dem Hagen, E. (2019). A hierarchical model of social perception: Psychophysical evidence suggests late rather than early integration of visual information from facial expression and body posture. Cognition, 185, 131-143.
[60] Van de Riet, W. A. C., & de Gelder, B. (2008). Watch the face and look at the body！ Reciprocal interaction between the perception of facial and bodily expressions.Netherlands Journal of Psychology, 64(4), 143-151.
[61] Van den Stock, J., & Gelder, B. de. (2014). Face identity matching is influenced by emotions conveyed by face and body.Frontiers in Human Neuroscience, 8.
[62] Van den Stock J., Righart R., & de Gelder B. (2007). Body expressions influence recognition of emotions in the face and voice.Emotion, 7(3), 487-494.
[63] Vrancken L., Germeys F., & Verfaillie K. (2017). Holistic integration of gaze cues in visual face and body perception: Evidence from the composite design.Journal of Vision, 17(1), 24-24.
[64] Wang Y., Collins J. A., Koski J., Nugiel T., Metoki A., & Olson I. R. (2017). Dynamic neural architecture for social knowledge retrieval.Proceedings of the National Academy of Sciences, 114(16), E3305-E3314.
[65] Weeks J. W., Howell A. N., & Goldin P. R. (2013). Gaze-avoidance in social anxiety disorder.Depression and Anxiety, 30(8), 749-756.
[66] Willems S., Vrancken L., Germeys F., & Verfaillie K. (2014). Holistic processing of human body postures: Evidence from the composite effect.Frontiers in Psychology, 5(7), 618.
[67] Willis M. L., Palermo R., & Burke D. (2011). Judging approachability on the face of it: The influence of face and body expressions on the perception of approachability.Emotion, 11(3), 514-523. |
|
|
|
