Research on Micro-Movement Responses of Facial Muscles by Intimacy, Empathy, Valence

친밀도, 공감도, 긍정도에 따른 얼굴 근육의 미세움직임 반응 차이

  • 조지은 (상명대학교 감성공학과) ;
  • 박상인 (상명대학교 감성공학과) ;
  • 원명주 (상명대학교 감성공학과) ;
  • 박민지 (상명대학교 감성공학과) ;
  • 황민철 (상명대학교 ICT융합대학 미디어소프트웨어학과)
  • Received : 2016.10.21
  • Accepted : 2017.01.21
  • Published : 2017.02.28


Facial expression is important factor on social interaction. Facial muscle movement provides emotion information to develop social network. However, facial movement has less determined to recognize social emotion. This study is to analyze facial micro-movements and to recognize the social emotion such as intimacy, empathy, and valence. 76 university students were presented to the stimuli for social emotions and was measure their facial expression using camera. As a results, facial micro-movement. showed significant difference of social emotion. After extracting the movement amount of 3 unconscious muscles and 18 conscious muscles, Dominant Frequency band was confirmed. While muscle around the nose and cheek showed significant difference in the intimacy, one around mouth did in the empathy and one around jaw in the valence. The results proposed new facial movement to express social emotion in virtual avatars and to recognize social emotion.


Supported by : 한국연구재단


  1. R. L. Birdwhistell, Kinesics and context: Essays on body motion communication, University of Pennsylvania press, 2010.
  2. F. I. Parke and K. Waters, Computer facial animation, CRC Press, 2008.
  3. G. D. de Boulogne and R. A. Cuthbertson, The mechanism of human facial expression, Cambridge university press, 1990.
  4. P. Ekman, W. V. Friesen, M. O'Sullivan, A. Chan, I. Diacoyanni-Tarlatzis, K. Heider, R. Krause, W. A. LeCompte, T. Pitcairn, and P. E. Ricci-Bitti, "Universals and cultural differences in the judgments of facial expressions of emotion," J. Pers. Soc. Psychol., Vol.53, No.4, p.712, 1987.
  5. S. Porter, L. Ten Brinke, and B. Wallace, "Secrets and lies: Involuntary leakage in deceptive facial expressions as a function of emotional intensity," J. Nonverbal Behav., Vol.36, No.1, pp.23-37, 2012.
  6. P. Ekman, "Lie catching and microexpressions," The philosophy of deception, pp.118-133, 2009.
  7. U. Dimberg, M. Thunberg, and K. Elmehed, "Unconscious facial reactions to emotional facial expressions," Psychol. Sci., Vol.11, No.1, pp.86-89, 2000(1).
  8. M. Schulte-Ruther, H. J. Markowitsch, G. R. Fink, and M. Piefke, "Mirror neuron and theory of mind mechanisms involved in face-to-face interactions: a functional magnetic resonance imaging approach to empathy," J. Cogn. Neurosci., Vol.19, No.8, pp.1354-1372, 2007.
  9. J. Gratch, W. Mao, and S. Marsella, Modeling social emotions and social attributions, Cambridge University Press, 2006.
  10. 성영신, 임선희, 김보경, 김희진, "감성광고에 대한 소비자 공감 (empathy) 의 효과," 광고학연구, 제18권, 제5호, pp.75-90, 2007.
  11. 차예술, 김지혜, 김종화, 김송이, 김동근, 황민철, "SNS 사용자의 관계유형에 따른 사회감성 모델의 타당화 분석," 감성과학, 제15권, 제2호, pp.283-296, 2012.
  12. 임성진, 감성 어휘와 얼굴표정을 기반으로 한 사회감성 통합모델, 석사학위논문, 2015.
  13. J. A. Russell, "A circumplex model of affect," Journal of Personality and social psychology, Vol.39, No.6, p.1161, 1980.
  14. M. B. Holbrook and R. Batra, "Assessing the role of emotions as mediators of consumer responses to advertising," Journal of consumer research, pp.404-420, 1987.
  15. B. E. Wexler, S. Warrenburg, G. E. Schwartz, and L. D. Janer, "EEG and EMG responses to emotion-evoking stimuli processed without conscious awareness," Neuropsychologia, Vol.30, No.12, pp.1065-1079, 1992.
  16. P. Ekman, "Expression and the nature of emotion," Approaches to emotion, Vol.3, pp.19-344, 1984.
  17. M. Argyle and J. Dean, "Eye-contact, distance and affiliation," Sociometry, pp.289-304, 1965.
  18. U. Hess, M. G. Beaupre, and N. Cheung, "Who to whom and why-cultural differences and similarities in the function of smiles," An empirical reflection on the smile, Vol.4, p.187, 2002.
  19. L. M. Coutts and F. W. Schneider, "Affiliative conflict theory: An investigation of the intimacy equilibrium and compensation hypothesis," J. Pers. Soc. Psychol., Vol.34, No.6, p.1135, 1976.
  20. P. Winkielman and J. T. Cacioppo, "Mind at ease puts a smile on the face: psychophysiological evidence that processing facilitation elicits positive affect," J. Pers. Soc. Psychol., Vol.81, No.6, p.989, 2001.