Advanced SearchSearch Tips
The Congruent Effects of Gesture and Facial Expression of Virtual Character on Emotional Perception: What Facial Expression is Significant?
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
The Congruent Effects of Gesture and Facial Expression of Virtual Character on Emotional Perception: What Facial Expression is Significant?
Ryu, Jeeheon; Yu, Seungbeom;
  PDF(new window)
In the design and develop a virtual character, it is important to correctly deliver target emotions generated by the combination of facial expression and gesture. The purpose of this study is to examine the effect of congruent/incongruent between gesture and facial expression on target emotion. In this study four emotions, joy, sadness, fear, and anger, are applied. The results of study showed that sadness emotion were incorrectly perceived. Moreover, it was perceived as anger instead of sadness. Sadness can be easily confused when facial expression and gestures were simultaneously presented. However, in the other emotional status, the intended emotional expressions were correctly perceived. The overall evaluation of virtual character`s emotional expression was significantly low when joy gesture was combined with sad facial expression. The results of this study suggested that emotional gesture is more influential correctly to deliver target emotions to users. This study suggested that social cues like gender or age of virtual character should be further studied.
Virtual Character;Emotional Status;Emotional Perception;Gesture;Facial Expression;
 Cited by
W. L. Johnson, J. W. Rickel, and J. C. Lester, "Animated pedagogical agents: Face-to-face interaction in interactive learning environments," International Journal of Artificial Intelligence in Education, Vol.41, pp.41-78, 2000.

H. van der Meij, J. van der Meij, and R. Harmsen, "Animated pedagogical agents effects on enhancing student motivation and learning in a science inquiry learning environment," Educational Technology Research and Development, Vol.63, No.3, pp.381-403, 2015. crossref(new window)

S. Domagk, "Do Pedagogical Agents Facilitate Learner Motivation and Learning Outcomes?," J. of Media Psychology: Theories, Methods, and Applications, Vol.22, No.2, pp.84-97, 2010. crossref(new window)

S. H. Chen and S. Y. Chen, "When educational agents meet surrogate competition: Impacts of competitive educational agents on students' motivation and performance," Computers & Education, Vol.75, pp.274-281, 2014. crossref(new window)

김진옥, "가상 인간의 감정 표현 인식을 위한 비언어적 다중모달 영향 분석," 인터넷정보학회지, Vol.13, No.5, pp.9-19, 2012.

F. D. Schonbrodt and J. B. Asendorpf, "The challenge of constructing psychologically believable agents," J. of Media Psychology: Theories, Methods, and Applications, Vol.23, No.2, pp.100-107, 2011. crossref(new window)

Dael, N..Mortillaro and K. R. M..Scherer, "Emotion expression in body action and posture," Emotion, Vol.12, No.5, pp.1085-1101, 2012. crossref(new window)

J. K. Hietanen and J. M. Leppanen, "Judgment of other people's facial expressions of emotions is influenced by their concurrent affective hand movements," J. of Psychology, Vol.49, No.3, pp.221-230, 2008.

M. Courgeon, C. Clavel, N. Tan, and J. C. Martin, "Front View vs. Side View of Facial and Postural Expressions of Emotions in a Virtual Character," Springer Berlin Heidelberg, In Z. Pan, A. Cheok, & W. Muller (Eds.), Transactions on Edutainment VI, Vol.6758, pp.132-143, 2011.

C. Clavel, J. Plessier, J. C. Martin, L. Ach, and B. Morel, "Combining Facial and Postural Expressions of Emotions in a Virtual Character," Springer Berlin Heidelberg, In Z. Ruttkay, M. Kipp, A. Nijholt, & H. Vilhjalmsson (Eds.), Intelligent Virtual Agents, Vol.5773, pp.287-300, 2009.

H. K. Meeren, C. C. van Heijnsbergen, and B. de Gelder, "Rapid perceptual integration of facial expression and emotional body language," Proceedings of the National Academy of Sciences of the United States of America, Vol.102, No.45, pp.16518-16523, 2005.

M. A. H. Rot, K. Hogenelst, and C. M. Gesing, "Communal and agentic behaviour in response to facial emotion expressions," British Journal of Psychology, Vol.105, No.2, pp.173-186, 2014. crossref(new window)

E. Gilboa-Schechtman and I. Shachar-Lavie, "More than a face: a unified theoretical perspective on nonverbal social cue processing in social anxiety," Frontiers in Human Neuroscience, Vol.7, No.904, pp.1-13, 2013.

R. Reisenzein, M. Studtmann, and G. Horstmann, "Coherence between Emotion and Facial Expression: Evidence from Laboratory Experiments," Emotion Review, Vol.5, No.1, pp.16-23, 2013. crossref(new window)

M. Kipp and J. C. Martin, Gesture and Emotion: Can basic gestural form features discriminate emotions?, Affective Computing and Intelligent Interaction and Workshops, Amsterdam, 2009.

R. Plutchik, Emotions and Life Perspectives from Psychology, Biology, and Evolution, Translated by Park. K, Seoul: Hakjisa, 2004. (Original work published 2002).

S. Sumpeno, M. Hariadi, and M. H. Purnomo, "Facial emotional expressions of life-like character based on text classifier and fuzzy logic," IAENG International Journal of Computer Science, Vol.38, No.2, pp.122-133, 2011.

J. L. Tracy and R. W. Robins, "The nonverbal expression of pride: evidence for cross-cultural recognition," J. of personality and social psychology, Vol.94, No.3, pp.516-530, 2008. crossref(new window)

이노미, "문화 간 비언어적 커뮤니케이션에서의 한국과 아시아 지역 손짓언어의 비교 연구," 커뮤니케이션학 연구, Vol.16, No.2, pp.5-34, 2008.

A. Bailey and S. Kelly, "Picture power: Gender versus body language in perceived status," J. of Nonverbal Behavior, Vol.39, No.4, pp.317-337, 2015. crossref(new window)

A. S. Won, L. Yu, J. H. Janssen, and J. N. Bailenson, "Tracking Gesture to Detect Gender," International Society for Presence Research Annual Conference, Philadelphia, PA, USA, 2012.