Journal of the Korea Institute of Information and Communication Engineering (한국정보통신학회논문지)

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Development of real-time reactive emotion image contents player system to induce the user's emotion

사용자의 감성을 유도하는 실시간 반응형 감성 이미지 콘텐츠 플레이어 시스템 개발

  • Lee, Haena (Department of Emotion Engineering, Graduate School, Sangmyung University) ;
  • Kim, Dong Keun (Department of Digital Media, College of Software, Sangmyung University)
  • Received : 2013.08.20
  • Accepted : 2013.11.04
  • Published : 2014.01.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study presents the real-time emotion image contents player to induce the user's emotion efficiently. The emotion image contents player was designed to efficiently induce by giving a change in the color, brightness, saturation of image contents corresponded to the user's emotion. In the emotion recognition module, physiological signal of pulse, skin temperature, skin resistance which based on autonomic nervous system were used. The emotion recognition part used physiological signal of pulse, skin temperature, skin resistance based on autonomic nervous system. The image as emotional contents was used with the 9 kinds emotion area classified in international affective picture system(IAPS). As experimental results, the use's emotion that match the image's emotion with the emotion image contents player was derived 10% more accurately. The emotion contents player is expected to increase emotional feeling between users's emotion and contents emotion duo to the real-time emotion reflection.

본 연구는 사용자의 감성을 효율적으로 유도하는 실시간 감성 이미지 콘텐츠 플레이어를 제안한다. 감성 이미지 콘텐츠 플레이어는 실시간으로 이미지 콘텐츠의 명도, 채도에 변화를 줌으로써 사용자의 감성에 따라 효율적으로 감성 유도가 가능하도록 설계하였다. 감성인식 부분은 자율신경계 기반의 맥파, 피부온도, 피부저항의 생체신호를 활용하였다. 사용된 감성 콘텐츠 이미지는 국제적 정서체계(IAPS)에서 분류된 9가지 감성영역의 이미지를 적용하였다. 실험결과로 감성 이미지 콘텐츠 플레이어를 통해 이미지의 감성 상태에 맞는 사용자의 감성이 10% 더 정확하게 유도되었다. 감성 콘텐츠 플레이어는 실시간으로 감성 반영을 통해 사용자와 콘텐츠간의 감성적 교감을 증대시킬 것으로 기대된다.

Keywords

References

  1. S. J. Oh, W. U. Lee, Y. M. Park, U. T. U, "u-contents : Realistic emotional contents in Ubiquitous Smart Space(USS)," Korea Multimedia Society, vol. 10, no. 2, pp. 73-83, 2006.
  2. M. Y . Kim, D. K. Kim, and Y. J. Cho, "A Study on the development of the interactive emotional contents player platform," The Jornal of the Korea Institute of Maritime Information & Communication Sciences, vol. 14, no. 7, pp. 1572-1580, 2010. https://doi.org/10.6109/jkiice.2010.14.7.1572
  3. S. H. Jung, "Development direction of emotional contents analysis of successful cases from applying emotional technology," Korean Journal of the Science of Emotion & Sensibility, vol.15, no.1, pp. 121-132, 2012.
  4. Makara vanny, K. E. Ko, S. M. Park, K. B. Sim, "Physiological responses-based emotion recognition using multi-class SVM with RBF kernel," Journal of Institute of Control, Robotics and Systems, vol. 19, no. 4, pp. 364-371, 2013. https://doi.org/10.5302/J.ICROS.2013.13.1879
  5. J. H. Choi, J. H. Hong, M. Y. Kwon, S. D. Park, T. J. Park, S. C. Jun, "Physical characteristic analysis of IAPS for emotional processing EEG study," HCI 2013, pp. 741-744, Jan. 2013.
  6. E. S. Song, H. R. Lee, "A study on bio-sensing systems for interactive media arts - mainly with sound and image generation system by brainwave-," Korea Digital Design council, vol. 13, no. 1, pp. 25-33, Jan. 2013.
  7. H. J. Suk, S. H. Jeong, J. M. Park, J. Y. Park, E. V. Chung, "Emotional Responses to the Color Modes of a Picture," Journal of Korean Society for Sience of Design, vol. 20, no. 5, pp229-238, Nov. 2007.
  8. W. H. Jung, S. J. Park, S. J. Shin, J. H. Han, "Effects of Brightness, Contrast, and Color Tone on the Affective Impressions of Photographic Images," The Society of Korean Photography, vol. 14, pp. 149-156, 2006.
  9. E. H. Jang, Y. G. Eum, S. H. Kin, J. H. Sohn, "Discrimination of Three Emotions using Parameters of Autonomic Nervous System Responses," The Ergonomics Society of Korea, vol. 2011 no.5, pp. 359 - 363, 2011.
  10. Gouizi Khadidja, Fethi BEREKSI REGUIG, Dr Choubeila MAAOUI, 2011, "Analysis physiological signals for emotion recognition", Systems, Signal Processing and their Applications (WOSSPA), pp.147 - 150.
  11. M. Y. Kim, K. S. Park, D. K. Kim, Y. J. Cho, "A study of the effects on users' emotional changes by 2D and 3D emorional video contents," Journal of the Korea Society of Computer and Information, vol. 25, no.3, pp.165-174, Sep. 2012.
  12. B. C. Min, S. C. Chung, I. H. Kang, J. Y. Choi, C. J. Kim, "Evaluation of two-Dimensional Space of Human Sensibility Mutation by IAPS," Korean Journal of the science of Emotion & sensibility, vol. 6, no.2, pp.21-28, June. 2003.
  13. Russell, J. A., "A circumplex model of affect," Journal of Personality and Social Psychology, Vol. 39, No.6, pp. 1161-1178, Dec. 1980. https://doi.org/10.1037/h0077714
  14. J. H. Kim, S. M. Ahn, J. U. Park, M. C. Whang, D. K. Kim, "The XML based Real-time Emotion Information Sharing System using Physiological Signals," The Korean Institute of Information Technology, vol.10, no.3, pp. 205-211, 2012.
  15. J. M. Lee, Art of color combinations, 3th ed. Seoul, iljinsa, 2009.

Cited by

  1. 감성 상태 기반의 영상 저작물 스토리 분석 시스템 및 분석 방법 개발에 관한 연구 vol.18, pp.6, 2015, https://doi.org/10.18108/jeer.2015.18.6.64
  2. Real-Time Mobile Emotional Content Player Using Smartphone Camera-Based PPG Measurement vol.2019, pp.None, 2019, https://doi.org/10.1155/2019/5820437