The Transactions of The Korean Institute of Electrical Engineers (전기학회논문지)

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지
DOI QR코드

DOI QR Code

Development of Bio-sensor-Based Feature Extraction and Emotion Recognition Model

바이오센서 기반 특징 추출 기법 및 감정 인식 모델 개발

  • Cho, Ye Ri (Dept. of Mechatronics, Korea University) ;
  • Pae, Dong Sung (School of Electrical Engineering, Korea University) ;
  • Lee, Yun Kyu (School of Electrical Engineering, Korea University) ;
  • Ahn, Woo Jin (School of Electrical Engineering, Korea University) ;
  • Lim, Myo Taeg (School of Electrical Engineering, Korea University) ;
  • Kang, Tae Koo (Dept. of Human Intelligence and Robot Engineering, Sangmyung University)
  • Received : 2018.05.29
  • Accepted : 2018.10.01
  • Published : 2018.11.01
Download PDF
⟨ Previous Next ⟩

Abstract

The technology of emotion recognition is necessary for human computer interaction communication. There are many cases where one cannot communicate without considering one's emotion. As such, emotional recognition technology is an essential element in the field of communication. n this regard, it is highly utilized in various fields. Various bio-sensor sensors are used for human emotional recognition and can be used to measure emotions. This paper proposes a system for recognizing human emotions using two physiological sensors. For emotional classification, two-dimensional Russell's emotional model was used, and a method of classification based on personality was proposed by extracting sensor-specific characteristics. In addition, the emotional model was divided into four emotions using the Support Vector Machine classification algorithm. Finally, the proposed emotional recognition system was evaluated through a practical experiment.

Keywords

References

  1. N. Fragopanagos, J.G. Taylor, "Emotion recognition in human-computer imteraction", Neural Networks, Vol. 18, No. 4, pp. 389-405, 2005. https://doi.org/10.1016/j.neunet.2005.03.006
  2. Eva hudlicka, "To feel or not to feel: The role of affect in human-computer interaction", International Journal of Human-Computer Studies, Vol. 59, No. 1-2, pp. 1-32, 2003. https://doi.org/10.1016/S1071-5819(03)00047-8
  3. Kim Su Jong, Kim Yeong Cheol, Lee Tae Soo, "Rendering of general paralyzed patient's emotion by using EEG", The Korean Institute of Electrical Engineers, pp. 343-344, 2007.
  4. Kim Moon Whan, Joo Yeong Hoon, Park Jin Bae, "Development of Facial Image Based Emotion Recongition System", Korea Fuzzy Logic and Intellignet System Society, Vol. 15, No. 1, pp. 433-436, 2005.
  5. Son Hee Su, Peon Sung Woo, Shin Bo Ra, Lee Seok Phil, "A building of Korean emotional speech DB sets", The Korean Institute of Electrical Engineers, pp. 138-139, 2017.
  6. Kim Won Ku, "Seech Emotion Recogntion using Features Selection and Fusion Method," The Korean Institute of Electrical Engineers, pp. 1265-1271, 2017.
  7. Kim Won Ku, "Emotional Speaker Recognition using Emotional Adaptation", The Korean Institute of Electrical Engineers, Vol. 66, No. 7, pp. 1105-1110, 2017.
  8. Gilsang Yoo, Sanghyun Seo, Sungdae Hong, "Emotion extraction based on multi bio-signal using backpropagation neural network", Multimedia Tools and App. lications, Vol. 77, No. 4, pp. 4925-4937, 2018. https://doi.org/10.1007/s11042-016-4213-5
  9. Qiang Zhang, Xianxiang Chen, Qingyuan Zhan, Ting Yang, Shanhong Xia, "Respiration-based emotion recognition with deep learning", Computers in Industries, Vol. 92-93, pp. 84-90, 2017. https://doi.org/10.1016/j.compind.2017.04.005
  10. Park So Eun, Kim Dae Hee, Lee Cheol, Kwon Sun Il, Park Neung Soo, "Voice Emotion Recognition Machine Learning Algorithm based on RNN", The Korean Institute of Electrical Engineers, pp. 152-153, 2017
  11. Ho Seok Ahn, Jin Young Choi, "Personallity Based Emotional Model Using 3D Character Head Robot System", The Korean Institute of Electrical Engineers, pp. 325-326, 2008.
  12. Colibazzi, Tiziano, Posner, Jonathan, Wang, Zhishun, Gorman, Daniel, Gerber, Andrew, Yu, Shan, Zhu, Hongtu, Kangarlu, Alayar, Duan, Yunsuo, Russell, James A, Peterson, Bradley S, "Neural systems subserving valence and arousal during the experience of induced emotions", American Psychological Association, Vol. 10(3) pp. 377-389, 2010
  13. McCrae, R. R., And john, O. P., "An introduction to the five-factor model and its app. lications. Special Issue: The fice-factor model: Issues and applications," Journal of Personallity, Vol. 60, pp. 119-121, 1992.
  14. Digman, J. M., "Personallity structure : Emergence of the five factor model," Annual Review of Psychology, Vol. 41, pp. 417-440, 1990. https://doi.org/10.1146/annurev.ps.41.020190.002221
  15. Sandra Koelstra, Christian Muhl, Mohammad Soleymani, Jong-Seok Lee, Ashkan Yazdani, Touradj Ebrahimi, Thierry Pun, Anton Nijholt, Ioannis Patras, “DEAP: A Database for Emotion Analysis Using Physiological Signals,” IEEE Transactions on Affective Computing, Vol. 3, No. 1, pp. 18-31, 2012. https://doi.org/10.1109/T-AFFC.2011.15
  16. Jonghwa Kim, Elisabeth Andre, "Emotion recognition based on Physiological changes in music listening", IEEE Transaction on Pattern Analysis and Macning Intelligence, Vol. 30, No. 12, pp. 2067-2083, 2008. https://doi.org/10.1109/TPAMI.2008.26
  17. Ki-Jong Park, Heejoeng Jeong, "Assessing Method of Heart Rate Variability, Korean J Clin Neurophysiol, Vol. 16, No. 2, pp. 49-54, 2014. https://doi.org/10.14253/kjcn.2014.16.2.49
  18. Angkoon Phinyomark, Pornchai Phukpattaranont, Chusak Limsakul, "Feature reduction and selection for EMG signal classifiaction", Expert Systems with App. lications, Vol. 39, No. 8, pp. 7420-7431, 2012. https://doi.org/10.1016/j.eswa.2012.01.102
  19. Mathias M. Adankon, Mohamad Cheriet, "Supp. ort Vector Machine, Encyclopedia of Biometics, 2009.
  20. Park Jong Wook, Lee Hyo Ki, Choi Ho Sun, Lee Kyung Joong, "Sleep Stage Classification based on SVM Classifier using Photoplethysmography", pp. 382-383, 2013.
  21. Sumedha Kshirsagar, Nadia Nagnenat-Thalmann, "A Multilayer Personality Model", International Symposium on Smart graphics, Vol. 2, pp. 107-115, 2002.
  22. www.physiolab.co.kr
  23. Vladimir J. Konecni, "Music Causes Emotion: A Responed Critique", Journal of Biomusical Emgineering, Vol. 3, pp. 1-2, 2015.
  24. Hui-Min Wang, Sheng-Chieh Huang "Musical Rhythms Affect Heart Rata Variability: Algorithm and Models", Hindawi Publishing Corporation Advances in Electrical Engineering, Vol. 851769, 2017.
  25. Khairun Nisa Minhad, Sawal Hamid Md Ali, Mamun Bin Ibne Reaz, "Happ. y-anger emotions classifications from electrocardiogram signal for automobile driving safety and awareness", Journal of Transport and Health, Vol. 7, pp. 75-89, 2017. https://doi.org/10.1016/j.jth.2017.11.001
  26. Ayoung Noh, Youngjoon Kim, Hyeong-Su Kim, Won-Tae Kim, "Smart Emotion Management System based on multi-biosignal Analysis using Artificial Intelligence", Institute of Korean Electrical and Electronics Engineers, Vol. 21, pp. 397-403, 2017.