ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Design of Prototype-Based Emotion Recognizer Using Physiological Signals

  • Received : 2012.11.13
  • Accepted : 2013.04.01
  • Published : 2013.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study is related to the acquisition of physiological signals of human emotions and the recognition of human emotions using such physiological signals. To acquire physiological signals, seven emotions are evoked through stimuli. Regarding the induced emotions, the results of skin temperature, photoplethysmography, electrodermal activity, and an electrocardiogram are recorded and analyzed as physiological signals. The suitability and effectiveness of the stimuli are evaluated by the subjects themselves. To address the problem of the emotions not being recognized, we introduce a methodology for a recognizer using prototype-based learning and particle swarm optimization (PSO). The design involves two main phases: i) PSO selects the P% of the patterns to be treated as prototypes of the seven emotions; ii) PSO is instrumental in the formation of the core set of features. The experiments show that a suitable selection of prototypes and a substantial reduction of the feature space can be accomplished, and the recognizer formed in this manner is characterized by high recognition accuracy for the seven emotions using physiological signals.

Keywords

References

  1. J. Wagner, J. Kim, and E. Andre, "From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification," IEEE Int. Conf. Multimedia Expo, Amsterdam, July 2005, pp. 940-943.
  2. N. Sebe, I. Cohen, and T.S. Huang, "Multimodal Emotion Recognition," Handbook of Pattern Recognition and Computer Vision, Amsterdam: Publications of the Universiteit van Amsterdam, 2005.
  3. L. Li and J. Chen, "Emotion Recognition Using Physiological Signals," ICAT, 2006, pp. 437-446.
  4. E.L. Meerwijk and S.J. Weiss, "Toward a Unifying Definition of Psychological Pain," J. Loss Trauma, vol. 16, no. 5, 2011, pp. 402-412. https://doi.org/10.1080/15325024.2011.572044
  5. S.D. Kreibig, "Autonomic Nervous System Activity in Emotion: A Review," Bio. Psychology, vol. 84, 2010, pp. 394-421. https://doi.org/10.1016/j.biopsycho.2010.03.010
  6. T. Verhoef et al., "Bio-sensing for Emotional Characterization without Word Labels," 13th Int. Conf. Human-Comput. Interaction: Ambient, Ubiquitous, Intell. Interaction, San Diego, CA, USA, July 2009, pp. 693-702.
  7. C. Maaoui and A. Pruski, "Emotion Recognition through Physiological Signals for Human-Machine Communication," Cutting Edge Robotics 2010, Vedran Kordic, Ed., 2010, pp. 317-322.
  8. C.L. Stephens, I.C. Christie, and B.H. Friedman, "Autonomic Specificity of Basic Emotions: Evidence from Pattern Classification and Cluster Analysis," Bio. Psychology, vol. 84, 2010, pp. 463-473. https://doi.org/10.1016/j.biopsycho.2010.03.014
  9. E.-H. Jang et al., "Emotion Recognition by Machine Learning Algorithms Using Psychophysiological Signals," Int. J. Eng. Industries, vol. 3, no. 1, 2012, pp. 55-66. https://doi.org/10.4156/ijei.vol3.issue1.6
  10. B.-J. Park et al., "Seven Emotion Recognition by Means of Particle Swarm Optimization on Physiological Signals," Proc. 9th IEEE Int. Conf. Netw., Sensing, Control, 2012, pp. 277-282.
  11. C.M. Bishop, Neural Networks for Pattern Recognition, New York: Oxford University Press Inc., 1995.
  12. J. Kennedy, "The Particle Swarm: Social Adaptation of Knowledge," Proc. IEEE Int. Conf. Evolutionary Comput., 1997, pp. 303-308.
  13. K.E. Parsopoulos and M.N. Vrahatis, "On the Computation of All Global Minimizers through Particle Swarm Optimization," IEEE Trans. Evolutionary Comput., vol. 8, 2004, pp. 211-224. https://doi.org/10.1109/TEVC.2004.826076
  14. C.L. Huang and C.J. Wang, "A GA-Based Feature Selection and Parameters Optimization for Support Vector Machines," Expert Syst. Appl., vol. 31, 2006, pp. 231-240. https://doi.org/10.1016/j.eswa.2005.09.024
  15. H. Cheng et al., "Conditional Mutual Information-Based Feature Selection Analyzing for Synergy and Redundancy," ETRI J., vol. 33, no. 2, Apr. 2011, pp. 210-218. https://doi.org/10.4218/etrij.11.0110.0237
  16. J.X. Huang et al., "Feature-Based Relation Classification Using Quantified Relatedness Information," ETRI J., vol. 32, no. 3, June 2010, pp. 482-485. https://doi.org/10.4218/etrij.10.0209.0353
  17. D.W. Aha, D. Kibler, and M.K. Albert, "Instance-Based Learning Algorithms," Machine Learning, vol. 6, 1991, pp. 37-66.
  18. C. Gonzalez and V. Dutt, "Instance-Based Learning: Integrating Sampling and Repeated Decisions from Experience," Psychological Rev., vol. 118, 2011, pp. 523-551. https://doi.org/10.1037/a0024558
  19. D. Palomba et al., "Cardiac Responses Associated with Affective Processing of Unpleasant Film Stimului," Int. J. Psychophysiology, vol. 36, 2000, pp. 45-57. https://doi.org/10.1016/S0167-8760(99)00099-9
  20. J.J. Gross and R.W. Levenson, "Emotion Elicitation Using Films," Cognition Emotion, vol. 9, 1995, pp. 87-108. https://doi.org/10.1080/02699939508408966
  21. A. Gorini and G. Riva, "The Potential of Virtual Reality as Anxiety Management Tool: A Randomized Controlled Study in a Sample of Patients Affected by Generalized Anxiety Disorder," Trials, vol. 9, 2008, pp. 1-9. https://doi.org/10.1186/1745-6215-9-1
  22. J. Arroyo-Palacios and D.M. Romano, "Towards a Standardization in the Use of Physiological Signals for Affective Recognition Systems," Proc. Meas. Behavior, Aug. 2008, pp. 121-124.
  23. M. Toichi et al., "The Influence of Psychotic States on the Autonomic Nervous System in Schizophrenia," Int. J. Psychophysiology, vol. 31, 1999, pp. 147-154. https://doi.org/10.1016/S0167-8760(98)00047-6
  24. M.A. Abido, "Optimal Design of Power-System Stabilizers Using Particle Swarm Optimization," IEEE Trans. Energy Conversion, vol. 17, 2002, pp. 406-413. https://doi.org/10.1109/TEC.2002.801992
  25. B. Liu et al., "Improved Particle Swarm Optimization Combined with Chaos," Chaos, Solitons, Fractals, vol. 25, 2005, pp. 1261-1271. https://doi.org/10.1016/j.chaos.2004.11.095
  26. A.E. Yilmaz and M. Kuzuoglu, "Calculation of Optimized Parameters of Rectangular Microstrip Patch Antenna Using Particle Swarm Optimization," Microw. Opt. Technol. Lett., vol. 49, 2007, pp. 2905-2907. https://doi.org/10.1002/mop.22918
  27. Z.L. Gaing, "A Particle Swarm Optimization Approach for Optimum Design of PID Controller in AVR System," IEEE Trans. Energy Conversion, vol. 19, 2004, pp. 384-391. https://doi.org/10.1109/TEC.2003.821821
  28. R. Eberhart and Y. Shi, "Particle Swarm Optimization: Developments, Applications and Resources," Proc. IEEE Int. Conf. Evolutionary Comput., 2001, pp. 81-86.
  29. W.-Y. Loh, "Classification and Regression Trees," Wiley Interdisciplinary Rev: Data Mining Knowl. Discovery, vol. 1, 2011, pp. 14-23. https://doi.org/10.1002/widm.8
  30. J.R. Quinlan, C4.5: Programs for Machine Learning, San Mateo, CA: Morgan Kaufmann, 1992.
  31. R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, 2nd ed., New York: Wiley-Interscience, 2000.
  32. J.M. Keller, M.R. Gray, and J.A. Givens, Jr., "A Fuzzy K-Nearest Neighbor Algorithm," IEEE Trans. Syst., Man, Cybern., vol. 15, no. 4, 1985, pp. 580-585.
  33. M.M Van Hulle, "Self-Organizing Maps," Handbook of Natural Computing: Theory, Experiments, and Applications, Springer-Verlag, 2010.

Cited by

  1. Analysis of Physiological Responses and Use of Fuzzy Information Granulation-Based Neural Network for Recognition of Three Emotions vol.37, pp.6, 2015, https://doi.org/10.4218/etrij.15.0114.0089
  2. Study on predicting sentiment from images using categorical and sentimental keyword-based image retrieval vol.72, pp.9, 2016, https://doi.org/10.1007/s11227-015-1510-0
  3. PPG 측정 장치에서의 온도 영향에 대한 연구 vol.12, pp.3, 2019, https://doi.org/10.17661/jkiiect.2019.12.3.306
  4. Reliability of Physiological Responses Induced by Basic Emotions: A Pilot Study vol.38, pp.1, 2019, https://doi.org/10.1186/s40101-019-0209-y
  5. Predicting Individuals’ Experienced Fear From Multimodal Physiological Responses to a Fear-Inducing Stimulus vol.16, pp.4, 2020, https://doi.org/10.5709/acp-0303-x