ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Analysis of Physiological Responses and Use of Fuzzy Information Granulation-Based Neural Network for Recognition of Three Emotions

  • Received : 2014.08.08
  • Accepted : 2015.09.16
  • Published : 2015.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this study, we investigate the relationship between emotions and the physiological responses, with emotion recognition, using the proposed fuzzy information granulation-based neural network (FIGNN) for boredom, pain, and surprise emotions. For an analysis of the physiological responses, three emotions are induced through emotional stimuli, and the physiological signals are obtained from the evoked emotions. To recognize the emotions, we design an FIGNN recognizer and deal with the feature selection through an analysis of the physiological signals. The proposed method is accomplished in premise, consequence, and aggregation design phases. The premise phase takes information granulation using fuzzy c-means clustering, the consequence phase adopts a polynomial function, and the aggregation phase resorts to a general fuzzy inference. Experiments show that a suitable methodology and a substantial reduction of the feature space can be accomplished, and that the proposed FIGNN has a high recognition accuracy for the three emotions using physiological signals.

Keywords

References

  1. H.S. Park et al., "In-Vehicle AR-HUD System to Provide Driving-Safety Information," ETRI J., vol. 35, no. 6, Dec. 2013, pp. 1038-1047. https://doi.org/10.4218/etrij.13.2013.0041
  2. A. Yuce, N.M. Arar, and J.-P. Thiran, "Multiple Local Curvature Gabor Binary Patterns for Facial Action Recognition," LNCS, vol. 8212, Oct. 2013, pp. 136-147.
  3. J. Wagner, J. Kim, and E. Andre, "From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification," IEEE Int. Conf. Multimedia Expo, Amsterdam, Netherland, July 2005, pp. 940-943.
  4. O. Alaoui-Ismaili et al., "Basic Emotions Evoked by Odorants: Comparison between Autonomic Responses and Self-Evaluation," Physiology Behavior, vol. 62, no. 4, Oct. 1997, pp. 713-720. https://doi.org/10.1016/S0031-9384(97)90016-0
  5. D. Palomba et al., "Cardiac Responses Associated with Affective Processing of Unpleasant Film Stimuli," Int. J. Psychophysiology, vol. 36, no. 1, Apr. 2000, pp. 45-57. https://doi.org/10.1016/S0167-8760(99)00099-9
  6. G. Stemmler, "Physiological Processes during Emotion," in The Regulation Emotion, Mahwah, NJ, USA: Erlbaum, 2004, pp. 33-70.
  7. C.L. Stephens, I.C. Christie, and B.H. Friedman, "Autonomic Specificity of Basic Emotions: Evidence from Pattern Classification and Cluster Analysis," Biol. Psychology, vol. 84, no. 3, July 2010, pp. 463-473. https://doi.org/10.1016/j.biopsycho.2010.03.014
  8. B.-J. Park et al., "Design of Prototype-Based Emotion Recognizer Using Physiological Signals," ETRI J., vol. 35, no. 5, Oct. 2013, pp. 869-879. https://doi.org/10.4218/etrij.13.0112.0751
  9. E.-H. Jang et al., "Classification of Three Negative Emotions Based on Physiological Signals," INTELLI, Venice, Italy, Apr. 2013, pp. 75-78.
  10. R.P. Lippmann, "An Introduction to Computing with Neural Nets," IEEE ASSP Mag., vol. 4, no. 1, Apr. 1987, pp. 4-22. https://doi.org/10.1109/MASSP.1987.1165575
  11. A. Patrikar and J. Provence, "Pattern Classification Using Polynomial Networks," Electron. Lett., vol. 28, no. 12, 1992, pp. 1109-1110. https://doi.org/10.1049/el:19920700
  12. F. Ros, M. Pintore, and J.R. Chretien, "Automatic Design of Growing Radial Basis Function NNs Based on Neighborhood Concepts," Chemometrics Intell. Laboratory Syst., vol. 87, no. 2, June 2007, pp. 231-240. https://doi.org/10.1016/j.chemolab.2007.02.003
  13. D. Palomba et al., "Cardiac Responses Associated with Affective Processing of Unpleasant Film Stimulus," Int. J. Psychophysiology, vol. 36, no. 1, Apr. 2000, pp. 45-57. https://doi.org/10.1016/S0167-8760(99)00099-9
  14. J.J. Gross and R.W. Levenson, "Emotion Elicitation Using Films," Cognition Emotion, vol. 9, no. 1, 1995, pp. 87-108. https://doi.org/10.1080/02699939508408966
  15. R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, 2nd ed., New York, USA: Wiley-Interscience, 2000.
  16. F. Akiyama, "An Example of Software System Debugging," Inf. Process., vol. 71, 1971, pp. 353-379.
  17. J.C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms, New York, USA: Plenum Press, 1981.
  18. H. Helson and L. Quantius, "Changes in Skin Temperature Following Intense Stimulation," J. Experimental Psychology, vol. 17, no. 1, Feb. 1934, pp. 20-35. https://doi.org/10.1037/h0074670
  19. F. Talbot, "Skin Temperatures of Children," American J. Diseases Children, vol. 42, 1931, pp. 965-967.
  20. C. Iani, D. Gopher, and P. Lavie, "Effects of Task Difficulty and Invested Mental Effort on Peripheral Vasoconstriction," Psychophysiology, vol. 41, no. 5, Sept. 2004, pp. 789-798. https://doi.org/10.1111/j.1469-8986.2004.00200.x
  21. V.N. Salimpoor et al., "The Rewarding Aspects of Music Listening are Related to Degree of Emotional Arousal," PlosOne, vol. 4, no. 10, 2009, p. e7487. https://doi.org/10.1371/journal.pone.0007487
  22. J.M. Gottman et al., "The Relationship between Heart Rate Reactivity, Emotionally Aggressive Behavior and General Violence in Batterers," J. Family Psychology, vol. 9, no. 3, Sept. 1995, pp. 227-248. https://doi.org/10.1037/0893-3200.9.3.227
  23. S.D. Kreibig, "Autonomic Nervous System Activity in Emotion: a Review," Biol. Psychology, vol. 84, no. 3, July 2010, pp. 394-421. https://doi.org/10.1016/j.biopsycho.2010.03.010
  24. L. Breiman et al., "Classification and Regression Trees," Monterey, CA, USA: Wadsworth, Inc., 1984.
  25. J.R. Quinlan, "C4.5 Programs for Machine Learning," San Mateo, CA, USA: Morgan Kaufmann, 1992.
  26. J.M. Keller, M.R. Gray, and J.A. Givens, Jr., "A Fuzzy K-Nearest Neighbor Algorithm," IEEE Trans. Syst., Man, Cybern., vol. 15, no. 4, 1985, pp. 580-585.
  27. P.D. Wasserman, "Advanced Methods in Neural Computing," New York, USA: Van Nostrand Reinhold, 1993, pp. 35-55.
  28. T. Kohonen, "Self-Organizing Maps," Springer Series Inf. Sci., vol. 30, Heidelberg, Berlin: Springer, 2001, p. 501.
  29. C.M. Bishop, "Neural Networks for Pattern Recognition," Oxford, UK: Oxford Univ. Press, 1995.

Cited by

  1. Effects of Augmented-Reality Head-up Display System Use on Risk Perception and Psychological Changes of Drivers vol.38, pp.4, 2015, https://doi.org/10.4218/etrij.16.0115.0770
  2. Quantification of vascular function changes under different emotion states: A pilot study vol.25, pp.3, 2017, https://doi.org/10.3233/thc-161284