DOI QR코드

DOI QR Code

Brain-wave Analysis using fMRI, TRS and EEG for Human Emotion Recognition

fMRI와 TRS와 EEG를 이용한 뇌파분석을 통한 사람의 감정인식

  • 김호덕 (중앙대학교 전자전기공학부) ;
  • 심귀보 (중앙대학교 전자전기공학부)
  • Published : 2007.12.25

Abstract

Many researchers are studying brain activity to using functional Magnetic Resonance Imaging (fMRI), Time Resolved Spectroscopy(TRS), Electroencephalography(EEG), and etc. They are used detection of seizures or epilepsy and deception detection in the main. In this paper, we focus on emotion recognition by recording brain waves. We specially use fMRI, TRS, and EEG for measuring brain activity Researchers are experimenting brain waves to get only a measuring apparatus or to use both fMRI and EEG. This paper is measured that we take images of fMRI and TRS about brain activity as human emotions and then we take data of EEG signals. Especially, we focus on EEG signals analysis. We analyze not only original features in brain waves but also transferred features to classify into five sections as frequency. And we eliminate low frequency from 0.2 to 4Hz for EEG artifacts elimination.

많은 연구자들은 인간의 사고를 functional Magnetic Resonance Imaging (fMRI), Time Resolved Spectroscopy(TRS), Electroencephalography(EEG)등을 이용해서 두뇌 활동 영역을 연구하고 있다. 주로 의학 분야와 심리학의 영역에서 두뇌의 활동을 연구하여 간질이나 발작을 알아내고 거짓말 탐지 분야에서도 사용된다. 본 논문에서는 사람의 두뇌활동을 측정하여 인간의 감정을 인식하는 연구에 중점을 두었다. 특히, fMRI와 TRS 그리고 EEG를 이용해서 사람의 두뇌 활동을 측정하는 연구를 하였다. 많은 연구자들이 한 가지 측정 장치만을 사용하여서 측정하거나 fMRI와 EEG를 동시에 측정하는 연구를 진행하고 있다. 현재에는 단순히 두뇌의 활동을 측정하거나 측정 시 발생하는 잡음들을 제거하는 연구들에 중점을 두고 진행되고 있다. 본 연구에서는 fMRI와 TRS를 동시에 측정하여 얻은 두뇌 활동 데이터를 가지고 감정에 따른 활동영역의 EEG 신호를 측정하였다. EEG 신호분석에 있어서 기존의 뇌파만을 가지고 특징을 찾아내는 것을 넘어서 각각의 채널에서 기록되는 뇌파의 파형을 주파수에 따라서 분류하고 정확한 측정을 위해 낮은 주파수를 제거하고 연구자가 필요한 부분의 뇌파를 분석하였다.

Keywords

References

  1. Kazuhiko, Takahashi, 'Remarks on Emotion Recognition from Multi-Modal Bio-Potential Signal,' IEEE International Conference on Industrial Technology (ICIT), 2004
  2. G.J. M Huiskamp, 'Reduction of the Ballistocardiogram Artifact in Simultaneous EEG-fMRI using ICA,' Proc. of the IEEE Engineering in Medicine and Biology 27th Annual Conference, September 2005
  3. Zhongming Liu, Bin He, 'A New Multimodal Imaging Strategy for integrating fMRI with EEG,' Proc. of the 28th IEEE EMBS Annual International Conference, August 2006
  4. J.C. de Munck, SI Goncalves, PWJ Pouwels, JPA Kuijer, RM Heethaar, FH Lopes da Silva, 'Signal Processing Aspects of Simultaneously Recorded EEG, Pulse and fMRI,' Proc. of the 3rd IEEE International Biomedical Imaging : Macro to Nano, April 2006
  5. Mark D. Korhonen, David A. Clausi, M. Ed Jernigan, 'Modeling Emotional Content of Music Using System Identification,' IEEE Trans. on Systems, Man, and Cybernetics-Part B : Cybernetics, vol. 36, no. 3, June 2006
  6. Junya Tanaka, Mitsuhiro Kimura, Naoya Hosaka, Hiroyuki Sawaji, Kenichi sakakura, Kazushige Magtani, 'Decelopment of the EEG measurement technique under exercising,' Proc. of the 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, Septerber 2005
  7. Arnaud Delorme, Scott Makeig, 'EEG Changes Accompanying Learned Regulation of 12-Hz EEG Activity,' IEEE Trans. of Neural System and Rehabilitation Engineering, vol. 11, no. 2, June 2003
  8. Tamn Madan, Rajeev Agarwal, M.N.S. Swamy, 'Compression of long-term EEG using Power Spectral Density,' Proc. of the 26th Annual Internatioal Conference of the IEEE EMBS, September 2004
  9. Pari Jahankhani, Kenneth Revett, Vassilis Kodogiannis, 'Data Mining an EEG Dataset With an Emphasis on Dimensionality Reduction,' Proc. of the 2007 IEEE Symposium on Computational Intelligence and Data Mining, pp. 405-412, April 2007
  10. 이옥현, 석지아, 박미숙, 엄진섭, 권애란, 손진훈, '부정 정서와 관련된 뇌 활성화 영역', Proc. of KFIS Spring Conference, vol. 12, no. 1, 2006
  11. Russell, J.A., 'Evidence of convergent validity on the dimensions of affect,' Journal of Personality and Social Psychology. 36. 1152-1168 https://doi.org/10.1037/0022-3514.36.10.1152
  12. Ekman, P, 'Universals and cultural differences in facial expressions of emotion,' In J. Cole (Ed.), Nebraska Symposium on Motivation 1971. 19. 207-283. Lincoln, NE: University of Nebraska Press
  13. Wakako Nakamura, Kimitaka Anami, Takeyuki mori, Osamu Saitoh, Andrzej Cichocki, Shun-ichi Amari, 'Removal of Ballistcardiogram Artifacts From Simultaneously Recorded EEG and fMRI Data Using Independent Component Analysis,' IEEE Trans. Biomedical Engineering, Vol.53, No.7, July 2006