DOI QR코드

DOI QR Code

강인한 음성 인식 시스템을 사용한 감정 인식

Emotion Recognition using Robust Speech Recognition System

  • 김원구 (군산대학교 전자정보공학부)
  • 발행 : 2008.10.25

초록

본 논문은 음성을 사용한 인간의 감정 인식 시스템의 성능을 향상시키기 위하여 감정 변화에 강인한 음성 인식 시스템과 결합된 감정 인식 시스템에 관하여 연구하였다. 이를 위하여 우선 다양한 감정이 포함된 음성 데이터베이스를 사용하여 감정 변화가 음성 인식 시스템의 성능에 미치는 영향에 관한 연구와 감정 변화의 영향을 적게 받는 음성 인식 시스템을 구현하였다. 감정 인식은 음성 인식의 결과에 따라 입력 문장에 대한 각각의 감정 모델을 비교하여 입력 음성에 대한 최종감정 인식을 수행한다. 실험 결과에서 강인한 음성 인식 시스템은 음성 파라메터로 RASTA 멜 켑스트럼과 델타 켑스트럼을 사용하고 신호편의 제거 방법으로 CMS를 사용한 HMM 기반의 화자독립 단어 인식기를 사용하였다. 이러한 음성 인식기와 결합된 감정 인식을 수행한 결과 감정 인식기만을 사용한 경우보다 좋은 성능을 나타내었다.

This paper studied the emotion recognition system combined with robust speech recognition system in order to improve the performance of emotion recognition system. For this purpose, the effect of emotional variation on the speech recognition system and robust feature parameters of speech recognition system were studied using speech database containing various emotions. Final emotion recognition is processed using the input utterance and its emotional model according to the result of speech recognition. In the experiment, robust speech recognition system is HMM based speaker independent word recognizer using RASTA mel-cepstral coefficient and its derivatives and cepstral mean subtraction(CMS) as a signal bias removal. Experimental results showed that emotion recognizer combined with speech recognition system showed better performance than emotion recognizer alone.

키워드

참고문헌

  1. Oh-Wook Kwon, etc "Emotion Recognition by Speech Signal", Proceedings of Eurospeech '2003, Vol. 1, pp. 125-128, Geneva, 2003
  2. K. R. Scherer, "Adding the Affective dimension : A New Look in Speech Analysis and Synthesis", Proceedings of ICSLP, 2002
  3. Noam Amir,"Classifying Emotions in Speech: a Comparison of Methods", Proceedings of Eurospeech '2001, Vol. 1, pp. 127-130, Aalborg, Denmark, 2001
  4. A. Nogueiras, etc,"Speech Emotion Recognition using Hidden Markov Models", Proceedings of Eurospeech '2001, Vol. 4, pp. 2679-2682, Aalborg, Denmark, 2001
  5. Rosalind W. Picard, Affective Computing, The MIT Press 1997
  6. Janet E. Cahn, "The Generation of Affect in Synthesized Speech", Journal of the American Voice I/O Society, Vol. 8, pp. 1-19, July 1990
  7. K. R. Scherer, D. R. Ladd, and K. E. A. Silverman, "Vocal Cues to Speaker Affect: Testing Two Models", Journal Acoustical Society of America, Vol. 76, No. 5, pp. 1346-1355, Nov. 1984 https://doi.org/10.1121/1.391450
  8. Iain R. Murray and John L. Arnott, "Toward the Simulation of Emotion in Synthetic Speech: A review of the literature on human vocal emotion", Journal of Accoustal Society of America, pp. 1097-1108, Feb. 1993
  9. C. E. Williams and K. N. Stevens, "Emotions and Speech: Some Acoustical Correlates", Journal Acoustical Society of America, Vol. 52, No. 4, pp. 1238-1250, 1972 https://doi.org/10.1121/1.1913238
  10. Michael Lewis and Jeannette M. Haviland, Handbook of Emotions, The Guilford Press 1993
  11. Rainer Banse and Klaus R. Scherer, "Acoustic Profiles in Vocal Emotion Expression", Journal of Personality and Social Psychology, Vol. 70, No. 3, pp. 614-636, 1996 https://doi.org/10.1037/0022-3514.70.3.614
  12. Frank Dellaert, Thomas Polzin, Alex Waibel, "Recognizing Emotion in Speech", Proceedings of the ICSLP 96, Philadelphia, USA, Oct. 1996
  13. Jun Sato, and Shigeo Morishima, "Emotion Modeling in Speech Production using Emotion Space", Proceedings of the IEEE International Workshop 1996, pp. 472-477, IEEE, Piscataway, NJ, USA., 1996
  14. Thomas S. Huang, Lawrence S. Chen and Hai Tao, "Bimodal Emotion Recognition by Man and Machine", ATR Workshop on Virtual Communication Environments-Bridges over Art/Kansei and VR Technologies, Kyoto, Japan, April 1998
  15. J. Koehler, N. Morgan, H. Hermansky, H. G. Hirsch, G. Tong, "Integrating RASTA-PLP into Speech Recognition", in Proc. ICASSP, pp. 421-424, 1994
  16. H. Hermansky, N. Morgan, A. Bayya, P. Kohn, "Compensation for the Effect of the Communication Channel in Auditory-Like Analysis of Speech(RASTA-PLP)", in Proc. EUROSPEECH, vol.3, pp. 1367-1370, Sep. 1991
  17. P.Alexandre, ect. "Root Cepstral Analysis: A Unified View. Application to Speech Processing in Car Noise Environments", Speech Communication, vol. 12, no. 3, pp. 277-288, 1993 https://doi.org/10.1016/0167-6393(93)90099-7
  18. M. G. Rahim, B. H. Juang, "Signal Bias Removal by Maximum Likelihood Estimation for Robust Telephone Speech Recognition", IEEE Trans. Speech & Audio Processing, vol. 4, No. 1, pp. 19-30, 1996 https://doi.org/10.1109/TSA.1996.481449
  19. L. R. Rabiner and B. H. Juang, Fundamentals of speech recognition, Prentice-Hall Inc., 1993