DOI QR코드

DOI QR Code

Virtual Dialog System Based on Multimedia Signal Processing for Smart Home Environments

멀티미디어 신호처리에 기초한 스마트홈 가상대화 시스템

  • Kim, Sung-Ill (Division of Electronic and Electrical Engineering, Kyungnam University) ;
  • Oh, Se-Jin (Radio Astronomy Division, Korea Astronomy and Space Science Institute)
  • Published : 2005.04.01

Abstract

This paper focuses on the use of the virtual dialog system whose aim is to build more convenient living environments. In order to realize this, the main emphasis of the paper lies on the description of the multimedia signal processing on the basis of the technologies such as speech recognition, speech synthesis, video, or sensor signal processing. For essential modules of the dialog system, we incorporated the real-time speech recognizer based on HM-Net(Hidden Markov Network) as well as speech synthesis into the overall system. In addition, we adopted the real-time motion detector based on the changes of brightness in pixels, as well as the touch sensor that was used to start system. In experimental evaluation, the results showed that the proposed system was relatively easy to use for controlling electric appliances while sitting in a sofa, even though the performance of the system was not better than the simulation results owing to the noisy environments.

본 논문은 보다 편리한 가정 생활환경 구축을 목적으로 한 가상대화시스템 구현에 관한 연구이다. 이를 실현하기 위하여 본 논문은 음성인식, 음성합성, 비디오 신호 및 센서신호처리 등의 멀티미디어 신호처리에 그 기술적 기반을 두고 있다. 대화시스템의 중요한 모듈로서의 음성합성기, HM-Net(Hidden Markov Network)에 기반한 실시간 음성인식기, 픽셀의 밝기차를 이용한 실시간 움직임 검출 및 터치센서 등을 대화시스템에 통합함으로써 이루어진다. 실제 구동 실험에서 주위 노이즈 환경의 영향으로 시뮬레이션 결과보다는 성능이 떨어지나, 소파에 앉아있는 동안 자동되는 시스템의 실험 평가에서 가전제품 능의 컨트롤이 비교적 사용하기 쉬웠다는 결과를 얻었다.

Keywords

References

  1. J. Machate, 'Being natural - on the use of multimodal interaction concepts in smart homes', HCI(2), pp.937-941, 1999
  2. M. Kohler, 'Special Topics of Gesture Recognition Applied in Intelligent Home Environments', Lecture Notes in Computer Science, Vol.1371, pp.285-233, 1998
  3. M. Mozer, 'The neural network house: An environment that adapts to its inhabitants', Proc. AAAI Sym. on Intelligent Environments, pp.110-114, 1998
  4. D. J. Cook, M. Youngblood, E. Heierman, K. Gopalratnam, S. Rao, A. Litvin, and F. Khawaja, 'MavHome: An Agent-Based Smart Home', Proc. IEEE Int. Conf. on Pervasive Computing and Communications, pp.521-524, 2003
  5. P. M. Corcoran, F. Papai, A.Zoldi, 'User Interface Technologies for Home Appliances and Networks', IEEE Trans. on Consumer Electronics, August 1998
  6. M. Suzuki, S. Makino, A. Ito, H. Aso and H. Shimodaira, 'A new HMnet construction algorithm requiring no contextual factors,' IEICE Trans. Inf. & Syst., Vol. E78-D, No. 6, pp. 662-669, 1995
  7. M. Ostendoft and H. Singer, 'HMM Topology design Using Maximum Likelihood Successive State Splitting', Computer Speech and Language Vol. 11, pp. 17-41, 1997 https://doi.org/10.1006/csla.1996.0021
  8. J. Takami and S. Sagayama, 'A Successive State Splitting Algorithm for Efficient Allophone Modeling,' Proc. ICASSP'92, Vol. 1, pp. 573-576, 1992
  9. S-J Oh, C-J Hwang, B-K Kim, H-Y Chung, and A. Ito, 'New state clustering of hidden Markovnetwork with Korean phonological rules for speech recognition,' IEEE 4th work. on Multimedia Signal Processing, pp. 39-44, 2001
  10. S-J Oh, C-J Hwang, B-K Kim, H-Y Chung, 'Performance Evaluation of HM-Nets Speech Recognition System using the Large Vocabulary Korean Speech Databases,' Proc. Kyushu- Youngnam Joint Conf. on Acoustics, pp. 49-52, 2003

Cited by

  1. Real-time Streaming and Remote Control for the Smart Door-Lock System based on Internet of Things vol.25, pp.6, 2015, https://doi.org/10.5391/JKIIS.2015.25.6.565