DOI QR코드

DOI QR Code

Development of facial recognition application for automation logging of emotion log

감정로그 자동화 기록을 위한 표정인식 어플리케이션 개발

  • Shin, Seong-Yoon (School of Computer Information & Communication Engineering, Kunsan National University) ;
  • Kang, Sun-Kyoung (Department of Computer Software Engineering, Wonkwang University)
  • Received : 2017.03.27
  • Accepted : 2017.03.31
  • Published : 2017.04.30

Abstract

The intelligent life-log system proposed in this paper is intended to identify and record a myriad of everyday life information as to the occurrence of various events based on when, where, with whom, what and how, that is, a wide variety of contextual information involving person, scene, ages, emotion, relation, state, location, moving route, etc. with a unique tag on each piece of such information and to allow users to get a quick and easy access to such information. Context awareness generates and classifies information on a tag unit basis using the auto-tagging technology and biometrics recognition technology and builds a situation information database. In this paper, we developed an active modeling method and an application that recognizes expressionless and smile expressions using lip lines to automatically record emotion information.

지능형 라이프로그 시스템은 언제(When), 어디서(Where), 누구와 함께(Who), 어떤 상황에서(What, How), 일어나는 정보, 즉 사용자의 일상에서 발생되는 시간, 인물, 장면, 연령대, 감정, 관계, 상태, 위치, 이동 경로 등의 다양한 상황정보들을 인식하여 태그를 달아 사용자의 일상생활을 기록하고 쉽고 빠르게 접근하도록 제공하는 것이다. 상황인식은 자동태킹(Auto-Tagging) 기술과 생체인식 기술인 얼굴인식을 이용해, 태그(Tag) 단위의 정보를 자동으로 생성하고 분류되어 상황정보 DB을 구축한다. 상황정보 DB에는 지리정보, 위치정보, 날씨정보, 감정정보 등을 포함하고 있다. 본 논문에서는 감정정보를 자동으로 기록하기 위해서 능동형태 모델 방법을 사용해 무표정과 웃는표정을 인식하는 어플리케이션을 개발하였다.

Keywords

References

  1. X. W. Wayne, F. Miao, "Networked Creativity on the Censored Web 2.0: Chinese Users' Twitter-based Activities on the Issue of Internet Censorship," Journal of Contemporary Eastern Asia, vol. 14, no. 1 , pp.23-43, Nov. 2015. https://doi.org/10.17477/jcea.2015.14.1.023
  2. S. K. Kang, S. Y. Shin, H. Ch. Lee, "Development of Intelligent Auto Tagging-LifeLog Agent Application," Proceedings of AWITC 2017, KIICE, Busan, pp. 46-47, Feb. 2017.
  3. E. R. Mohan, H. J. Lee, K. S. Calderon, "LifeVision: Integrating heart rate sensing in lifelogging camera for accurate risk diagnosis for the elderly," In: The 6th Intl. Convention on Rehabilitation Eng. and Assistive Tech, March 2012.
  4. J. S. Kim, W. S. Choi, J. H. Park, D. H. Lee, "An Efficient-keyword-searching Technique over Encrypted data on Smartphone Database," Journal of the Korea Institute of Information Security and Cryptology, vol. 24, no. 4, pp.739-751, June 2014. https://doi.org/10.13089/JKIISC.2014.24.4.739
  5. J. S. Kim, J. H. Kim, J. H. J, E. M. Jung, "The Auto Generation Scheme of Message Frame for Testing of the Information Service Devices," Journal of Korean Institute of Intelligent Systems, vol. 24, no. 4, pp.418-423, March 2014. https://doi.org/10.5391/JKIIS.2014.24.4.418
  6. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," Computer Vision and Pattern Recognition, vol. 1, pp.I-511- I-518, Sep. 2001.
  7. W. Ch. Song, S. K. Kang, J. K. Dong, S. T. Jung, "Detection of Lip Area and Smile Analysis for Self Smile Training," Proceedings of the 2011 2nd International Congress on Computer Applications and Computational Science, vol. 145, pp.267-272, 2012.