DOI QR코드

DOI QR Code

Improvement of Face Recognition Rate by Normalization of Facial Expression

표정 정규화를 통한 얼굴 인식율 개선

  • 김진옥 (대구한의대학교 정보경영대학 모바일콘텐츠학부)
  • Published : 2008.10.31

Abstract

Facial expression, which changes face geometry, usually has an adverse effect on the performance of a face recognition system. To improve the face recognition rate, we propose a normalization method of facial expression to diminish the difference of facial expression between probe and gallery faces. Two approaches are used to facial expression modeling and normalization from single still images using a generic facial muscle model without the need of large image databases. The first approach estimates the geometry parameters of linear muscle models to obtain a biologically inspired model of the facial expression which may be changed intuitively afterwards. The second approach uses RBF(Radial Basis Function) based interpolation and warping to normalize the facial muscle model as unexpressed face according to the given expression. As a preprocessing stage for face recognition, these approach could achieve significantly higher recognition rates than in the un-normalized case based on the eigenface approach, local binary patterns and a grey-scale correlation measure.

얼굴의 기하학적 특징이 변하여 생기는 표정은 얼굴 인식 시스템의 인식 결과에 다양한 영향을 끼친다. 얼굴 인식율을 개선하기 위해 본 연구에서는 인식 대상 얼굴과 참조 얼굴 사이의 표정 차이를 줄이는 방법으로 얼굴 표정 정규화를 제안한다. 본 연구에서는 대형의 이미지 데이터베이스를 구축하지 않고도 한 개의 정지 이미지에 일반적인 얼굴 근육 모델을 이용하는 접근 방식을 제시하여 얼굴 표정 모델링과 정규화를 처리한다. 첫 번째 방식은 본능적으로 변하는 얼굴 표정의 생물학적 모델을 구축하기 위해 선형 근육 모델의 기하학적 계수를 예측하는 것이다. 두 번째 방식은 RBF(Radial Basis Function)기반의 보간과 와핑을 통해 주어진 표정에 따라 얼굴 근육 모델을 무표정한 얼굴로 정규화한 것이다. 실험 결과, 기저얼굴 방식, 지역 이진 패턴 방식, 회색조 상관측정 방식과 같은 얼굴 인식 과정의 전처리 단계로 본 연구의 표정 정규화 과정을 적용하면 정규화를 거치지 않은 것보다 더 높은 인식율을 보인다.

Keywords

References

  1. Pillips P. J., Flynn P. J., Scruggs T., Bowyer K., Chang J., Hoffman K., Marques J., Min J. and Worek W., “Overview of the Face Recognition Grand Challenge,” 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol.1, pp.947-954, 2005 https://doi.org/10.1109/CVPR.2005.268
  2. Hay D., Young A. and Ellis A, “Routes through the Face Recognition System,” Journal of Exp. Psychol A-Human Exp., Vol.43, pp.761-791, 1991 https://doi.org/10.1080/14640749108400957
  3. Bronstein A. M., Bronstein M. M. and Kimmel R., “Expression-Invariant 3D Face Recognition,” Lecture Notes in Computer Science, Vol.2688, pp.62-69, Springer, 2003
  4. Ekman P., “Emotion in the Human Face,” Cambridge University Press, 1982
  5. Vetter T. and Poggio T., “Linear Object Classes and Image Synthesis from a Single Example Image,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.19, pp.733-742, 1997 https://doi.org/10.1109/34.598230
  6. Jiang D., Hu Y., Yan S., Zhang L., Zhang H. and Gao W., “Efficient 3D Reconstruction for Face Recognition,” Pattern Recognition, Vol.38, No.6, pp.787-798, Elsevier, 2004 https://doi.org/10.1016/j.patcog.2004.11.004
  7. Cootes T. and Taylor C., “Anatomical Statistical Models and their Role in Feature Extraction,” British Journal of Radiology, Vol.77, pp.133-S139, 2004 https://doi.org/10.1259/bjr/20343922
  8. Cootes T., Edwards G. J. and Taylor C., “Active Appearance Models,” IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol.23, pp.681-685, 2001 https://doi.org/10.1109/34.927467
  9. 신기한, 전준철, “동영상 기반 얼굴 애니메이션 콘텐츠 제작 기술”, 한국인터넷정보학회지, 8권 4호, pp.44-53, 2007
  10. Li C. and Barreto A., “Biometric Recognition of 3D Faces and Expressions,” Lecture Notes in Computer Science, Vol. 2688, pp.62-70, 2003
  11. Turk M. and Pentland A., “Eigenfaces for Recognition,” Journal of Cognitive Neuroscience, Vol.3, No.7, pp.71-86, 1991 https://doi.org/10.1162/jocn.1991.3.1.71
  12. Waters K., ”A Muscle Model for Animating three-dimensional Facial Expressions, Proceedings of SIGGRAPH87, Vol.21, pp.17-24, 1987 https://doi.org/10.1145/37401.37405
  13. Platt S. M. and Badler N. I., “Animating Facial Expressions,” Proceedings of 8th Annual Conference on Computer Graphics and Interactive Technique, pp.245-252, 1981 https://doi.org/10.1145/965161.806812
  14. M. Pantic and L. J. M. Rothkrantz, “Expert System for Automatic Analysis of Facial Expressions,” Image and Vision Computing, Vol.18, pp.881-905, 2000 https://doi.org/10.1016/S0262-8856(00)00034-2
  15. Ahonen T., Hadid A. and Pietikainen M., “Face Recognition with Local Binary Patterns,” Proc. of the 8th ECCV(European Conference on Computer Vision), pp.469-481, 2004
  16. S. Gundimada, L. Tao and V. Asari, “Face Detection Technique based on Intensity and Skin Color Distribution,” International Conference on Image Processing, Vol.2, pp.1413-1416, 2004 https://doi.org/10.1109/ICIP.2004.1419767
  17. 김진옥, “색상조합모델과 LM(Levenberg-Marquadt)알고리즘을 이용한 얼굴 영역 검출”, 한국정보처리학회 논문지 B, 14-B권, 4호, pp.255-262, 2007 https://doi.org/10.3745/KIPSTB.2007.14-B.4.255

Cited by

  1. Robust Facial Expression-Recognition Against Various Expression Intensity vol.16B, pp.5, 2009, https://doi.org/10.3745/KIPSTB.2009.16B.5.395