A Resampling Method for Small Sample Size Problems in Face Recognition using LDA

LDA를 이용한 얼굴인식에서의 Small Sample Size문제 해결을 위한 Resampling 방법

  • Oh, Jae-Hyun (Division of Electrical and Computer Engineering, Ajou University) ;
  • Kwak, Jo-Jun (Division of Electrical and Computer Engineering, Ajou University)
  • Published : 2009.03.25

Abstract

In many face recognition problems, the number of available images is limited compared to the dimension of the input space which is usually equal to the number of pixels. This problem is called as the 'small sample size' problem and regularization methods are typically used to solve this problem in feature extraction methods such as LDA. By using regularization methods, the modified within class matrix becomes nonsingu1ar and LDA can be performed in its original form. However, in the process of adding a scaled version of the identity matrix to the original within scatter matrix, the scale factor should be set heuristically and the performance of the recognition system depends on highly the value of the scalar factor. By using the proposed resampling method, we can generate a set of images similar to but slightly different from the original image. With the increased number of images, the small sample size problem is alleviated and the classification performance increases. Unlike regularization method, the resampling method does not suffer from the heuristic setting of the parameter producing better performance.

본 논문에서는 LDA를 이용한 얼굴 인식에서 발생하는 small sample size 문제를 해결하기 위한 효율적인 방법인 resampling 방법을 제안한다. 기존에는 regularization method를 사용하여 small sample size 문제를 해결하였는데, 이 방법을 사용하면 클래스내 분산행렬의 특이성을 없앨 수 있지만, 클래스내 분산행렬과 상수를 곱하는 과정에서 상수 값을 임의로 정해 주어야 하고, 이 상수 값에 따라 인식률이 개선되지 않을 수 있다는 문제점이 발생한다. 제안된 resampling 방법을 이용하여 학습 데이터의 수를 늘리면, regularization method보다 개선된 인식률을 얻을 수 있고, 또한 경험적으로 상수 값을 지정해 주는 과정을 거치지 않아도 되는 장점이 있다.

Keywords

References

  1. J. Yang, Y. Yu, and W. Kunz, 'An efficient LDA algorithm for face recognition,' Proceedings of the Sixth International Conference on Control, Automation, Robotics and Vision, Vol.33, No.10, 2000
  2. B. Heisele, P. Ho, and T. Poggio, 'Face recognition with support vector machines: global versus component-based approach,' In Proc. 8th International Conference on Computer Vision, Vol.2, pp.688-694, July, 2001 https://doi.org/10.1109/ICCV.2001.937693
  3. 'A New LDA-based Face Recognition System Which Can Solve the small sample size problem,' Pattern Recognition, Vol.33, No.10, 2000 https://doi.org/10.1016/S0031-3203(99)00139-9
  4. Rui Huang, Qingshan Liu, Hanging Lu and Songde Ma, 'Solving the small sample size problem of LDA,' 16th International Conference on Pattern Recognition ,Vol.3, pp. 29-32, 2002
  5. 한학용, 패턴인식개론, 한빛미디어, 2005
  6. M. Turk, A. Pentland, 'Face recognition using eigenfaces,' Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 586-591, 1991
  7. P. J. Phillips, H. Wechsler, J. Huang, and P. J. Rauss, 'The FERET database and evaluation procedure for face recognition algorithm,' Image and Vision Computing, Vol 16, No.5, pp. 295-306, 1988 https://doi.org/10.1016/S0262-8856(97)00070-X
  8. Gonzalez.R.C., Woods.R.E., Eddins.S.L., "Digital Image Processing Using MATLAB," Prentice-Hall, pp. 12-64, Inc, 2004
  9. 홍은혜, 고병철, 변혜란, 'PCA와 LDA를 이용한 실시간 얼굴 검출 및 검증기법,' 정보과학회논문지 : 소프트웨어 및 응용, 31(2), pp. 213~223, Feb, 2004.
  10. Ganhua Li, Xuanping Cai and Xianshuai Li, 'An Efficient Face Normalization Algorithm Based on Eyes Detection,' Proceedings of the 2006 IEEE/RSJ, pp.3843-3848, Oct, 2006
  11. National Institute of Standards and Technology, the FERET database. http://www.itl.nist.gov/iad/humanid/feret/
  12. AT&T Laboratories Cambridge, AT&T database. http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html