Real-Time Automatic Tracking of Facial Feature

얼굴 특징 실시간 자동 추적

  • Published : 2004.10.01

Abstract

Robust, real-time, fully automatic tracking of facial features is required for many computer vision and graphics applications. In this paper, we describe a fully automatic system that tracks eyes and eyebrows in real time. The pupils are tracked using the red eye effect by an infrared sensitive camera equipped with infrared LEDs. Templates are used to parameterize the facial features. For each new frame, the pupil coordinates are used to extract cropped images of eyes and eyebrows. The template parameters are recovered by PCA analysis on these extracted images using a PCA basis, which was constructed during the training phase with some example images. The system runs at 30 fps and requires no manual initialization or calibration. The system is shown to work well on sequences with considerable head motions and occlusions.

References

  1. Y. Tian, T. Kanade, and J. F. Cohn. Dual-state parametric eye tracking. In Proceedings of Conference on Automatic Face and Gesture Recognition, 2000
  2. Y. Tian, T. Kanade, and J. F. Cohn. Recognizing upper face action units for facial expression analysis. In Proceedings of Conference on Computer Vision and Pattern Recognition, June 2000
  3. I. Essa, S. Basu, T. Darrell, and A. Pentland. Modeling, tracking and interactive animation of faces and heads using input from video. In Proceedings of Computer Animation Conference, 1996
  4. M. J. Jones and T. Poggio. Multidimensional morphable models. In Proceedings of International Conference on Computer Vision, 1998
  5. T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active appearance models. Pattern Analysis and Machine Intelligence, 23(6), June 2001
  6. M. Covell.' Eigen-points. In Proceedings of International Conference Image Processing, September 1996
  7. M. Covell. Eigen-points: control-point location using principal component analyses. In Proceedings of Conference on Automatic Face and Gesture Recognition, October 1996
  8. C.Morimoto, D. Koons, A. Amir, and M. Flickner. Pupil detection and tracking using multiple light sources. Technical report, IBM Almaden Research Center, 1998
  9. A. Haro, I. Essa, and M. Flickner. Detecting and tracking eyes by using their physiological properties. In Proceedings of Conference on Computer Vision and Pattern Recognition, June 2000