Advanced SearchSearch Tips
A Fast and Accurate Face Tracking Scheme by using Depth Information in Addition to Texture Information
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
A Fast and Accurate Face Tracking Scheme by using Depth Information in Addition to Texture Information
Kim, Dong-Wook; Kim, Woo-Youl; Yoo, Jisang; Seo, Young-Ho;
  PDF(new window)
This paper proposes a face tracking scheme that is a combination of a face detection algorithm and a face tracking algorithm. The proposed face detection algorithm basically uses the Adaboost algorithm, but the amount of search area is dramatically reduced, by using skin color and motion information in the depth map. Also, we propose a face tracking algorithm that uses a template matching method with depth information only. It also includes an early termination scheme, by a spiral search for template matching, which reduces the operation time with small loss in accuracy. It also incorporates an additional simple refinement process to make the loss in accuracy smaller. When the face tracking scheme fails to track the face, it automatically goes back to the face detection scheme, to find a new face to track. The two schemes are experimented with some home-made test sequences, and some in public. The experimental results are compared to show that they outperform the existing methods in accuracy and speed. Also we show some trade-offs between the tracking accuracy and the execution time for broader application.
Face detection;Face tracking;Adaboost algorithm;Template resizing;Early termination;
 Cited by
M.-H. Yang, D. J. Kriegman and N. Ahuja, "Detecting Faces in Images; A Survey," IEEE Trans. On Pattern Analysis and Machine Intelligence, Vol. 24, No. 1, pp. 34-58, Jan. 2002. crossref(new window)

P. Viola and M. Jones, "Rapid Object Detection using a Boosted Cascade of Simple Features," Conf. on Computer Vision and Pattern Recognition, pp. 1-9, 2001.

P. Viola and M. Jones, "Robust Real-time Object Detection," Intl. Workshop on Statistical and computational Theories of Vision-Modeling, Learning, Computing, and Sampling, pp. 1-25, 2001.

P. Viola and M. Jones, "Robust Real-Time Face Detection," J. of Compter Vision, 57(2), pp. 137-154, 2004. crossref(new window)

C. E. Erdem, S. Ulukaya, A. Karaali and A. T. Erdem, "Combining Haar Feature and Skin Color Based Classifiers for Face Detection," Conf. Acoustics, Speech and Signal Processing, pp. 1497-1500, 2011,

S. A. Inalou and S. Kasaei, "AdaBoost-based Face Detection in Color Images with Low False Alarm," Conf. Computer Modeling and Simulation, pp. 107-111, 2010.

Y. Tu, F. Yi, G. Chen, S. Jiang and Z. Huang, "Fast Rotation Invariant Face Detection in Color Image Using Multi-Classifier Combination Method," Conf. EDT, pp. 211-218, 2010.

J. Wu, S. C. Brubaker, M. D. Mullin and J. M. Rehg, "Fast Asymmetric Learning for Cascade Face Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 30, No. 3, pp. 369-382, March 2008. crossref(new window)

Y.-W. Wu and X.-Y. Ai, "Face detection in color images using AdaBoost algorithm based on skin color information," Workshop on Knowledge Discovery and Data Mining, pp. 339-342, 2008.

Y. Tie and L. Guan, "Automatic face detection in video sequence using local normalization and optimal adaptive correlation techniques," J. Pattern Recognition 42, pp. 1859-1868, 2009. crossref(new window)

P. Shih and C. Liu, "Face detection using discriminating feature analysis and support vector machine," J. Pattern Recognition 39, pp. 260-276, 2006. crossref(new window)

A. Colombo, C. Cusano and R. Schettini, "3D face detection using curvature analysis", J. Pattern Recognition 39, pp. 444-455, 2006. crossref(new window)

C. A. Waring and X. Liu, "Face Detection Using Spectral Histograms and SVMs," IEEE trans. Syst., Man, And Cybernetics, Vol. 35, No. 3, pp. 467-476, Jun. 2005. crossref(new window)

W.-K. Tsao, A. J. T. Lee, Y.-H. Liu, T.-W. Chang and H.-H. Lin, "A Data mining Approach to Face Detection," J. Pattern Recognition 43, pp. 1039-1049, 2010. crossref(new window)

A. Sagheer and S. Aly, "An Effective Face Detection Algorithm based on Skin Color Information," Conf. Signal Image Technology and Internet Based Systems, pp. 90-96, 2012.

H. Fan, D. Zhou, R. Nie and D. Zhao, "Target Face Detection using Pulse Coupled Neural Network and Skin Color Model," Conf. Computer Science & Service System, pp. 2185-2188, 2012.

S. Kherchaoui and A. Houacine, "Face Detection Based on a Model of the Skin Color with Constraints and Template Matching," Conf. Machine and Web Intelligence, pp. 469-472, 2010.

H.-Y. Chen, C.-L Huang and C.-M. Fu, "Hybridboost Learning for Multi-pose Face Detection and Facial Expression Recognition," J. Pattern Recognition 41, pp. 1173-1185, 2008. crossref(new window)

C. Huang, H. Ai, Y. Li and S. Lao, "High- Performance Rotation Invariant Multiview Face Detection, IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 29, No. 4, pp. 671-686, April 2007. crossref(new window)

T. Maurer and C. Malsburg, "Tracking and Learning Graphs and Pose on Image Sequences of Faces," International Conf. Automatic Face and Gesture Recognition, pp. 176-181, 1996.

S. McKenna, S. Gong, R. Wurtz, J. Tanner and D. Banin, "Tracking Facial Feature Points with Gabor Wavelets and Shape Models," International Conf. on Audio and Video-based Biometric Person Authentication, pp. 35-42, 1997.

Q. Wang, W. Zhang, X. Tang, and H.-Y. Shum. "Realtime Bayesian 3-D Pose Tracking," IEEE Trans. Circuits Syst. Video Techn., Vol. 16, No. 12, pp. 1533-1541, Dec. 2006. crossref(new window)

W. Zhang, Q. Wang, and X. Tang. "Real Time Feature Based 3-D Deformable Face Tracking," ECCV, pp. 720-732, 2008.

T. Cootes and G. Edwards, "Active Appearance Models," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 23, No. 6, pp. 681-685, June 2001. crossref(new window)

T. Cootes, G. Wheeler, K. Walker and C. Taylor, "View-based Active Appearance Models," Image Vision Comput. Vol. 20, No. 9, pp. 657-664, 2002. crossref(new window)

J. -W. Sung and D. Kim, "Large Motion Object Tracking using Active Contour Combined Active Appearance Model," International Conference on Computer Vision Systems, p. 31, 2006.

M. Zhou, L. Liang, J. Sun and Y. Wang, "AAM based Face Tracking with Temporal Matching and Face Segmentation," IEEE Conf. on Computer Vision and Pattern Recognition, pp. 701-708, 2010.

P. Wang and Q. Ji, "Robust Face Tracking via Collaboration of Generic and Specific Models," IEEE Trans. Image Processing, Vol. 17, No. 7, pp. 1189-1199, July 2008. crossref(new window)

Y. Lui, J. Beveridge and L. Whitley, "Adaptive Appearance Model and Condensation Algorithm for Robust Face Tracking," IEEE Tran. Syst., Man, and Cybernetics, Vol. 40, No. 3, pp. 437-448, May 2010. crossref(new window)

Y. Raja, S. McKenna, and S. Gong, "Colour Model Selection and Adaptation in Dynamic Scenes," European Conference on Computer Vision, pp. 460-474, 1998.

G. Jang and I. Kweon, "Robust Real-time Face Tracking using Adaptive Color Model," International Symposium on Mechatronics and Intelligent Mechanical System for 21 Century, 2000.

H. Stern and B. Efros, "Adaptive Color Space Switching for Tracking under Varying Illumination," Image Vision Computation, Vol. 23, No. 3, pp. 353-364, 2005. crossref(new window)

H. Lee and D. Kim, "Robust Face Tracking by Integration of Two Separate Trackers: Skin Color and Facial Shape," J. pattern recognition, Vol. 40, pp. 3225-3235, March 2007. crossref(new window)

P. Vadakkepat, P. Lim, L. Silva, L. Jing and L. Ling, "Multimodal Approach to Human-Face Detection and Tracking" IEEE Trans. Industrial Electronics, Vol. 55, No. 3, pp. 1385-1393, March 2008. crossref(new window)

R. Qian, M. Sezan, K. Matthews, "A Robust Realtime Face Tracking Algorithm," International Conference on Image Processing, pp. 131-135, 1998.

X. Suau, J. Ruiz-Hidalgo and J. Casas, "Real-Time Head and Hand Tracking Based on 2.5D Data", IEEE Trans. Multimedia, Vol. 14, No. 3, pp. 575-585, June 2012. crossref(new window)

D. Chai, et al., "Locating Facial Region of a Headand -Shoulders Color Image," Int'l Conf. Automatic Face and Gesture Recognition, pp.124-129, April 1998.

R. C. Gonzalez and R. E. Woods, Digital Image Processing, 3rd Ed., Pearson Ed. Inc., Upper Saddle River, NJ, 2008.