KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Noisy label based discriminative least squares regression and its kernel extension for object identification

  • Liu, Zhonghua (Information Engineering College, Henan University of Science and Technology) ;
  • Liu, Gang (Information Engineering College, Henan University of Science and Technology) ;
  • Pu, Jiexin (Information Engineering College, Henan University of Science and Technology) ;
  • Liu, Shigang (School of Computer Science, Shaanxi Normal University)
  • Received : 2016.10.02
  • Accepted : 2017.02.27
  • Published : 2017.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

In most of the existing literature, the definition of the class label has the following characteristics. First, the class label of the samples from the same object has an absolutely fixed value. Second, the difference between class labels of the samples from different objects should be maximized. However, the appearance of a face varies greatly due to the variations of the illumination, pose, and expression. Therefore, the previous definition of class label is not quite reasonable. Inspired by discriminative least squares regression algorithm (DLSR), a noisy label based discriminative least squares regression algorithm (NLDLSR) is presented in this paper. In our algorithm, the maximization difference between the class labels of the samples from different objects should be satisfied. Meanwhile, the class label of the different samples from the same object is allowed to have small difference, which is consistent with the fact that the different samples from the same object have some differences. In addition, the proposed NLDLSR is expanded to the kernel space, and we further propose a novel kernel noisy label based discriminative least squares regression algorithm (KNLDLSR). A large number of experiments show that our proposed algorithms can achieve very good performance.

Keywords

References

  1. Y. Xu, A. Zhong, et al., "LPP solution schemes for use with face recognition," Pattern Recognition, 43(12):4165-4176, 2010. https://doi.org/10.1016/j.patcog.2010.06.016
  2. Wankou Yang, Zhenyu Wang, Changyin Sun., "A collaborative representation based projections method for feature extraction," Pattern Recognition, 48(1): 20-27, 2015. https://doi.org/10.1016/j.patcog.2014.07.009
  3. Z. Lai, Y. Xu, et al, "Multilinear sparse principal component analysis," IEEE Transactions on Neural Networks and learning Systems,25(10): 1942-1950, 2014. https://doi.org/10.1109/TNNLS.2013.2297381
  4. Lingfen Wang, Huaiyu Wu, "Chunhong Pan. Manifold regularized local sparse representation for face recognition," IEEE Transactions on Circuits and Systems for Video Technology, 25(4): 651-659, 2015. https://doi.org/10.1109/TCSVT.2014.2335851
  5. J. Wu, S. Pan, X. Zhu, C. Zhang, and X, Wu, "Positive and Unlabeled Multi-Graph Learning," IEEE Trans. Cybern, 2016.
  6. J. Wu, S. Pan, X. Zhu, Z. Cai, "Boosting for Multi-Graph Classification," IEEE Trans. Cybern, 45(3): 416-429, 2015. https://doi.org/10.1109/TCYB.2014.2327111
  7. J. Wu, X. Zhu, C. Zhang, P. S. Yu, "Bag Constrained Structure Pattern Mining for Multi-Graph Classification," IEEE Trans. Knowl. Data Eng., 26(10): 2382-2396, 2014. https://doi.org/10.1109/TKDE.2013.2297923
  8. Fujiao Ju, Yangfeng Sun, et al, "Image outlier detection and feature extraction via L1-norm-based 2D probabilistic PCA," IEEE Transactions on Image Processing, 24(12): 4834-4846, 2015. https://doi.org/10.1109/TIP.2015.2469136
  9. Yong Xu, Xingjie Zhu, et al, "Using the original and 'symmetrical face training samples to perform representation based two-step face recognition," Pattern Recognition, 46: 1151-1158, 2013. https://doi.org/10.1016/j.patcog.2012.11.003
  10. Shenghua Gao, Yuting Zhang, et al, "Single sample face recognition via learning deep supervised autoencoders," IEEE Transactions on Information Forensics and Security, 10(10): 2108-2118,2015. https://doi.org/10.1109/TIFS.2015.2446438
  11. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(2): 210-227, 2009. https://doi.org/10.1109/TPAMI.2008.79
  12. Jun Yin, Zhonghua Liu, et al, "Kernel sparse representation based classification," Neurocomputing, 77(11): 120-128, 2012. https://doi.org/10.1016/j.neucom.2011.08.018
  13. Lingfeng Wang, Huaiyu Wu, Chunhong Pan, "Manifold regularized local sparse representation for face recognition," IEEE Transactions on Circuits and Systems for Video Technology, 25(4): 651-659, 2015. https://doi.org/10.1109/TCSVT.2014.2335851
  14. M. Yang and L. Zhang, "Gabor feature based sparse representation for face recognition with Gabor occlusion dictionary," in Proc. of 11th Eur. Conf. Comput. Vis. (ECCV), pp. 448-461, 2010.
  15. Ran He, Weishi Zheng, Baogang Hu, "Maximum correntropy criterion for robust face recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(8): 1561-1576, 2011. https://doi.org/10.1109/TPAMI.2010.220
  16. W. Liu, P.P. Pokharel, and J.C. Principe, "Correntropy: Properties and Applications in Non-Gaussian Signal Processing," IEEE Trans. Signal Processing, 55(11): 5286-5298, 2007. https://doi.org/10.1109/TSP.2007.896065
  17. X. Yuan and S. Yan, "Visual classification with multi-task joint sparse representation," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 3493-3500, Jun. 2010.
  18. L. Zhang, Meng Yang, Xiangchu Feng, "Sparse Representation or Collaborative Representation: Which Helps Face Recognition?" in ICCV 2011, pp.1-8, 2011.
  19. J. Wu, S. Pan, X. Zhu, P. Zhang, and C. Zhang, "Self-Adaptive One-Dependence Estimators for classification," Pattern Recognit., 51: 358-377, 2016. https://doi.org/10.1016/j.patcog.2015.08.023
  20. Meng Yang, Lei Zhang, et al, "Relaxed collaborative representation for pattern classification," in Proc. of International Conference on Wavelet Analysis and Pattern Recognition, pp.13-16, 2014.
  21. Yong Xu, David Zhang, et al., "A two-phase test sample sparse representation method for use with face recognition," IEEE Transactions on Circuits and Systems for Video Technology, 21(9): 1255-1262, 2011. https://doi.org/10.1109/TCSVT.2011.2138790
  22. R. Barsi and D. Jacobs, "Lambertian Reflection and Linear Subspaces. IEEE Trans," Pattern Analysis and Machine Intelligence, 25(2): 218-233, 2003. https://doi.org/10.1109/TPAMI.2003.1177153
  23. Roberto Togneri, Mohammed Bennamoun, "Linear regression for face recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(11): 2106-2112, 2010. https://doi.org/10.1109/TPAMI.2010.128
  24. X. Chai, S. Shan, X. Chen, and W. Gao, "Locally Linear Regression for Pose-Invariant Face Recognition," IEEE Trans. Image Processing, vol. 16, no. 7, pp. 1716-1725, July 2007. https://doi.org/10.1109/TIP.2007.899195
  25. Yong Xu, Xiaozhao Fang, et al, "Modified minimum squared error algorithm for robust classification and face recognition experiments," Neurocomputing, 135(5): 253-261, 2014. https://doi.org/10.1016/j.neucom.2013.11.025
  26. Jianjun Qian, Jian Yang, "General regression and representation model for face recognition," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp.166-172, 2013.
  27. Feiping Nie, Dong Xu, et al, "Flexible manifold embedding: A framework for semi-supervised and unsupervised dimension reduction," IEEE Transactions on Image Processing, 19(7): 1921-1932, 2010. https://doi.org/10.1109/TIP.2010.2044958
  28. Shiming Xiang, Feiping Nie, et al, "Discriminative least squares regression for multiclass classification and feature selection," IEEE Transactions on Neural Networks and Learning Systems, 23(11): 1738-1754, 2012. https://doi.org/10.1109/TNNLS.2012.2212721
  29. X. Cao, W. Shen, et al, "Illumination invariant extraction for face recognition using neighboring wavelet coefficients," Pattern Recognition, 45: 1299-1305, 2012. https://doi.org/10.1016/j.patcog.2011.09.010
  30. Amirhosein Nabatchian, Esam Abdel-Raheem, Majid Ahmadi, "Illumination invariant feature extraction and mutual-information-based local matching for face recognition under illumination variation and occlusion," Pattern Recognition, 44: 2576-2587, 2011. https://doi.org/10.1016/j.patcog.2011.03.012
  31. Meng Yang, Lei Zhang, et al, "Robust kernel representation with statistical local features for face recognition," IEEE Transactions on Neural Networks and Learning Systems, 24(6): 900-912, 2013. https://doi.org/10.1109/TNNLS.2013.2245340
  32. Cuicui Kang, Shengcai Liao, et al, "Kernel sparse representation with pixel-level and region-level local feature kernels for face recognition," Neurocomputing, 133(10): 141-152, 2014. https://doi.org/10.1016/j.neucom.2013.11.022
  33. M.A. Turk, A.P. Pentland, "Face recognition using eigenfaces," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 586-591, 1991.
  34. B. Scholkopf, A. Smola, K. R. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural computation, 10:1299-1319, 1998. https://doi.org/10.1162/089976698300017467
  35. Yong Xu, "A new kernel MSE algorithm for constructing efficient classification procedure," International Journal of Innovative Computing, Information and Control, 5(8): 2439-2447, 2009.
  36. A. Martinevz, and R. benavente, "The AR face database," CVC Tech. Report, No. 24, 1998.