Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Multimodal Face Biometrics by Using Convolutional Neural Networks

  • Received : 2017.01.12
  • Accepted : 2017.01.20
  • Published : 2017.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

Biometric recognition is one of the major challenging topics which needs high performance of recognition accuracy. Most of existing methods rely on a single source of biometric to achieve recognition. The recognition accuracy in biometrics is affected by the variability of effects, including illumination and appearance variations. In this paper, we propose a new multimodal biometrics recognition using convolutional neural network. We focus on multimodal biometrics from face and periocular regions. Through experiments, we have demonstrated that facial multimodal biometrics features deep learning framework is helpful for achieving high recognition performance.

Keywords

References

  1. A. Ross and A.K. Jain, "Multimodal Biometrics: an Overview," Proceeding of European Signal Processing Conference, pp. 1221-1224, 2004.
  2. H. Li, Z. Lin, X. Shen, J. Brandt, and G. Hua, "A Convolutional Neural Network Approach for Face Identification," Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, pp. 5325-5334, 2015.
  3. M.M. Kasar, D. Bhattacharyya, and T.H. Kim, "Face Recognition Using Neural Network: a Review," International Journal of Security and Its Application, Vol. 10, No. 3, pp. 81-100, 2016.
  4. O. Abdelhamid, A. Mohamed, H. Jiang, L. Deng, G. Penn, and D. Yu, "Convolutional Neural Networks for Speech Recognition," IEEE Transactions Audio, Speech, Language Processing, Vol. 22, No. 10, pp. 1533-1545, 2014. https://doi.org/10.1109/TASLP.2014.2339736
  5. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and F.F. Li, "Large-Scale Video Classification with Convolutional Neural Networks," Proceeding of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1725-1732, 2014.
  6. Y Choi, H. Kim, and Y.M. Ro, "Local Feature Learning using Deep Canonical Correlation for Heterogeneous Face Recognition," Journal of Korea Multimedia Society, Vol. 19, No. 5, pp. 848-855, 2016. https://doi.org/10.9717/kmms.2016.19.5.848
  7. C.N. Padole and H. Proenca, "Periocular Recognition: Analysis of Performance Degradation Factors," Proceeding of International Association of Pattern Recognition International Conference on Biometrics, pp. 439-445, 2012.
  8. K.B. Raja, R. Raghavendra, R.R. Martin, and S. Christoph, "Fusion of Face and Periocular Information for Improved Authentication on Smartphones," Proceeding of International Conference on Information Fusion, pp. 2115- 2120, 2015.
  9. N.S. Lakshmiprabha, "Fusing Face and Periocular Biometrics Using Canonical Correlation Analysis," Proceeding of Computer Vision and Pattern Recognition, pp. 1-5, 2016.
  10. S. Prabhakar and A.K. Jain, "Decision-Level Fusion in Fingerprint Verification," Pattern Recognition, Vol. 35, No. 4, pp. 861-874, 2002. https://doi.org/10.1016/S0031-3203(01)00103-0
  11. K. Chang, K.W. Bowyer, S. Sarkar, and B. Victor, "Comparison and Combination of Ear and Face Images in Appearance-Based Biometrics," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, No. 9, pp. 1160-1165, 2003. https://doi.org/10.1109/TPAMI.2003.1227990
  12. B.J. Kang and K.R. Park, "Multimodal Biometric Authentication Based on the Fusion of Finger Vein and Finger Geometry," IET Computer Vision, Vol. 4, No. 3, pp. 209-217, 2009. https://doi.org/10.1049/iet-cvi.2009.0081
  13. U. Park, R.R. Jillela, A. Ross, and A.K. Jain, "Periocular Biometrics in the Visible Spectrum: a Feasibility Study," Proceeding of IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems, pp. 1-6, 2009.
  14. U. Park, R.R. Jillela, A. Ross, and A.K. Jain, "Periocular Biometrics in the Visible Spectrum," IEEE Transactions on Information Forensics Security, Vol. 6, No. 1, pp. 96-106, 2011. https://doi.org/10.1109/TIFS.2010.2096810
  15. Y. Lecun and Y. Bengio, Convolutional Networks for Images, Speech, and Time-Series, The Handbook of Brain Theory and Neural Networks, MIT Press, Cambridge, MA, 1995.
  16. K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," Proceeding of International Conference on Learning Representations, pp. 1-14, 2015.
  17. G. Hu, Y. Yang, D. Yi, J. Kittler, W. Christmas, S.Z. Li, et al., "When Face Recognition Meets with Deep Learning: an Evaluation of Convolutional Neural Networks for Face Recognition," Proceeding of IEEE International Conference on Computer Vision, pp. 384-392, 2015.
  18. Histogram Equalization, http://cache.freescale.com/files/dsp/doc/app_note/AN4318.pdf. (accessed Oct., 11, 2016).
  19. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust Face Recognition Via Sparse Representation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, No. 2, pp. 210-227, 2009. https://doi.org/10.1109/TPAMI.2008.79
  20. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker, "Multi-PIE," Image Visual and Computer Vision, Vol. 28, No. 5, pp. 807-813, 2010. https://doi.org/10.1016/j.imavis.2009.08.002
  21. Z. Zhu, P. Luo, X. Wang, and X. Tang, "Multi- View Perceptron : a Deep Model for Learning Face Identity and View Representations," Advanced in Neural Information Processing Systems, pp. 1-9, 2014.
  22. A. Wagner, J. Wright, A. Ganesh, Z. Zhou, H. Mobahi, and Y. Ma, "Toward a Practical Face Recognition System: Robust Alignment and Illumination by Sparse Representation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 34, No. 2, pp. 372-386, 2012. https://doi.org/10.1109/TPAMI.2011.112
  23. L. Zhang, M. Yang, X. Feng, and H. Kong, "Sparse Representation or Collaborative Representation: which Helps Face Recognition?," Proceedings of International Conference on Computer Vision, pp. 471-478, 2011.
  24. Z. Cao, Q. Yin, X. Tang, and J. Sun, "Face Recognition with Learning-Based Descriptor," Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2707-2714, 2010.

Cited by

  1. Implementation of multimodal biometric recognition via multi-feature deep learning networks and feature fusion vol.78, pp.16, 2017, https://doi.org/10.1007/s11042-019-7618-0
  2. Animal Face Classification using Dual Deep Convolutional Neural Network vol.23, pp.4, 2017, https://doi.org/10.9717/kmms.2020.23.4.525