DOI QR코드

DOI QR Code

A Design of Small Scale Deep CNN Model for Facial Expression Recognition using the Low Resolution Image Datasets

저해상도 영상 자료를 사용하는 얼굴 표정 인식을 위한 소규모 심층 합성곱 신경망 모델 설계

  • Received : 2020.12.02
  • Accepted : 2021.02.17
  • Published : 2021.02.28

Abstract

Artificial intelligence is becoming an important part of our lives providing incredible benefits. In this respect, facial expression recognition has been one of the hot topics among computer vision researchers in recent decades. Classifying small dataset of low resolution images requires the development of a new small scale deep CNN model. To do this, we propose a method suitable for small datasets. Compared to the traditional deep CNN models, this model uses only a fraction of the memory in terms of total learnable weights, but it shows very similar results for the FER2013 and FERPlus datasets.

인공 지능은 놀라운 혜택을 제공하는 우리 삶의 중요한 부분이 되고 있다. 이와 관련하여 얼굴 표정 인식은 최근 수십 년 동안 컴퓨터 비전 연구자들 사이에서 뜨거운 주제 중 하나였다. 저해상도 이미지의 작은 데이터 세트를 분류하려면 새로운 소규모 심층 합성곱 신경망 모델을 개발해야 한다. 이를 위해 소규모 데이터 세트에 적합한 방법을 제안한다. 이 모델은 기존 심층 합성곱 신경망 모델에 비해 총 학습 가능 가중치 측면에서 메모리의 일부만 사용하지만 FER2013 및 FERPlus 데이터 세트에서 매우 유사한 결과를 보여준다.

Keywords

References

  1. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet Classification with Deep Convolutional Neural Networks", In Advances in Neural Information Processing Systems 25: 26th Annual Conf. on Neural Information Processing Systems, New York, USA, Dec. 2012, pp. 1097-1105.
  2. J. Hu, L. Shen, S. Albanie, G. Sun, and E. Wu, "Squeeze-and-Excitation Networks," In IEEE Conf. on Computer Vision and Pattern Recognition, Salt Lake City, USA, 2018, pp. 7132-7141.
  3. M. I. Georgescu, R. T. Ionescu, and M. Popescu, "Local Learning with Deep and Handcrafted Features for Facial Expression Recognition," IEEE Access, vol. 7, 2019, pp. 64827-64836. https://doi.org/10.1109/access.2019.2917266
  4. K. Wang, X. Peng, J. Yang, D. Meng, and Y. Qiao, "Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition," IEEE Trans. on Image Processing, vol. 29, 2020, pp. 4057-4069. https://doi.org/10.1109/tip.2019.2956143
  5. S. Albanie, A. Nagrani, A. Vedaldi, and A. Zisserman, "Emotion Recognition in Speech using Cross-Modal Transfer in the Wild," In Proc. of the 26th ACM Int. conf. on Multimedia, Seoul, Korea, 2018, pp. 292-301.
  6. E. Barsoum, C. Zhang, C. C. Ferrer, and Z. Zhang, "Training Deep Networks for Facial Expression Recognition with Crowd-Sourced Label Distribution," In Proc. of the 18th ACM Inte. Conf. on Multimodal Interaction, Tokyo, Japan, 2016, pp. 279-283.
  7. J. Yoo, "An Extension of Unified Bayesian Tikhonov Regularization Method and Application to Image Restoration," J. of the Korea Institute of Electronic Communication Sciences, vol. 15, no. 01, 2020, pp. 161-166.
  8. J. Yoo, "A Unified Bayesian Tikhonov Regularization Method for Image Restoration," J. of the Korea Institute of Electronic Communication Sciences, vol. 11, no. 11, 2016, pp. 1129-1134. https://doi.org/10.13067/JKIECS.2016.11.11.1129
  9. J. Yoo, "Self-Regularization Method for Image Restoration," J. of the Korea Institute of Electronic Communication Sciences, vol. 11, no. 1, 2016, pp. 45-52. https://doi.org/10.13067/JKIECS.2016.11.1.45
  10. S. Kim and D. Cho, "Design and Implementation of Hashtag Recommendation System Based on Image Label Extraction using Deep Learning," J. of the Korea Institute of Electronic Communication Sciences, vol. 15, no. 4, 2020, pp. 709-716. https://doi.org/10.13067/JKIECS.2020.15.4.709
  11. Y. Kim, D. Kim, and S. Park, "Research on Robust Face Recognition against Lighting Variation using CNN," J. of the Korea Institute of Electronic Communication Sciences, vol. 12, no. 2, 2017, pp. 325-330. https://doi.org/10.13067/JKIECS.2017.12.2.325
  12. M. Ying and K. Kim, "CNN Based 2D and 2.5D Face Recognition For Home Security System," J. of the Korea Institute of Electronic Communication Sciences, vol. 14, no. 6, 2019, pp. 1207-1214. https://doi.org/10.13067/JKIECS.2019.14.6.1207