DOI QR코드

DOI QR Code

Development of concentration measurement system in online education based on OpenCV

온라인 교육을 위한 OpenCV 기반 집중도 측정 시스템 개발

  • Yim, Dae-Geun (Department of Information and Commuication Engineering, Sangmyung University) ;
  • Koh, Kyu Han (Dept. of Computer Science, California State University Stanislaus) ;
  • Jo, Jaechoon (Division of Computer Engineering, Hanshin University)
  • 임대근 (상명대학교 스마트정보통신공학과) ;
  • 고규한 (캘리포니아 주립대학교 스태니슬라우스 컴퓨터학과) ;
  • 조재춘 (한신대학교 컴퓨터공학부)
  • Received : 2020.09.25
  • Accepted : 2020.11.20
  • Published : 2020.11.28

Abstract

There have been many developments and innovations in the educational environments in line with the rapidly evolving information age. E-Learning is a representative example of this rapid evolution. However, E-Learning is challenging to maintain students' concentration because of the low engagement level and limited interactions between instructors and students. Additionally, instructors have limitations in identifying learners' concentration. This paper proposes a system that can measure E-learning users' concentration levels by detecting the users' eyelid movement and the top of the head. The system recognizes the eyelid and the top of the head and measures the learners' concentration level. Detection of the eyelid and the top of the head triggers an event to assess the learners' concentration level based on the users' response. After this process, the system provides a normalized concentration score to the instructor. Experiments with experimental groups and control groups were conducted to verify and validate the system, and the concentration score showed more than 90% accuracy.

빠르게 발전하고 있는 정보화 시대에 맞춰 교육환경에서도 많은 발전과 영향이 있다. 이에 대표적으로 이러닝(E-Learning)이 있다. 그러나 이러닝은 직접적인 교류와 참여율이 낮아 집중을 유지하기가 어렵고, 교수자 또한 학습자의 집중 여부를 파악하는데 한계가 있다. 본 논문은 이러닝을 사용하는 학습자의 집중도를 사용자 눈 개폐와 정수리 인식을 통하여 집중도 측정할 수 있는 시스템을 개발하였다. 본 시스템은 눈과 정수리를 인식하여 집중도를 측정하고 지표화하여 교수자에게 제공한다. 눈과 정수리를 인식한 경우 이벤트가 발생하고 사용자의 반응 결과에 따라 집중도가 지표화된다. 시스템 검증을위해 실험집단과 통제집단으로 실험하였고 집중도 지표가 90% 이상의 정확도를 보였다.

Keywords

References

  1. Korea Ministry of Government Legislation. (2018). Act on the Development of eLearning Industry and the Promotion of eLearning Utilization, Law No. 14998
  2. J. Redmon. (2016) You Only Look Once: Unified, Real -Time Object Detection, The IEEE Conference on Computer Vision and Pattern Recog nition (CVPR). 779-788
  3. S. C. Bae, Y. S. Lee & S. W. Choi, (2019). Vision-based Authentication and Registration of Facial Identity in Hospital Infor mation System, Journal of the Korea Society of Computer and Information 24(12), 59-65 DOI : 10.9708/jksci.2019.24.12.059
  4. S. Y. Lee & H. J. Kim, (2019). A Study on the Factors Affecting Flow in e-Learning Environment - Focusing on Interaction Factors and Affordance -. The Journal of the Korea Contents Association, 19(10), 522-534 DOI : 10.5392/JKCA.2019.19.10.522
  5. K. B. Noh, S. C. Nam & K. S. Song, (2012), Application of Eye-tracking in E-lea rning Evaluation, The Korean Association Of Computer Education,16(2), 271-276.
  6. D. J. Jung & J. O. Yoon. (2011). Human Activity Recognition using Model-based Gaze Direction Estimation, Journal of the Korea Industrial Information Systems Research. 16(4), 9-18. DOI : 10.9723/jksiis.2011.16.4.009
  7. E. M. Kim & J. W. Choi. (2019), Devel opment of e-learning support platform through real-time two-way communication, Korea Academy Industrial Cooperation Society, 20(7), 249-254. DOI : 10.5762/KAIS.2019.20.7.249
  8. G. H. Han & S. N. Beak, (2019). Effects of perceived quality of e-Learning system on user satisfaction and learning immersion. The e-Business Studies 20(7), 71-88 https://doi.org/10.20462/tebs.2019.12.20.7.71
  9. H. D. Lee. (2018). Clustering University e-Learning learners in the Perspective of Learning Analytics and Analyzing the Differences in A cademic Achievement among Clusters : Focused on Spatio-Temporal Data Relate to e-Learning. Journal of Lifelong Learning Society 14(3), 97-118 https://doi.org/10.26857/JLLS.2018.8.14.3.97
  10. D. H. Gong & K. C. Kwak (2009). Sleepiness Determination of Driver through the Frequency Analysis of the Eye Opening and Shutting. Journal of Korean Institute of Intelligent Systems 26(6), 464-470 DOI : 10.5391/JKIIS.2016.26.6.464
  11. D. O. Kim & J. K. Hong & H. R. Byun. (2014). Face Recognition Based on Facial Landmark Feature Descriptor in Unconstrained Environments. Journal of KIISE 41(9), 666-673. DOI : 10.5626/JOK.2014.41.9.666
  12. U. K. Park. (2006). The Technology Trends of E-Learning Industry and a Development Scheme of the Future E-Learning Technology. Journal of Science & Culture 3(1), 109-11