DOI QR코드

DOI QR Code

외국어 능력 향상을 위한 사용자 안구운동 분석 기반의 지능형 학습도구 개발

Development of Intelligent Learning Tool based on Human eyeball Movement Analysis for Improving Foreign Language Competence

  • Shin, Jihye (School of Electronics Engineering, Kyungpook National University) ;
  • Jang, Young-Min (School of Electronics Engineering, Kyungpook National University) ;
  • Kim, Sangwook (School of Electronics Engineering, Kyungpook National University) ;
  • Mallipeddi, Rammohan (School of Electronics Engineering, Kyungpook National University) ;
  • Bae, Jungok (Department of English Education, Kyungpook National University) ;
  • Choi, Sungmook (Department of English Education, Kyungpook National University) ;
  • Lee, Minho (School of Electronics Engineering, Kyungpook National University)
  • 투고 : 2013.07.12
  • 발행 : 2013.11.25

초록

최근 효율적인 외국어 학습 및 테스트를 위한 교육 콘텐츠 개발에 대한 연구가 많이 되고 있다. 이러한 추세에 기반 하여, 온라인 학습 도구와 방송매체 등의 IT 기술을 이용한 e-learning 교육용 콘텐츠 개발이 급격하게 증가하고 있는 추세이다. 하지만 기존의 IT 기술을 이용한 교육용 콘텐츠들은 단방향의 학습 정보만을 제공하기에, 외국어 글을 이해하는 데는 사용자의 학습 편의를 제공하기 어렵다. 사용자 편의가 제공되려면 사용자의 학습 진단에 대한 부가적인 off-line 분석이 요구된다. 이에 본 논문에서는 사용자의 외국어 능력 향상을 위하여, 실시간(on-line)으로 학습 콘텐츠를 제공하여 외국어 능력을 진단하고, 향상시키기 위한 사용자 안구운동 분석 기반의 지능형 학습 도구를 제안한다. 이에 본 논문에서는 사용자 학습상태를 분석하기 위하여 인지심리학/신경생리학 기반의 사용자 학습상태와 관련된 안구 운동 특징 정보를 추출하고 판별 분석한다. 본 논문에서 제안하는 지능형 학습 도구는 앞서 언급한 사용자 안구운동 특징 정보를 기저로 하여 사용자가 외국어 읽기를 수행할 때, 사용자가 응시하고 있는 단어에 대하여, '안다/모른다'를 분석하여, 모르는 단어일 경우 실시간(on-line)으로 웹에서 단어를 검색하고, 정리하여 사용자에게 제공함으로써, 외국어로 된 글을 읽고 이해하는데 도움을 주는 자가 학습 서비스를 제공한다. 제안하는 시스템은 학습자들에게 자기 주도적 학습 도구를 제공하고, 자동화된 학습 콘텐츠로 외국어로 된 글의 이해에 대한 성취와 만족도를 높일 수 있다.

Recently, there has been a tremendous increase in the availability of educational materials for foreign language learning. As part of this trend, there has been an increase in the amount of electronically mediated materials available. However, conventional educational contents developed using computer technology has provided typically one-way information, which is not the most helpful thing for users. Providing the user's convenience requires additional off-line analysis for diagnosing an individual user's learning. To improve the user's comprehension of texts written in a foreign language, we propose an intelligent learning tool based on the analysis of the user's eyeball movements, which is able to diagnose and improve foreign language reading ability by providing necessary supplementary aid just when it is needed. To determine the user's learning state, we correlate their eye movements with findings from research in cognitive psychology and neurophysiology. Based on this, the learning tool can distinguish whether users know or do not know words when they are reading foreign language sentences. If the learning tool judges a word to be unknown, it immediately provides the student with the meaning of the word by extracting it from an on-line dictionary. The proposed model provides a tool which empowers independent learning and makes access to the meanings of unknown words automatic. In this way, it can enhance a user's reading achievement as well as satisfaction with text comprehension in a foreign language.

키워드

참고문헌

  1. C. H. Lee, "The Effective Contents Teaching Methods for Online Multimedia English Education Course", Students in Foreign Language Education, vol. 23, no. 1, pp. 103-104, 2009. https://doi.org/10.16933/sfle.2009.23.1.103
  2. D. Y. Kwon, S. B. Lee, H .S. Lim, W. G. Lee, H . C. Kim, S. U. Jung, and K. C. Nam, "A computer assisted landguage learning system based on principle of human language processing: the english brain enhancement system", KSII the first International Conference on Internet, 2009.
  3. Kyoung-Bo noh, Sang-Cheon Nam, Ki-Sang Song, "Application of Eye-tracking in E-learning Evaluation", Korea Association of Computer Education, Proceedings, 16 No 2. pp. 271-276, 2012.
  4. Sungryong Koh, Nakyeong Yoon, "The characteristics of eye-movement in Korean sentence reading: cluster length, word frequency, and landing position effects", Cognitive Science, Article 18, No. 4, pp. 325-350, 2007.
  5. Raney, G. E., & Rayner, K, "Word frequency effects and eye movements during two readings of a text", Canadian Journal of Experimental Psychology, vol. 48, no. 2, pp. 151-172, Jun., 1995.
  6. Van G, R. P. G., Pickering, M. J., & Traxler, M. J., "Reanalysis in sentence processing: Evidence against current constraint-based and two-stage models", Journal of Memory and Language, vol. 45, pp. 225-258, 2001. https://doi.org/10.1006/jmla.2001.2773
  7. Ki Moon Kwon, Jeong Jun Lee, Kang Ryoung Park, Jai Hie Kimg, "Eye Gaze for Human Computer Interaction", The institute of Electronics Engineers of Korea, General Conference (Fall) 2003 : Computer Society, vol. 26, no. 2, pp. 83-86, Nov., 2003.
  8. J. K. J. Robert "Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces", Advances in Human-Computer Interaction, pp. 151-190, 1993.
  9. C. B. Jeong, K. H. Lee, and S. H. Hong, "Eneygy Efficient Eye Tracking System Using Dual Tracking Side Mounted Cameras", The institute of Electronics Engineers of Korea, ISOCC 2012 Conference, pp. 97-97, Nov., 2012.
  10. Do-Hyun Kim, Jai-Htun Kim, Myung-Jin Chung, "Human-Computer Interface using the Eye-Gaze Direction", The institute of Electronics Engineers of Korea, Institute of Electronics Engineers of CI service, Chapter 38 6, pp. 46-56, Nov., 2001.
  11. Eye tracking system of Tobii Technology, http://www.tobii.com/
  12. Morris, R. K.. "Lexical and message-level sentence context effects on fixation times in reading", Journal of Experimental Psychology: Learing, Memory, and Cognition, vol. 20, pp. 92-103, 1994. https://doi.org/10.1037/0278-7393.20.1.92
  13. Chungsoo Lim, Ki-Hyun Song and Joon-Hyuk Chang, " Fine-tuning SVM for Enhancing Speech/Music Classification", The institute of Electronics Engineers of Korea, Institute of Electronics Engineers of SP service, Chapter 48 2, pp. 141-148, Mar., 2011.
  14. V. Kecman, Learning and Soft Computing, Cambridge, MA, MIT Press, 2001.
  15. C. Shagass, R. A. Roemer, M. Amadeo, "Eye-Tracking Performance and Engagement of Attention", Arch Gen Psychiatry, vol. 33, no. 1, pp. 121-125, Jan., 1976. https://doi.org/10.1001/archpsyc.1976.01770010077015
  16. E. J. Haltrecht and P. D. McCormark, "Mornitoring eye movement of slow and fast learner", Psychonomic Science, vol. 6, pp. 461-462. 1966. https://doi.org/10.3758/BF03328091
  17. P. D. McCormack, E. J. Haltrecht, and T. E. Hannah, "Mornitoring eye movement during the learning of successive paried-associate lists", Journal of Verbal Learning and Verbal Behavior, vol. 6, pp. 950-953, 1967. https://doi.org/10.1016/S0022-5371(67)80164-6
  18. E. Osuna, R. Freund, and F. Girosi, "Training Support Vector Machines: An Application to Fec Detection", CVPR, pp. 130-136, Jun., 1997.
  19. L.-P. Bi, H. Huang, Z.-Y. Zheng, and H.-T. Song, "New heuristic for determination Gaussian kernel's parameter", Proc. International Conference on Machine Learning and Cybernetics, vol. 7, pp. 4299-4304, Aug., 2005.
  20. Hyung-Keun Jee, Kyung-Hee Lee, Yong-Hwa Jung, "Eye Detection using Edge Information and SVM, The institute of Electronics Engineers of Korea, General Conference (Summer), vol. 4, 2002 : Signal Processing Society vol. 25, no.1, pp. 347-350, June, 2002.
  21. Shin Koo Lee, "Development of a Model for Web-Based English Vocabulary Learning : Focusing on Vocabulary Structure", Central University Master's Thesis, 2004.
  22. J. Bae, S. Choi, M. Lee, Y.-M. Jang, S. Park, and M.-J. Jang, "The eye tracker study of text comprehension and vocabulary knowledge", Presentation at Language Testing Research and Colloquium, 2013.
  23. S. Tong, D. Koller, "Support vector machine active learning with applications to text classification", The Journal of Machine Learning Research, vol. 2, no 3, pp. 45-66, 2002.