대한인간공학회지 (Journal of the Ergonomics Society of Korea)

  • 제36권6호
  • /
  • Pages.717-727
  • /
  • 2017
  • /
  • 1229-1684(pISSN)
  • /
  • 2093-8462(eISSN)
대한인간공학회 (Ergonomics Society of Korea)
권호 표지
DOI QR코드

DOI QR Code

시선추적과 뇌파를 활용한 한국어 학습자의 읽기 과정 분석

Analysis of Reading Process with Korean Learner using EEG and Eye Tracking

  • 임정남 (한양대학교, 인문과학대학 국어국문학과) ;
  • 만승남 (신성대학교, 공학대학 소방안전관리과(산업안전전공)) ;
  • 조성문 (한양대학교, 인문과학대학 국어국문학과)
  • Im, Jung Nam (Hanyang University, Korean Language and Literature) ;
  • Min, Seung Nam (Shinsung University, Fire Safety Mamagement) ;
  • Cho, Sung Moon (Hanyang University, Korean Language and Literature)
  • 투고 : 2017.10.17
  • 심사 : 2017.11.16
  • 발행 : 2017.12.31
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

Objective: The purpose of this study is to establish the goal with the reading stage of Korean learners in Korean language education institutions for preparing enter university using EEG and eye tracker. Background: International students enter the university after completing Korean language education finding lots of difficulties in classes handled in Korean. This is due to the current qualitative evaluation method adopted by the Korean teachers. Therefore, the international students need a proper learning method. Method: The Korean language proficiency test and learner's level are classified as a beginner, intermediate, and advanced levels. The reading process was measured using Eye tracker and EEG. The independent variables consisted of 3 text level and 3 learner's level. The dependent variables consisted of fixation time, fixation number, saccade number, saccade time, and stress index. The variance analysis was performed with $3{\times}3$ within subject design. Results: As the text level increased, the fixation time and number were lowered for beginner, intermediate, and advanced learner. Even the number of fixation decreased, the understanding score as significantly increased. It was also found that the part of fixation number was related to process vocabulary and grammar. The text level significantly increased when saccade number increased. In addition, the saccade number significantly increased for the learner language level. There was no significant difference in the level of text difficulties between beginner and intermediate learners. Nevertheless, we found that advanced learners were confirmed with higher saccade time in beginner difficulty text. Conclusion: The fixation ratio was higher for beginner learners. Similarly, it was found that fixation time had a constant pattern with respect to learners' proficiency regardless of difficulty level. The saccade time affects the learners' level of text understanding. Also, the number of saccades associated with grammar and vocabulary. Application: In the future, if this study focus on a word and grammar in a sentence using EEG and eye tracking, this can prepare a study design for Korean reading system.

키워드

참고문헌

  1. Ashby, J., Rayner, K. and Clifton, C.J., Eye movements of highly skilled and average readers: Differential effects of frequency and predictability. The Quarterly Journal of Experimental Psychology, 58, 1065-1086, 2005. https://doi.org/10.1080/02724980443000476
  2. Barber, H., Vergara, M. and Carreiras, M., Syllable-frequency effects in visual word recognition: evidence from ERPs. Neuroreport, 15(3), 545-548, 2004. https://doi.org/10.1097/00001756-200403010-00032
  3. Choi, G.S., A Study of Improvement of Internet Text Reading of Elementary Students Using a Gaze Tracking System, Master Thesis, 2016.
  4. Choi, S.G., Exploring Gender Difference in Reading Comprehension Process Using Eye Tracking Technology. Journal of Korean Association for Learner-Centered Curriculum and Instruction, 14(11), 573-597, 2014.
  5. Ga, K.S., Correlation between reading ability and reading cognitive variables. The Korean Reading Association, 15, 243-269, 2006.
  6. Goodman, K, Goodman, Y. and Flores, B., Reading in the bilingual classroom: Literacy and biliteracy. Rosslyn, VA: National Clearing For Bilingual Education, 1979.
  7. Goodman, K.S., A linguistic study of cues and miscues in reading. Elementary English, 42(6), 639-643, 1965.
  8. Harmony, T., Marosi, E., Becker, J., Rodriguez, M., Reyes, A., Fernandez, T. and Bernal, J., Longitudinal quantitative EEG study of children with different performances on a reading-writing test. Electroencephalography and Clinical Neurophysiology, 95(6), 426-433, 1995. https://doi.org/10.1016/0013-4694(95)00135-2
  9. Holcomb, P.J. and Grainger, J., On the time course of visual word recognition: An event-related potential investigation using masked repetition priming. Journal of Cognitive Neuroscience, 18(10), 1631-1643, 2006. https://doi.org/10.1162/jocn.2006.18.10.1631
  10. Im, J.N., Min, S.N. and Cho, S.M., Comparison of Cognitive Loads between Koreans and Foreigners in the Reading Process. Journal of the Ergonomics Society of Korea, 35(4), 293-305, 2016. https://doi.org/10.5143/JESK.2016.35.4.293
  11. Jeon, H.I., Yun, H.O. and Hong, O.H., The representation and processing of polysemy and homonym nouns in Korean sentence comprehension: an ERP study. Language Eesearch Institute, 68, 149-182, 2015.
  12. Jeon, S.J., Needs Analysis of Korean Learners for Reading Education for Academic Purpose. Korean Language Education as a Foreign Language, 29(0), 203-230, 2004.
  13. Jeong, S.M., Study of Textbook Reading Tendency of the First Grade Students in Elementary School through the Eye-tracking. Master's Thesis, 2015.
  14. Juhola, M. and Grönfors, T., A scheme of inference of regular grammars for the syntactic pattern recognition of saccadic eye movements. Artificial Intelligence in Medicine, 3(2), 87-93, 1991. https://doi.org/10.1016/0933-3657(91)90020-C
  15. Just, M.A. and Carpenter, P.A.A., theory of reading: from eye fixations to comprehension. Psychological Review, 87(4), 329, 1980. https://doi.org/10.1037/0033-295X.87.4.329
  16. Ki, J.S., A Study of Korean Reading Strategies Employed by Chinese Background Speakers. The International Association for Korean Language Education, 21(2), 29-58, 2010.
  17. Kim, J.Y., Lee, M,H., Min, S,N., Cho, Y.J. and Choi, J.H., Quantitative Comparison of the E-book and Paper-book by using Eyetracker. Journal of the Ergonomics Society of Korea, 31(5), 609-616, 2012. https://doi.org/10.5143/JESK.2012.31.5.609
  18. Kim, T.Y. and Yi, S.H., The Differences in Children's Story Comprehension According to the Types of Reading Media: Paperback Books vs. Electronic Books. Korean Journal of Child Studies, 35(4), 249-262, 2014. https://doi.org/10.5723/KJCS.2014.35.4.249
  19. Kwon, Y., Nam, K. and Lee, Y., ERP index of the morphological family size effect during word recognition. Neuropsychologia, 50(14), 3385-3391, 2012. https://doi.org/10.1016/j.neuropsychologia.2012.09.041
  20. Lee, M.S. and Yong, N.S., Processing of syntactic dependency in Korean relative clauses: Evidence from an eye-tracking study. Korean Journal of Cognitive Science, 20(4), 507-533, 2009. https://doi.org/10.19066/cogsci.2009.20.4.005
  21. Liu, H.C. and Chuang, H.H., An examination of cognitive processing of multimedia information based on viewers' eye movements. Interactive Learning Environments, 19(5), 503-517, 2011. https://doi.org/10.1080/10494820903520123
  22. Morrison, R.E. and Rayner, K., Saccade size in reading depends upon character spaces and not visual angle. Attention, Perception and Psychophysics, 30(4), 395-396, 1981. https://doi.org/10.3758/BF03206156
  23. Newell, A. and Simon, H.A., Human problem solving, Englewood Cliffs. NJ: Prentice-Hall, 1972.
  24. Rayner, K., Ashby, J., Pollatsek, A. and Reichle, E.D., The effects of frequency and predictability on eye fixations in reading: implications for the EZ Reader model, Journal of Experimental Psychology. Human Perception and Performance, 30(4), 720, 2004. https://doi.org/10.1037/0096-1523.30.4.720
  25. Sim, S.M., An Analysis of Research Trends in Korean Language Education for Multicultural Learner. The Association of Korean Education, 98, 153-183, 2014.
  26. Suh, H., Kim, J.H., Pyeon, J.Y. and Shin, Y.H., A Research of Characteristics and Eye-tracking of Readers in Problem-solving Context- Focused on Readers' Task Commitment According to the Reading Level. Korea Reading Association, 38, 225-254, 2016.