Journal of The Korean Association of Information Education (정보교육학회논문지)

Korea Association of Information Education (한국정보교육학회)
권호 표지
DOI QR코드

DOI QR Code

Designing the Framework of Evaluation on Learner's Cognitive Skill for Artificial Intelligence Education through Computational Thinking

Computational Thinking 기반 인공지능교육을 통한 학습자의 인지적역량 평가 프레임워크 설계

  • Shin, Seungki (Computer Science Education, Mary Lou Fulton Teachers College, Arizona State University)
  • 신승기 (애리조나주립대학교 컴퓨터교육전공)
  • Received : 2020.02.05
  • Accepted : 2020.02.14
  • Published : 2020.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study is to design the framework of evaluation on learner's cognitive skill for artificial intelligence(AI) education through computational thinking. To design the rubric and framework for evaluating the change of leaner's intrinsic thinking, the evaluation process was consisted of a sequential stage with a) agency that cognitive learning assistance for data collection, b) abstraction that recognizes the pattern of data and performs the categorization process by decomposing the characteristics of collected data, and c) modeling that constructing algorithms based on refined data through abstraction. The evaluating framework was designed for not only the cognitive domain of learners' perceptions, learning, behaviors, and outcomes but also the areas of knowledge, competencies, and attitudes about the problem-solving process and results of learners to evaluate the changes of inherent cognitive learning about AI education. The results of the research are meaningful in that the evaluating framework for AI education was developed for the development of individualized evaluation tools according to the context of teaching and learning, and it could be used as a standard in various areas of AI education in the future.

본 연구에서는 Computational Thinking 기반의 인공지능(AI)교육에 대한 학습자의 내재적 사고의 변화를 살펴보기 위한 평가도구 개발의 기준과 프레임워크를 구성하여 제시하고자 하였다. 이를 위해 데이터수집을 위한 인지적 학습보조(Agency)의 단계, 수집된 데이터의 특징을 분해하여 데이터의 패턴을 인식하고 카테고리화 과정을 수행하는 추상화(Abstracting)의 단계, 추상화과정을 수행한 정제된 데이터를 토대로 알고리즘을 구성하는 모델링(Modeling)단계의 일련의 순차적 과정이 평가요소로 구성되었다. 또한 학습자의 인식, 학습, 행동, 결과에 대한 인지적영역에 대한 평가가 구성되었으며, 학습자의 문제해결의 과정과 결과에 대하여 지식, 역량, 태도의 영역에 대하여 측정을 하게 됨으로써 AI교육에 대한 학습의 내재적인 인지영역의 변화와 결과에 대한 평가를 할 수 있도록 프레임 워크가 설계되었다. 연구의 결과는 교수학습의 맥락에 따른 개별화된 평가도구 개발에 대한 프레임워크를 구성하였다는 점에서 의미가 있으며, 향후 AI교육의 다양한 영역에서 활용될 수 있는 기준으로서 활용될 수 있을 것이다.

Keywords

References

  1. Bloom, B. S. (1956). Taxonomy of educational objectives. Vol. 1: Cognitive domain. New York: McKay, 20-24.
  2. Bloom, B.S. (Ed.). Engelhart, M.D., Furst, E.J., Hill, W.H., Krathwohl, D.R. (1956). Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. New York: David McKay Co Inc.
  3. Brennan, K., & Resnick, M. (2012, April). New frameworks for studying and assessing the development of computational thinking. In Proceedings of the 2012 annual meeting of the American Educational Research Association, Vancouver, Canada.
  4. Hsieh, H. F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative health research, 15(9), 1277-1288. https://doi.org/10.1177/1049732305276687
  5. Kirkpatrick, D., & Kirkpatrick, J. (2006). Evaluating training programs: The four levels. Berrett-Koehler Publishers.
  6. Kirkpatrick, J. (2015). An Introduction to the New World Kirkpatrick(R) Model. K. Partners (Ed.). Newnan, GA, USA: Kirkpatrick Partners, LLC.
  7. Luckin, R., Holmes, W., Griffiths, M., and Forcier, L. B., Intelligence Unleashed: An Argument for AI in Education (2016), http://www.gettingsmart.com/wpcontent/uploads/2016/02/Pearson-Intelligence-Unleashed-v11-RW-WEB.pdf
  8. Lye, S. Y., & Koh, J. H. L. (2014). Review on teaching and learning of computational thinking through programming: What is next for K-12?. Computers in Human Behavior, 41, 51-61. https://doi.org/10.1016/j.chb.2014.09.012
  9. Mertens, D. M. (2014). Research and evaluation in education and psychology: Integrating diversity with quantitative, qualitative, and mixed methods. Sage publications.
  10. Ministry of Science and ICT (2019). Announcement of National AI Strategy. Retrieved from https://msit.go.kr/web/msipContents/contentsView.do?cateId=mssw311&artId=2405727
  11. Oldridge, M. (2017). Is it about coding? No. It's about computational thinking. Retrieved from https://medium.com/@MatthewOldridge/is-it-about-coding-no-its-about-computational-thinking-fe0ba30add61
  12. Raghavan, S. (2019). 2020 AI Predictions from IBM Research. Retrieved from https://www.ibm.com/blogs/research/2019/12/2020-ai-predictions/
  13. Ryu, M., and Han, S. (2019). AI Education Programs for Deep-Learning Concepts. Journal of The Korean Association of Information Education Vol. 23, No. 6, December 2019, pp. 583-590. https://doi.org/10.14352/jkaie.2019.23.6.583
  14. Shin, G. (2015). The Big Data World, Principles and Uses. KOCW. Retrieved from http://www.kocw.net/home/cview.do?mty=p&kemId=1132874
  15. Shin, S. (2019). Designing the Instructional Framework and Cognitive Learning Environment for Artificial Intelligence Education through Computational Thinking. Journal of The Korean Association of Information Education Vol. 23, No. 6, December 2019, pp. 639-653 https://doi.org/10.14352/jkaie.2019.23.6.639
  16. Shin, S. and Bae, Y. (2015). A Study on the Hierarchical Instructional System Design of Software Education by School System. Journal of The Korean Association of Information Education Vol. 19, No. 4, pp. 533-544. https://doi.org/10.14352/jkaie.2015.19.4.533
  17. Shin, S., Bae, Y. (2018). The Concept of Computational Thinking through Analysis of Computer Education Framework in the United States and its Implications for the Curriculum of Software Education. Journal of The Korean Association of Information Education. Vol 22, No. 2. pp. 252-262.
  18. Silapachote, P., & Srisuphab, A. (2017). Engineering Courses on Computational Thinking Through Solving Problems in Artificial Intelligence. International Journal of Engineering Pedagogy, 7(3), 34-49. https://doi.org/10.3991/ijep.v7i3.6951
  19. Tabesh, Y. (2017). Computational thinking: A 21st century skill. Olympiads in Informatics, 11, 65-70. https://doi.org/10.15388/ioi.2017.special.10
  20. Touretzky, D., Gardner-McCune, C., Martin, F., & Seehorn, D. (2019). Envisioning AI for K-12: What should every child know about AI.
  21. Touretzky, D., Martin, F., Seehorn, D., Breazeal, C., & Posner, T. (2019, February). Special Session: AI for K-12 Guidelines Initiative. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (pp. 492-493). ACM.
  22. Tyler, R. W. (1949). Tyler, Ralph W., Basic Principles of Curriculum and Instruction. Chicago: The University of Chicago Press, 1949.
  23. Wang, Y., Li, H., Feng, Y., Jiang, Y., & Liu, Y. (2012). Assessment of programming language learning based on peer code review model: Implementation and experience report. Computers & Education, 59(2), 412-422. https://doi.org/10.1016/j.compedu.2012.01.007
  24. Wing, J. (2006). Computational thinking. Communications of the ACM, 49(3), 33-35. https://doi.org/10.1145/1118178.1118215
  25. Wing, J. (2011). Research notebook: Computational thinking-What and why? The Link Magazine, Spring. Carnegie Mellon University, Pittsburgh. Retrieved from http://link.cs.cmu.edu/article.php?a=600
  26. Zeng, D. (2013). From computational thinking to ai thinking. IEEE Intelligent Systems, (6), 2-4.

Cited by

  1. A Study on the Framework Design of Artificial Intelligence Thinking for Artificial Intelligence Education vol.11, pp.9, 2020, https://doi.org/10.18178/ijiet.2021.11.9.1540
  2. An artificial intelligence based model for evaluation of college students’ ability and characteristics through teaching evaluation vol.40, pp.2, 2020, https://doi.org/10.3233/jifs-189378