Journal of The Korean Association For Science Education (한국과학교육학회지)

The Korean Association for Science Education (한국과학교육학회)
권호 표지
DOI QR코드

DOI QR Code

Development and Application of Instrument for Level Scale of the Systems Thinking Ability about Carbon Cycle

탄소 순환에 대한 시스템 사고 능력 수준 측정을 위한 검사도구 개발 및 적용

  • Received : 2022.04.21
  • Accepted : 2022.08.30
  • Published : 2022.08.30
Download PDF
⟨ Previous Next ⟩

Abstract

As the global warming problem becomes serious, the need for carbon cycle education in school is increasing. Adopting systems thinking ability is needed to understand the carbon cycle systematically. Furthermore, under the rapid change of environment, society, and economy, systems thinking ability is being emphasized as it can strengthen the competencies of students who will be leading the future society. The purposes of this study are as follows: first, is developing the systems thinking instrument for the carbon cycle and the rubric for analysis of systems thinking instrument. The second is analyzing the systems thinking ability of students using the developed instrument and rubric. In order to perform this study, previous studies related to the carbon cycle and systems thinking education were analyzed. Based on the analysis results, the systems thinking instrument for the carbon cycle and rubric were developed. The systems thinking ability was analyzed by implementing the developed instrument and rubric to 172 high school and university students. The results of this study are as follows: first, the systems thinking instrument for the carbon cycle was developed, and a rubric utilization guide was constructed. The instrument and rubric were modified through pilot study for middle school students producing expert opinion in relation to systems thinking and carbon cycle. Second, the systems thinking ability of students was analyzed. Consequently, students had systems thinking ability fully at a low level, such as identifying the variables related to the carbon cycle. However, it was shown that they lacked the systems thinking ability at a high level, such as time delay and feedback processes. The importance of the carbon cycle has been increasing since the global warming is the most pressing issue and significant environmental problem facing us today. Application of the systems thinking ability can contribute to understanding these complex problems and finding fundamental solutions.

최근 지구 온난화 문제가 심각해짐에 따라 탄소 순환에 대한 교육적 요구가 커지고 있다. 이와 관련하여 탄소 순환에 대한 체계적인 이해를 위해 시스템 사고 능력의 접목이 요구되고 있다. 더욱이 급변하는 환경, 사회, 경제적 상황에서, 시스템 사고 교육은 미래 사회를 살아갈 학생들에게 요구되는 역량을 강화할 수 있으므로 더욱 강조되고 있다. 이 연구의 목적은 첫째, 탄소 순환에 대한 시스템 사고 검사 도구를 개발하고 루브릭을 활용한 분석 방법을 구성하고, 둘째, 개발된 검사도구 및 루브릭 분석 방법을 적용하여 학생들의 시스템 사고 능력을 분석하는 것이다. 이 연구를 위해 탄소 순환 및 시스템 사고와 관련된 다양한 선행 연구를 분석하였다. 이 결과를 바탕으로 시스템 사고 검사도구 및 루브릭을 활용한 시스템 사고 능력 분석 방법을 개발하였다. 이를 고등학생 및 대학생 172명에게 적용하여 시스템 사고 능력을 분석하였다. 이 연구의 결과는 다음과 같다. 첫째, 선행연구 분석을 통해 탄소 순환 및 시스템 사고 검사를 위한 시사점을 도출하였고, 탄소 순환에 대한 시스템 사고 검사도구 및 이를 평가하기 위한 루브릭 채점 가이드를 개발하였다. 이를 중학생을 대상으로 예비 투입을 진행하고, 전문가 자문을 통해 최종 완성하였다. 둘째, 개발된 검사도구를 활용하여 학생들의 시스템 사고 능력을 분석한 결과, 학생들은 탄소 순환과 관련된 요인을 식별하는 것과 같은 낮은 수준의 시스템 사고는 잘 수행하였지만, 시간 지연이나 피드백 과정과 같은 높은 수준의 시스템 사고는 부족한 것으로 나타났다. 지구 온난화는 현재 인류가 직면한 가장 시급한 문제 상황으로, 탄소 순환의 중요성이 커지고 있다. 이러한 복잡한 문제 상황은 시스템 사고 능력의 적용을 바탕으로 올바르게 이해하고 근본적인 해결책을 모색할 수 있을 것이다.

Keywords

Acknowledgement

이 논문은 2017년 대한민국 교육부와 한국연구재단의 지원을 받아 수행된 연구임(NRF-2017S1A5A2A01026791).

References

  1. Baryla, E., Shelley, G., & Trainor, W. (2012). Transforming Rubrics Using Factor Analysis. Practical Assessment, Research & Evaluation, 17(4), 1-7.
  2. Ben-Zvi Assaraf, O., & Orion, N. (2005a). A study of junior high students' perceptions of the water cycle. Journal of Geoscience Education, 53(4), 366-373. https://doi.org/10.5408/1089-9995-53.4.366
  3. Ben-Zvi Assaraf, O., & Orion, N. (2005b). Development of system thinking skills in the context of earth system education. Journal of Research in Science Teaching, 42(5), 518-560. https://doi.org/10.1002/tea.20061
  4. Ben-Zvi Assaraf, O., & Orion, N. (2009). A design based research of an earth systems based environmental curriculum. Eurasia Journal of Mathematics, Science & Technology Education, 5(1), 47-62.
  5. Ben-Zvi Assaraf, O., & Orion, N. (2010). Four case studies, six years later: Developing system thinking skills in junior high school and sustaining them over time. Journal of Research in Science Teaching, 47(10), 1253-1280. https://doi.org/10.1002/tea.20383
  6. Bissinger, K., & Bogner, F. X. (2018). Environmental literacy in practice: Education on tropical rainforests and climate change. Environment, Development and Sustainability, 20(5), 2079-2094. https://doi.org/10.1007/s10668-017-9978-9
  7. Byoun, S., & Han, W. (2022). An Analysis of Korean College Students' needs for Core Competency Education in Universities. Korean Journal of General Education, 16(3), 101-116. https://doi.org/10.46392/kjge.2022.16.3.101
  8. Chen, J., & Anderson, C. W. (2015). Comparing American and Chinese students' learning progression on carbon cycling in socio-ecological systems. Science Education International, 26(4), 439-462.
  9. Cheong, C., Kim, Yun Ji. (2021). The Perceptions of Non-scientific College Students about the Future Global Environment. Journal of Korean Society of Earth Science Education, 14(1), 21-32. https://doi.org/10.15523/JKSESE.2021.14.1.21
  10. Cho, E. S. (2020). Untact Classes in Post Covid-19: The Roles and Challenges of Educational Technology. Journal of Educational Technology, 36(3), 693-713. https://doi.org/10.17232/KSET.36.3.693
  11. Cho, K., & Kim, H. (2017). Effect of Systems Thinking Based STEAM Education Program on Climate Change Topics. The Journal of the Korea Contents Association, 17(7), 113-123. https://doi.org/10.5392/JKCA.2017.17.07.113
  12. Cho, O.-H., & Hwang, K. H. (2016). The Effects of Simulation-based Education on Nursing Students' Presence in Education, Systems Thinking and Proactivity in Problem Solving. Journal of Korean Academic Society of Home Health Care Nursing, 23(2), 147-154. https://doi.org/10.22705/JKASHCN.2016.23.2.147
  13. Choi, S. (2013). Review of High School Environment Textbooks for Students' Conceptual Development about Climate Change. Korean Journal of Environmental Education, 26(1), 79-93.
  14. Dunlap, C. (2015). The global carbon cycle. Technical Education Research Centers [TERC]. Retrieved from https://serc.carleton.edu/details/images/56944.html
  15. Dusing, K., Asshoff, R., & Hammann, M. (2018). Students' conceptions of the carbon cycle: Identifying and interrelating components of the carbon cycle and tracing carbon atoms across the levels of biological organization. Journal of Biological Education, 53(1), 110-125. https://doi.org/10.1080/00219266.2018.1447002
  16. Ebert-May, D., Batzli, J., & Lim, H. (2003). Disciplinary research strategies for assessment of learning. BioScience, 53(12), 1221-1228. https://doi.org/10.1641/0006-3568(2003)053[1221:DRSFAO]2.0.CO;2
  17. Evans, M. (2016). Water and carbon cycles. Retrieved from https://www.rgs.org/schools/teaching-resources/water-and-carbon-cycles/
  18. Flowers, C. (2006). Confirmatory Factor Analysis of Scores on the Clinical Experience Rubric: A Measure of Dispositions for Preservice Teachers. Educational and Psychological Measurement, 66(3), 478-488. https://doi.org/10.1177/0013164405282458
  19. Grotzinger, J., Jordan, T. H., Press, F., & Siever, R. (2007). Understanding earth (5th ed.). New York: W. H. Freeman. 조석주, 권성택, 김동주, 김형수, 도성재, 윤성택, 이미혜, 이영재, 이진한, 조호영, 최선규 역 (2009). 지구의 이해 (5판). 서울: (주)시그마프레스.
  20. Gudovitch, Y., & Orion, N. (2001). The carbon cycle and the earth systems: Studying the carbon cycle in multidisciplinary environmental context. In Proceedings of the 1st IOSTE Symposium in Southern Europe. (April 29-May 2).
  21. Haff, P. K. (2014). Humans and technology in the Anthropocene: Six rules. The Anthropocene Review, 1(2), 126-136. https://doi.org/10.1177/2053019614530575
  22. Hafner, J., & Hafner, P. (2003). Quantitative analysis of the rubric as an assessment tool: An empiricalstudy of student peer-group rating. International Journal of Science Education, 25(12), 1509-1528. https://doi.org/10.1080/0950069022000038268
  23. Han, D. K., & Jo, E. H. (2015). A study on the exploration of relationship between environmental literacy and systems thinking for sustainability education in Social Studies. Social Studies Education, 54(2), 65-83.
  24. Hartley, L. M., Wilke, B. J., Schramm, J. W., D'Avanzo, C., & D'Anderson, C. W. (2011). College students' understanding of the carbon cycle: Contrasting principle-based and informal reasoning. BioScience, 61, 65-75. https://doi.org/10.1525/bio.2011.61.1.12
  25. Hung, W. (2008). Enhancing systems thinking skills with modelling. British Journal of Educational Technology, 39(6), 1099-1120. https://doi.org/10.1111/j.1467-8535.2007.00791.x
  26. Im, Y.-G., & Lee, H. (2014). Development and Analysis of Effects of Writing Educational Program for Improving System Thinking Ability. The Journal of Learner-Centered Curriculum and Instruction, 14(12), 407-427.
  27. Intergovernmental Panel on Climate Change [IPCC]. (2021). Summary for policymakers. In: Climate change 2021: The physical science basis. Contribution of working group I to the Sixth assessment report of the intergovernmental panel on climate change [Masson-Delmotte, V., P. Zhai, A. Pirani, S. L. Connors, C. Pean, S. Berger, N. Caud, Y. Chen, L. Goldfarb, M. I. Gomis, M. Huang, K. Leitzell, E. Lonnoy, J. B. R. Matthews, T. K. Maycock, T. Waterfield, O. Yelekci, R. Yu, & B. Zhou (Eds.)]. Cambridge, England: Cambridge University Press. Retrieved from https://www.ipcc.ch/report/ar6/wg1/downloads/report/ IPCC_AR6_WGI_SPM.pdf
  28. Jackson, M. (2003). Systems thinking: Creative holism for manager. Chichester, England: John Wiley & Son Ltd.
  29. Jeon, J., & Lee, H. (2015). The Development and Application of STEAM Education Program based on Systems Thinking for High School Students. Journal of the Korean Association for Science Education, 35(6), 1007-1018. https://doi.org/10.14697/JKASE.2015.35.6.1007
  30. Jho, H. (2017). The Changes of Future Society and Educational Environment according to the Fourth Industrial Revolution and the Tasks of School Science Education. Journal of Korean Elementary Science Education, 36(3), 286-301. https://doi.org/10.15267/KESES.2017.36.3.286
  31. Jin, H., & Anderson, C. W. (2012). A learning progression for energy in socio-ecological systems. Journal of Research in Science Teaching, 49(9), 1149-1180. https://doi.org/10.1002/tea.21051
  32. Joeng, Y., Yu, J., & Kim C. (2021). Establishment of Elementary Information Curriculum to Solve the Learning Gap between Students. Journal of The Korean Association of Information Education, 25(1), 33-40. https://doi.org/10.14352/jkaie.2021.25.1.33
  33. Kali, Y., Orion, N., & Eylon, B.-S. (2003). Effect of knowledge integration activities on students' perception of the Earth's crust as a cyclic system. Journal of Research in Science Teaching, 40(6), 545-556. https://doi.org/10.1002/tea.10096
  34. Kang, C., Lee, H., Yoon, I.-H., & Kim, E. (2008). Analysis of Conceptions Related to Earth System and Systems-Thinking of High School Student about Water Cycle. Journal of Science Education, 32(1), 61-72. https://doi.org/10.21796/JSE.2008.32.1.61
  35. Kim, B.-M., Maeng, S. (2020). Characteristics of Elementary Students' System Thinking in Learning of Water Cycle. Journal of Korean Elementary Science Education, 39(3), 412-432. https://doi.org/10.15267/KESES.2020.39.3.412
  36. Kim, D.-R. (2014). An Analysis of Students' Systemic Thinking and Teachers' Reflective Thinking after the Lesson of Digestion, Circulation, Respiration and Excretion of Middle School Science. The Journal of Fisheries and Marine Sciences Education, 26(2), 401-420. https://doi.org/10.13000/JFMSE.2014.26.2.401
  37. Kim, H., & Mun, S.-Y. (2017). The Effect of a System Thinking-based STEAM-type ESD Program on Environmental Literacy and System Thinking Ability of Elementary Students. Korean Journal of Environmental Education, 30(1), 85-102. https://doi.org/10.17965/KJEE.2017.30.1.85
  38. Kim, H., Jeong, S.-J., Jeong, S.-R., & Mun, S.-Y. (2017). Development of a Systems Thinking-based STEAM Education Program for Elementary School Students and the Effect of its Application. School Science Journal, 11(3), 288-301. https://doi.org/10.15737/SSJ.11.3.201710.288
  39. Kim, S. (2010). 시스템 사고와 시나리오 플래닝 [Systems thinking and scenario planning]. Chungbuk: Chungbuk National University Press.
  40. Kim, Y., Jeon, J., Eom, J., & Lee, H. (2020). Developing Systems Thinking-based STEAM Programs and Analyzing its Effects on Middle School Students. Journal of The Korean Earth Science Society, 41(1), 75-91. https://doi.org/10.5467/JKESS.2020.41.1.75
  41. Kin, H.-Y., & Eun, K. (2014). Development and Application of a System Thinking-Based Approach with the Use of a Patient Simulator in Nursing Education : Focus on Congestive Heart Failure. Korean System Dynamics Review, 15(4), 61-84.
  42. Kook, D.-S. (2003). An Analysis of 10th Grade Science Textbook as an Origin of Misconception on Greenhouse Effect Concept. Journal of the Korean Association for Science Education, 23(5), 592-598.
  43. Krauskopf, S. (2010). A life-cycle assessment of biofuels. Science Teacher, 77(9), 35-40.
  44. Kwak, Y. (2014). Conditions of Science Teachers' Professionalism on Curriculum Organization and Implementation at the School Level. The Journal of The Korean Earth Science Society, 35(3), 203-212. https://doi.org/10.5467/JKESS.2014.35.3.203
  45. Kwon, S.-N., Yoo, Y.-J., & Lee, J.-S. (2014). Effect of Rubric Application on Motivation for Learning Hair Beauty. Journal of Investigative Cosmetology, 10(1), 59-66. https://doi.org/10.15810/jic.2014.10.1.008
  46. Kwon, Y., Lee, J., Kim, C., Ahn, J., Seo, E., Nam, Y., Park, E., Choi, S., & Ahn, Y. (2016). The 2015 Revised National Curriculum for "Environment" Subject: Major Changes in Contents and Approaches. Korean Journal of Environmental Education, 29(4), 363-383. https://doi.org/10.17965/KJEE.2016.29.4.363
  47. Kwon, Y.-J., Kim, W.-J., Lee, H., Byun, J.-H., & Lee, I.-S. (2011). Analysis of Biology Teachers' Systems Thinking about Ecosystem. Biology Education, 39(4), 529-543. https://doi.org/10.15717/bioedu.2011.39.4.529
  48. Kye, B., Kim, H.-S., Lee, Y., Son, J.-E., Kim, S., & Beak, S. Y. (2020). COVID-19에 따른 초중등학교 원격교육 경험 및 인식 분석 [Analysis of Experience and Perception about Remote Education in Elementary and Secondary Schools according to COVID-19] (GM 2020-11). Daegu, Korea: Korea Education and Research Information Service.
  49. Lee, D.-Y., Oh, E., Kim, H., & Jeong, J.-W. (2013). Analysis of Carbon Cycle Concepts based on Earth Systems Perspective of High School Students. Journal of Science Education, 37(1), 157-169. https://doi.org/10.21796/jse.2013.37.1.157
  50. Lee, H. (2020). An Analysis of Systems Thinking Levels of the Water Cycle in Earth System of Primary School Pre-Service Teachers. Teacher Education Research, 59(1), 21-38. https://doi.org/10.15812/TER.59.1.202003.21
  51. Lee, H., & Lee, H. (2013). Revalidation of Measuring Instrument Systems Thinking and Comparison of Systems Thinking between Science and General High School Students. Journal of the Korean Association for Science Education, 33(6), 1237-1247. https://doi.org/10.14697/JKASE.2013.33.6.1237
  52. Lee, H., & Lee, H. (2017). Analysis and Effects of High School Students' Systems Thinking Using Iceberg(IB) Model. Journal of the Korean Association for Science Education, 37(4), 611-624. https://doi.org/10.14697/JKASE.2017.37.4.611
  53. Lee, H., Jeon, J., & Lee, H. (2018). Development of Framework and Rubric for Measuring Students' Level of Systems Thinking. Journal of the Korean Association for Science Education, 38(3), 355-367. https://doi.org/10.14697/JKASE.2018.38.3.355
  54. Lee, H., Kim, C., Shin, C., Lee, W. J., Heo, J., & Lee, H. (2018). Comparative Analysis of the System Thinking between Underrepresented and General Students: An Exploratory Study. Secondary Education Research, 66(1), 307-327. https://doi.org/10.25152/SER.2018.66.1.307
  55. Lee, H., Kim, T., & Lee, H. (2017). An Analysis of High School Students' Systems Thinking and Understanding of the Earth Systems through their Science Writing. Journal of The Korean Earth Science Society, 38(1), 91-104. https://doi.org/10.5467/JKESS.2017.38.1.91
  56. Lee, H., Kwon, H., Park, K., & Lee, H. (2013). An Instrument Development and Validation for Measuring High School Students' Systems Thinking. Journal of the Korean Association for Science Education, 33(5), 995-1006. https://doi.org/10.14697/JKASE.2013.33.5.995
  57. Lee, H., Kwon, Y.-J., Oh, H. J., & Lee, H. (2011). Development and Application of the Educational Program to Increase High School Students' Systems Thinking Skills - Focus on Global Warming -. Journal of The Korean Earth Science Society, 32(7), 784-797. https://doi.org/10.5467/JKESS.2011.32.7.784
  58. Lee, J.-E., Han, S., & Park, T. (2017). Conception of Carbon Cycle in High School Students According to the Difference of Spatial Perception Ability. Journal of Korean Society of Earth Science Education, 10(3), 308-322. https://doi.org/10.15523/JKSESE.2017.10.3.308
  59. Lee, K., Han, M., & Kim, H.-B. (2016). Development of High School Students' System Thinking through the Construction of External Representations of an Ecosystem. Biology Education, 44(3), 447-462. https://doi.org/10.15717/BIOEDU.2016.44.3.447
  60. Maani, K. E., & Maharaj, V. (2004). Links between systems thinking and complex decision making. System Dynamics Review, 20(1), 21-48. https://doi.org/10.1002/sdr.281
  61. Mambrey, S., Schreiber, N., & Schmiemann, P. (2020). Young students' reasoning about ecosystems: The role of systems thinking, knowledge, conceptions, and representation. Research in Science Education. Advance online publication. doi:10.1007/s11165-020-09917-x.
  62. McNeill, K. L., & Vaughn, M. H. (2012). Urban high school students' critical science agency: Conceptual understandings and environmental actions around climate change. Research in Science Education, 42(2), 373-399. https://doi.org/10.1007/s11165-010-9202-5
  63. Ministry of Education (2015). 2015 Revised science curriculum. 2015-74. Sejong, Korea: Author.
  64. Mohan, L., & Anderson, C. W. (2009). Teaching experiments and the carbon cycle learning progression. Paper presented at the Learning Progressions in Science (LeaPS) Conference, June 2009, Iowa City, IA.
  65. Mohan, L., Chen, J., & Anderson, C. W. (2009). Developing a multi-year learning progression for carbon cycling in socio-ecological systems. Journal of Research in Science Teaching, 46(6), 675-698. https://doi.org/10.1002/tea.20314
  66. Mohan, L., Sharma, A., Jin, H., Cho, I., & Anderson, W. (2006). Developing a carbon cycling learning progression for K-12. Paper presented at the annual meeting of the National Association for Research on Science Teaching, San Francisco, CA.
  67. Monroe, M. C., Hall, S., & Li, C. J. (2016). Can climate change enhance biology lessons?. A quasi-experiment. Applied Environmental Education & Communication, 15(2), 125-137. https://doi.org/10.1080/1533015X.2016.1164095
  68. Montgomery, K. (2000). Classroom rubrics: Systemizing what teachers do naturally. The Clearing House, 73, 324-328. https://doi.org/10.1080/00098650009599436
  69. Moon, B.-C., Jeong, J.-W. Kyung, J.-B., Koh, Y.-K., Youn, S.-T., Kim, H.-G., & Oh, K.-H. (2004). Related Conception s to Earth System and Applying of Systems Thinking about Carbon Cycle of the Preservice Teachers. Journal of The Korean Earth Science Society, 25(8), 684-696.
  70. Musters, C. J. M., De Graaf, H. J., & Ter Keurs, W. J. (1998). Defining socio-environmental systems for sustainable development. Ecological Economics, 26(3), 243-258. https://doi.org/10.1016/S0921-8009(97)00104-3
  71. National Curriculum Information Center (2021). 2022 개정 교육과정 정책홍보 리플렛 [2022 Revised Curriculum Policy Promotion Leaflet]. Retrieved from http://ncic.re.kr/mobile.revise.board.list.do?degreeCd=RVG01&boardNo=1006
  72. National Research Council [NRC]. (2012). A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. Washington, DC: National Academies Press.
  73. National Research Council [NRC]. (2013). Next generation science standards. Washington, DC: National Academies Press.
  74. Organisation for Economic Co-operation and Development [OECD]. (2018). The future of education and skills: Education 2030. Paris, France: Author.
  75. Oh, H., Lee, K. Y., & Kim, K. (2021). Analysis of Secondary School Students' System Thinking on the Cycle of Matter in Earth System: Considering the Impact of Human Activity on the Cycle. Journal of Science Education, 45(3), 275-291. https://doi.org/10.21796/JSE.2021.45.3.275
  76. Orion, N., & Basis, T. (2008). Characterization of high school students' system thinking skills in the context of earth systems. Presented in the 2008 NARST Annual Meeting. March, 2008. Baltimore, MD.
  77. Pak, S., Han, Y., & Cho, Y. H. (2021). Understanding Digital Competence and Digital Divide of Elementary School Students from Teacher Perspectives. The Journal of Learner-Centered Curriculum and Instruction, 21(16), 479-492.
  78. Park, B.-Y., Jeon, J., Lee, H., & Lee, H. (2020). An Analysis of Research Trend for Integrated Understanding of Environmental Issues: Focusing on Science Education Research on Carbon Cycle. Journal of the Korean Association for Science Education, 40(3), 237-251. https://doi.org/10.14697/JKASE.2020.40.3.237
  79. Park, B.-Y., Lee, H. (2014). Development and Application of Systems Thinking-based STEAM Education Program to Improve Secondary Science Gifted and Talented Students' Systems Thinking Skill. Journal of Gifted/Talented Education, 24(3), 421-444. https://doi.org/10.9722/JGTE.2014.24.3.421
  80. Park, K., Lee, H., Lee, H., & Jeon, J. (2019). Analysis of Systems Thinking Level of Pre-service Teachers about Carbon Cycle in Earth Systems using Rubrics of Evaluating Systems Thinking. Journal of the Korean Association for Science Education, 39(5), 599-611. https://doi.org/10.14697/JKASE.2019.39.5.599
  81. Pelletier, K., Brown, M., Brooks, C., McCormack, M., Reeves, J., Arbino, N., Bozkurt, A., Crawford, S., Czerniewicz, L., Gibson, R., Linder, K., Mason, J., & Mondelli, V. (2021). 2021 EDUCAUSE Horizon Report Teaching and Learning Edition. Boulder, CO: EDU.
  82. Saff, K. (2008). Carbon cycle-cute diagram. Retrieved from https://commons.wikimedia.org/wiki/File:Carbon_cycle-cute_diagram.jpeg
  83. Savasci, F. (2014). Carbon goes to.... Science Activities, 51(2), 33-43. https://doi.org/10.1080/00368121.2014.889649
  84. Seo, J.-W., Kim, H., & Potvin, P. (2014). An Analysis of High School Students' Conceptions of Conservation of Mass on Carbon Cycle through Carbon Emission Scenario. Journal of The Korean Earth Science Society, 35(3), 192-202. https://doi.org/10.5467/JKESS.2014.35.3.192
  85. Shealy, T., Klotz, L., Godwin, A., Hazari, Z., Potvin, G., Barclay, N., & Cribbs, J. (2019). High school experiences and climate change beliefs of first year college students in the United States. Environmental Education Research, 25(6), 925-935. https://doi.org/10.1080/13504622.2017.1293009
  86. Sibley, D. F., Anderson, C. W., Heidemann, M., Merrill, J. E., Parker, J. M., & Szymanski, D. W. (2007). Box diagrams to assess students' systems thinking about the rock, water and carbon cycles. Journal of Geoscience Education, 55(2), 138-146. https://doi.org/10.5408/1089-9995-55.2.138
  87. Son, J. H., & Kim, J. (2016). Effects of 3-Steps Mind Map Activities on the System Thinking of Science Gifted Students: Focused on the Astronomy Contents. Journal of Gifted/Talented Education, 26(2), 257-280. https://doi.org/10.9722/JGTE.2016.26.2.257
  88. Son, M. H., & Jeong, D. (2019). Development Worksheet and Rubric for System Thinking Assesment -Focused on the Earth System Unit in 'Integrated Science'. School Science Journal, 13(1), 78-94. https://doi.org/10.15737/SSJ.13.1.201902.78
  89. Spellman, K. V., Deutsch, A., Mulder, C. P. H., & Carsten-Conner, L. D. (2016). Metacognitive learning in the ecology classroom: A tool for preparing problem solvers in a time of rapid change?. Ecosphere 7(8):e01411. 10.1002/ecs2.1411
  90. Sterman, J. D. (2000). Business dynamics: Systems thinking and modeling for a complex world (No. HD30. 2 S7835 2000).
  91. Summers, M., Kruger, C., & Childs, A. (2001). Understanding the science of environmental issues: Development of a subject knowledge guide for primary teacher education. International Journal of Science Education, 23(1), 33-53. https://doi.org/10.1080/09500690116990
  92. Thompson, G. R., & Turk, J. (2011). Earth (1st ed.). Pacific Grove, CA: Brooks/Cole. 윤일희, 박경애, 김철희, 김성수, 안덕근, 안경진 역 (2012). 지구시스템 과학. 서울: 북스힐.
  93. Walker, G. H., Stanton, N. A., Jenkins, D. P., & Salmon, P. M. (2009). From telephones to iPhones: Applying systems thinking to networked, interoperable products. Applied Ergonomics, 40(2), 206-215. https://doi.org/10.1016/j.apergo.2008.04.003
  94. World Economic Forum (2016). New vision for education: Fostering social and emotional learning through technology. Cologny, Switzerland: Author.
  95. York, S., Lavi, R., Dori, Y. J., & Orgill, M. K. (2019). Applications of systems thinking in STEM education. Journal of Chemical Education, 96, 2742-2751. https://doi.org/10.1021/acs.jchemed.9b00261
  96. You, H. S., Marshall, J. A., & Delgado, C. (2018). Assessing students & disciplinary and interdisciplinary understanding of global carbon cycling. Journal of Research in Science Teaching, 55(3), 377-398. https://doi.org/10.1002/tea.21423
  97. Zangori, L., & Koontz, J. A. (2017). Supporting upper-level undergraduate students in building a systems perspective in a botany course. Journal of Biological Education, 51(4), 399-411. https://doi.org/10.1080/00219266.2016.1257502
  98. Zangori, L., Peel, A., Kinslow, A., Friedrichsen, P., & Sadler, T. D. (2017). Student development of model-based reasoning about carbon cycling and climate change in a socio-scientif ic issues unit. Journal of Research in Science Teaching, 54(10), 1249-1273. https://doi.org/10.1002/tea.21404