Advanced SearchSearch Tips
Validation of Learning Progressions for Earth`s Motion and Solar System in Elementary grades: Focusing on Construct Validity and Consequential Validity
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Validation of Learning Progressions for Earth`s Motion and Solar System in Elementary grades: Focusing on Construct Validity and Consequential Validity
Lee, Kiyoung; Maeng, Seungho; Park, Young-Shin; Lee, Jeong-A; Oh, Hyunseok;
  PDF(new window)
The purpose of this study is to validate learning progressions for Earth`s motion and solar system from two different perspectives of validity. One is construct validity, that is whether a hypothetical pathway derived from our study of LPs is supported by empirical evidence of children`s substantive development. The other is consequential validity, which refers to the impact of LP-based adaptive instruction on children`s improved learning outcomes. For this purpose, 373 fifth-grade students and 17 teachers from six elementary schools in Seoul, Kangwon province, and Gwangju participated. We designed LP-based adaptive instruction modules delving into the unit of `Solar system and stars.` We also employed 13 ordered multiple-choice items and analyzed the transitions of children`s achievement levels based on the results of pre-test and post-test. For testing construct validity, 64 % of children in the experimental group showed improvement according to the hypothetical pathways. Rasch analysis also supports this results. For testing consequential validity, the analysis of covariance between experimental and control groups revealed that the improvement of experimental group is significantly higher than the control group (F
learning progressions;Rasch analysis Earth` motion;solar system;construct validity;consequential validity;
 Cited by
Alonzo, A. C., & Steedle, J. T. (2009). Developing and assessing a force and motion learning progression. Science Education, 93(3), 389-421. crossref(new window)

Alonzo, A. C., Neidorf, T., & Anderson, C. W. (2012). Using learning progression to inform large-scale assessment. In Alonzo, A. C., & Gotwals, A. W. (Eds.). Learning science in science: Current challenges and future directions (pp. 211-240). Rotterdam, The Netherlands: Sense Purblishers.

Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd edtion). New York, NY: Routledge.

Briggs, D. C., Alonzo, A. C., Schwab, C., & Wilson, M. (2006). Diagnostic assessment with ordered multiple-choice items. Educational Assessment, 11(1), 33-63. crossref(new window)

Corcoran, T., & Silander, M. (2009). Instruction in high schools: The evidence and the challenge. The Future of Children: America's High Schools, 19, 157-183.

Corcoran, T., Mosher, F. A., & Rogat, A. (2009). Learning progressions in science: An evidence-based approach to reform. Consortium for Policy Research in Education Report #RR-63. Philadelphia, PA: Consortium for Policy Research in Education.

Ji, E., & Chae, S. (2000). Theory and practices of Rasch model. Seoul: Kyoyook-Kwahak-Sa.

Kim, Y., Lee, K., Maeng, S., & Lee, J. (2014). Development of assessment items for learning progressions on cross-cutting concepts and its application to physics and Earth science. Report submitted to Korea Foundation for the Advancement of Science & Creativity.

Krajcik, J. S. (2012). The importance, cautions and future of learning progression research. In Alonzo, A. C., & Gotwals, A. W. (Eds.). Learning science in science: Current challenges and future directions (pp. 27-36). Rotterdam, The Netherlands: Sense Purblishers.

Liu, X. (2010). Using and developing measurement instruments in science education: A Rasch modeling approach. Charlotte, NC: Information Age Publishing Inc.

Maeng, S., & Lee, K. (2015). Cross-sectional item response analysis of geocognition assessment for the development of plate tectonics learning progressions: Rasch model. Journal of the Korean Earth Science Society, 35(1), 37-52.

Maeng, S., Lee, K., Park, Y., Lee, J., & Oh, H. (2014). Development and validation of a learning progression for astronomical system using ordered multiple-choice assessment. Journal of the Korean Association for Science Education, 34(8), 703-718. crossref(new window)

Maeng, S., Seong, Y., & Jang, S. (2013). Present states, methodological features, and an exemplar study of the research on learning progressions. Journal of the Korean Association for Science Education, 33, 161-180. crossref(new window)

Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149-174. crossref(new window)

Ministry of Education, Science, and Technology. (2011). 2009 revised science curriculum. Seoul: MEST.

National Research Council (NRC). (2006). Learning to think spatially. Washington, DC: National Academies Press.

National Research Council. (2007). Taking science to school: Learning and teaching science in grades K-8. (R.A. Duschl, H.A. Schweingruber, & A.W. Shouse, Eds.). Washington DC: The National Academies Press.

National Research Council. (2012). A framework for k-12 science education: Practices, crosscutting concepts, and core ideas. Committee on a Conceptual Framework for New K-12 Science Education Standards. Board on Science Education, Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies Press.

NGSS Lead States (2013). Next Generation Science Standards. Achieve, Inc.

Oh, H., Lee, K., Park, Y-S., Maeng, S., & Lee, J-A. (2015). An analysis of systems thinking revealed in middle school astronomy classes: The case of science teachers' teaching practices for the unit of stars and universe. Journal of Korean Earth Science Society, 36(6), 591-608. crossref(new window)

Plummer, J. D. (2014). Spatial thinking as the dimension of progress in an astronomy learning progression, Studies in Science Education, 50(1), 1-45. crossref(new window)

Seong, Y., Maeng, S., & Jang, S. (2013). A learning progression for water cycle from fourth to sixth graders with ordered multiple-choice items. Elementary Science Education, 32(2), 139-158.

Shin, N., Koh, E. J., Choi, C. I., & Jeong, D. H. (2014). Using a learning progression to characterize Korean secondary students' knowledge and submicroscopic representations of the particle nature of matter. Journal of Korean Association for Science Education, 34(5), 437-447. crossref(new window)

Wilson, M. (2009). Measuring progressions: Assessment structures underlying a learning progression. Journal of Research in Science Teaching, 46, 716-730. crossref(new window)