Journal of The Korean Association For Science Education (한국과학교육학회지)

The Korean Association for Science Education (한국과학교육학회)
권호 표지
DOI QR코드

DOI QR Code

The Development of Assessment Tool on Student's Character Competence based on Collaborative Problem-Solving Instruction Model

협력적 문제해결 중심 교수모델에 기반 한 학생 인성 역량 평가 도구 개발

  • Received : 2018.04.20
  • Accepted : 2018.06.15
  • Published : 2018.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study is to develop an assessment tool to evaluate student character competence in applying a Collaborative Problem-Solving Instruction Model in science education. Through the literature analysis, nine elements of character are extracted. They are: openness, empathy, tolerance, caring, integrity, self-regulation, honesty, responsibility, and cooperation. Based on these existing measures of character competence, experts discussed and developed items for evaluation of a student's character competence based on the Collaborative Problem-Solving Instruction Model. The first 88 preliminary items were investigated, corrected, and supplemented based on the results of the first survey. A second validity survey was conducted on 71 middle- and high school science teachers to determine the content validity of the items. Inter-rater reliability was calculated for the assessors to verify the reliability of the items. Overall, the inter-rater reliability and content validity of the assessment items are good with 53 items ultimately being selected based on the analysis results. The assessment tool developed in this study could be used to explore changes in student character competence through a Collaborative Problem-Solving Instruction Model, as well as to evaluate student character competence in science education.

본 연구의 목적은 과학교육에 협력적 문제해결 중심 교수모델 적용에서 학생의 인성 역량을 평가하는 평가 도구를 개발하는 것이다. 문헌 분석을 통해 개방성, 공감, 관용, 배려, 성실, 자기조절, 정직, 책임, 협력의 9개 인성 역량 구성요인을 추출하였다. 기존 인성 역량 관련 척도를 바탕으로 전문가 협의를 통해 협력적 문제해결 중심 교수모델에 기반 한 학생 인성 역량 평가 문항을 개발하였다. 전문가 집단을 대상으로 88개의 예비문항에 대한 1차 조사를 하였고, 예비조사 결과를 바탕으로 문항을 수정 보완하였다. 재구성된 문항의 타당도를 확인하고자 중 고등학교 과학교사 71명을 대상으로 2차 내용타당도 조사를 하였고, 해당 문항의 신뢰도를 검증하기 위해 평정자간 신뢰도를 산출하였다. 평가 문항의 내용타당도 및 평정자간 신뢰도는 전반적으로 양호한 수준으로 나타났고 분석 결과를 토대로 53문항을 최종적으로 선정하였다. 본 연구에서 개발한 평가 도구는 협력적 문제해결 중심 교수모델을 통한 학생의 인성 역량 변화를 알아보고 과학교육에서 학생 인성 역량을 평가하는 데 유용하게 사용될 수 있을 것이다.

Keywords

References

  1. An, Y., Kang, E., Kwon, J., Park, J., Son. J., & Nam, J. (2017). Analysis of elements of character education in the middle school science curriculum. Journal of Science Education, 41(2), 167-178. https://doi.org/10.21796/jse.2017.41.2.167
  2. Arthur, J., Kristjansson, K., Walker, D., Sanderse, W., & Jones, C. (2015). Character education in UK schools. University of Birmingham: Jubilee Centre for Character and Virtues. Retrieved From: http://epapers.bham.ac.uk/1969/1/Character_Education_in_UK_Schools.pdf.
  3. Bae, H. (2008). Theory-driven educational program evaluation. Seoul: Wonmisa.
  4. Baek, S., & Lim, S. (2015). The development and validation of a preschooler character scale rated by teacher. Korean Journal of Educational Research, 53(3), 347-375.
  5. Bodemer, D., & Dehler, J. (2011). Group awareness in CSCL environments. Computers in Human Behavior, 27(3), 1043-1045. https://doi.org/10.1016/j.chb.2010.07.014
  6. Byun, Y., & Lee, S. (2003). Instructional design. Seoul: Hakjisa.
  7. Character Education Promotion Act. (2015). Retrieved From: http://www.law.go.kr/lsInfoP.do?lsiSeq=188361&efYd=20161220#0000.
  8. Cho, H., Seo, M., Nam, J., Kwon, J., Son, J., & Park, J. (2017). Analysis of character competency change in high school students by role assignment in Argument-Based Inquiry(ABI) Science Class. Journal of the Korean Association for Science Education, 37(4), 763-773. https://doi.org/10.14697/JKASE.2017.37.4.763
  9. Cho, N., & Cha, W. (2001). A study on the evaluation method of character education program in schools. Moral & Ethics Education, 13, 18-40.
  10. Cho, N., Choi, W., & Eun, J. (2014). Character education in the curriculum and the ability of teachers. The Korean Society for the Study of Teacher Education, 67th Spring Conference, 135-180.
  11. Cho, Y., Kim, C., Yoo, K., & Lee, K. (2016). Understanding and practice Character. Gyeonggi Province: Knowledge Community.
  12. Choi, C., & Kim, J. (2004). A analysis of factors affecting the Youth Conflict Resolution Styles(YCRS) with friends. Studies on Korean Youth, 15(2), 509-539.
  13. Choi, S., & Lee, C. (2017). A study on the development of elementary school mathematics program with a focus on social issues for the mathematically gifted and talented students for fostering democratic citizenship. Journal of Elementary Mathematics Education in Korea, 21(3), 415-441.
  14. Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assess, 6, 284-290. https://doi.org/10.1037/1040-3590.6.4.284
  15. Cohen, E. G. (1994). Restructuring the classroom: Conditions for productive small groups. Review of educational research, 64(1), 1-35. https://doi.org/10.3102/00346543064001001
  16. Do, S. (2013). The character education as a future human resource development. The Journal of Thinking Development, 9(2), 143-159.
  17. Education Research Institute, Seoul National University. (1994). The dictionary of educational studies. Seoul: Seoul National University.
  18. Fehring, R. J. (1987). Methods to validate nursing diagnoses. Heart and Lung, 16(6), 625-629.
  19. Fischer, F., Bruhn, J., Grasel, C., & Mandl, H. (2002). Fostering collaborative knowledge construction with visualization tools. Learning and Instruction, 12(2), 213-232. https://doi.org/10.1016/S0959-4752(01)00005-6
  20. Fowers, B. J. (2014). Toward programmatic research on virtue assessment: challenges and prospects. School Field, 12(3), 309-328. https://doi.org/10.1177/1477878514546064
  21. Ha, J. (2000). The development of creative personality scale. Korean Journal of Educational Psychology, 14(2), 187-210.
  22. Hong, S., No, U., & Jung, S. (2011). Factor structure of scale containing negatively-worded items: A case of self-esteem scale. Journal of Educational Evaluation, 24(3), 713-732.
  23. Hyun, J., Han, M., & Im, S. (2015). Development and validation of primary and secondary school students' character test. The Korean Journal of Social and Personality Psychology, 29(1), 83-106.
  24. Jang, J., Mun, J., Ryu, H., Choi, K., Krajcik, J., & Kim, S. (2012). Korean middle school students' perceptions as global citizens of socioscientific Issues. Journal of the Korean Association for Science Education, 32(7), 1124-1138. https://doi.org/10.14697/jkase.2012.32.7.1124
  25. Jeong, C., Chang, K., Lee, D., Song, S., & Woo, Y. (2016). Creating practical action plans for character education through student-teacher/studentstudent interactions. Journal of Ethics Education Studies, 40, 1-27. https://doi.org/10.18850/JEES.2016.40.01
  26. Jo, H. (2014). Exploration of supporting teaching and learning of mathematics assessment through observation and interview. Doctoral dissertation, Sungkyunkwan University.
  27. Jung, C., Son, K., & Shin, W. (2015). A study on the effectiveness of Goodneighbors education program. 2015 Goodneighbors Research Paper. Seoul: Goodneighbors.
  28. Jung, J. (2010). A study on the development of observation evaluation standard for elementary invention gifted distinction. Journal of Korean Practical Arts Education, 23(3), 199-219.
  29. Jung, J., Jung, W., & Kim, H. (1998). National assessment system development of science-related affective domain. Journal of the Korean Association for Science Education, 18(3), 357-369.
  30. Kang, D., & Lee, J. (2016). A study on the implication of character education in art education through implementing character-oriented achievement standards. Journal of Art Education, 46, 1-22.
  31. Kang, T., & Jang, H. (2003). Construction and validation of debate competence. Korean Journal of Broadcasting and Telecommunication Studies, 17(4), 139-185.
  32. Kim, D., Choi, S., Shim, S., Lee, J., & Ra, Y. (2016). The challenges and prospects of future education design based on character education. Asian Journal of Education, 17(1), 25-45. https://doi.org/10.15753/aje.2016.03.17.1.25
  33. Kim, D., Oh, H., Song, Y., Koh, E., Park, S., & Jung, E. (2009). Exploring students' core competencies in higher education from professors' perspectives: A case study of Seoul National University(SNU). Asian Journal of Education, 10(2), 195-214.
  34. Kim, H., Lee, K., Kim, O., & Lee, Y. (2010). The validation of the moral intelligence checklist for Korean adolescents. The Journal of Yeolin Education, 18(4), 152-170.
  35. Kim, K., Kim, S., Kim, S., Ban, J., & Kim, S. (2006). Standards of teacher's competence in student assessment. Journal of Education Evaluation, 19(2), 89-112.
  36. Kim, M. (2007). A study on methods for personality education in morals education. Journal of Ethics Education Studies, 14, 181-206.
  37. Kim, M. (2015). Revisiting affective characteristics assessment for humanism education in school: Recent trends in educational research. Journal of Learner-Centered Curriculum and Instruction, 15(11), 981-1000.
  38. Kim, M., Kim, Y., & Oh, K. (2012). Standardization study for the Korean version of the teacher's report form. The Korean Journal of School Psychology, 9(2), 367-391. https://doi.org/10.16983/kjsp.2012.9.2.367
  39. Kim, S. (2011). Development of youth tolerance Scale. Journal of Evaluation on Counseling, 4(1), 63-81.
  40. Kim. H., & Han, S. (2017). Comparison among perspective taking, personal distress, empathic concern, empathic responding and empathic understanding: Concerning the relatedness with the Big 5 personality factors. Journal of Human Understanding and Counseling, 38(2), 55-73.
  41. Kong, K. (2017). Statistical methods: Reliability assessment and method comparison. The Ewha Medical Journal, 40(1), 9-16. https://doi.org/10.12771/emj.2017.40.1.9
  42. Korea Institute for Curriculum and Evaluation. (2004). Basic research for developing the measurement of character education. Korea Institute for Curriculum and Evaluation Research paper. CRC 2004-4-14.
  43. Korea Institute for Curriculum and Evaluation. (2013). Comprehensive plans for improving evaluation method for realizing creativity and character education. RRE 2013-20. Retrieved from: https://www.nkis.re.kr:4445/subject_view1.do?otpId=KICE00026956&otpSeq=0&popup=P.
  44. Korean Educational Development Institute. (2012). A development of the KEDI creative personality scale. Retrieved from: http://gifted.kedi.re.kr/khome/gifted/research/selectResearchForm.do?article_sq_no=19445&board_sq_no=22&selectTp=0.
  45. Kwak, Y. (2013). Ways of restructuring key competencies for a revision of science curriculum. Korean Earth Science Society, 34(4), 378-387.
  46. Kwon, J. (2017). The development and effect of Collaborative Problem-Solving Instruction model for improving character competence in science education. Doctoral dissertation, Pusan National University.
  47. Kwon, J., & Nam, J. (2017). Impact of Collaborative Problem-Solving Instruction model on character competence of high school students. Journal of the Korean Association for Science Education, 37(5), 847-857. https://doi.org/10.14697/JKASE.2017.37.5.847
  48. Kwon, M., & Lee, Y. (2017). A comparison study of self-report questionnaire, teacher's observation assessment, observation assessment within character education program for character assessment. Journal of Ethics Education Studies, 44, 157-190. https://doi.org/10.18850/JEES.2017.44.06
  49. Lee, B., Kim, D., & Shin, W. (2017). Children's character competency in 4th Industrial Revolution. Goodneighbors Research Paper. Retrieved from: www.goodneighbors.kr/board/boardFileDownLoad.gn?seq=92021.
  50. Lee, H., Choi, Y., & Ko, Y. (2014). Designing collective intelligence-based instructional models for teaching socioscientific Issues. Journal of the Korean Association for Science Education, 34(6), 523-534. https://doi.org/10.14697/jkase.2014.34.6.0523
  51. Lee, K. (2017). Critical considerations on issues and methods of character assessment. Master's Thesis, Seoul National University.
  52. Lee, S., Kim, J., & Hong, J. (2017). The effects of subject-linked character education program in social studies class on character development for High School Students. Journal of Education & Culture, 23(6(B)), 409-432.
  53. Lee, Y. (2012). The development of the Test of Morality(TM) for elementary school students - Focused on the domain of - I as a moral agent -. The Journal of Elementary Education, 25(4), 125-146.
  54. Lee, Y. S & Kim, S, H. (2009). Development of a care scale for elementary school students. The Korea Journal of Counseling, 10(4), 2479-2493. https://doi.org/10.15703/kjc.10.4.200912.2479
  55. Lickona, T., Schaps, E., & Lewis, C. C. (2003). Eleven principles of effective character education. Character Education Partnership. Retrieved from : https://digitalcommons.unomaha.edu/cgi/viewcontent.cgi?article=1065&context=slcestgen.
  56. Lynn, M. R. (1985). Determination and quantification of content validity. Nursing research, 35(6), 382-385.
  57. Meichtry, Y. (2002). Elementary science teaching methods: Developing and measuring student views about the nature of science. In W. F. McComas(E d), The nature of science in science education, (pp. 231-241). New York, NY: Kluwer Academic Publishers.
  58. Ministry of Education, Science and Technology (2012). The research of character education. Retrieved from: http://www.moe.go.kr/boardCnts/view.do?boardID=294&lev=0&statusYN=W&s=moe&m=0503&opType=N&boardSeq=32716.
  59. Ministry of Education. (2013). The present condition of character education in schools activation plan. Retrieved from: http://www.moe.go.kr/boardCnts/view.do boardID=352&lev=0&statusYN=C&s=moe&m=030212&opType=N&boardSeq=52949.
  60. Ministry of Education. (2014). A study of development of character index. Seoul: Jinhan M&B.
  61. Ministry of Education. (2015). 2015 revised curriculum Science. Seoul: Ministry of Education.
  62. Moon. S. (2002). The validity and utility of the Korean version of Social Skill Rating System(K-SSRS: College Level). The Korean Journal of Counseling and Psychotherapy, 14(3), 655-679.
  63. Nam, I., & Im, S. (2017). Analysis of trends of character-related research in science education. Journal of the Korean Association for Science Education, 37(3), 493-505. https://doi.org/10.14697/jkase.2017.37.3.493
  64. Nam, J., Kwak, K., Jang, K., & Hand, B. (2008). The implementation of argumentation using Science Writing Heuristic (SWH) in middle school science. Journal of the Korean Association for Science Education, 28(8), 922-936.
  65. Nelson, L. M. (1999). Collaborative problem solving. In C. M. Reigeluth (E d), Instructional design theories and models: A new paradigm of instructional theory (Volume II), (pp. 241-267). New Jersey, NJ: Lawrence Erlbaum Associates, Inc.
  66. OECD. (2005). The definition and selection of key competencies: Executive summary. Retrieved from: http://www.oecd.org/pisa/35070367.pdf.
  67. Park, D., & Park, J. (2016). Directions for character education in science education and a theoretical approach of nature-study in terms of character education. Journal of the Korean Association for Science Education, 36(4), 581-589. https://doi.org/10.14697/jkase.2016.36.4.0581
  68. Park, S., & Huh, S. (2012). A study for development of the integrated humanity scale for adolescent. The Journal of Child Education, 21(3), 35-47.
  69. Person, A. E., Moiduddin, E., Hague-Angus, M., & Malone, L. M. (2009). Survey of outcomes measurement in research on character education programs. NCEE 2009-006, Washington DC: U.S. Department of Education.
  70. Peterson, R. S. & Behfar, K. J. (2005). Leadership as group regulation. In D. M. Messick & R. M. Kramer (E d), The psychology of leadership: New perspectives and research, (pp.143-162). New Jersey, NJ: Lawrence Erlbaum Associates, Inc.
  71. Seong, T. (2002). Validity and reliability. Seoul:Hakjisa.
  72. Seong, T., & Si, G. (2006). Research methodology. Seoul:Hakjisa.
  73. So, K. (2007). 'Competency' in the context of schooling: It's meaning and curricular implication. The Journal of Curriculum Studies, 25(3), 1-21.
  74. Son, K. (2016). Improvement of the effectiveness of character education program. Journal of Ethics Education Studies, 41, 49-78. https://doi.org/10.18850/JEES.2016.41.03
  75. Son, K., & Jeong, C. (2014). A study on the analysis of Korean adolescent’s character and its implications for character education. Journal of Ethics Education Studies, 33, 27-52.
  76. Song, Y. (2005). Effects of problem-solving activities on science process skills and scientific attitudes of middle school students. Doctoral dissertation, Korea National University of Education.
  77. Sparks, S., & Lien-Gieschen, T. (1994). Modification of the diagnostic content validity model. Nursing Diagnosis, 5, 31-35. https://doi.org/10.1111/j.1744-618X.1994.tb00365.x
  78. Stiff-Williams, H. R. (2010). Widening the lens to teach character education alongside standards curriculum. The Clearing House, 83(4), 115-120. https://doi.org/10.1080/00098651003653030
  79. Waltz, C. F., & Bausell, B. R. (1981). Nursing research: design statistics and computer analysis. PA: F. A. Davis.
  80. Washington State University. (2016). Prosocial Spring 16 Survey. Retrieved from: https://educationwsu.co1.qualtrics.com/ControlPanel/Ajax.php.
  81. Whang, W., Kim, D., Kim, W., Lee, D., & Choi, S. (2017). Development and validation of a testing tool for mathematical creativity and character. The Mathematical Education, 56(1), 41-62. https://doi.org/10.7468/mathedu.2017.56.1.41
  82. Yang, J., Kim, H., Gao, L., Kim, E., Kim, S., & Lee, H. (2012). Perceptions of science teachers on socioscientific issues as an instructional tool for creativity and character education. Journal of the Korean Association for Science Education, 32(1), 113-128. https://doi.org/10.14697/jkase.2012.32.1.113
  83. Yerrick, R., & Roth, W. M. (2005). Introduction: The role of language in science learning and teaching. In R. Yerrick & W. M Roth (E d), Establishing scientific classroom discourse communities: Multiple voices of teaching and learning research, (pp. 1-18). New Jersey, NJ: Lawrence Erlbaum Associates, Inc.

Cited by

  1. 협력적 문제해결 중심 교수모델(CoProC)을 적용한 고등학교 화학 수업에서의 인성역량 평가 방법에 대한 비교 분석 vol.65, pp.2, 2021, https://doi.org/10.5012/jkcs.2021.65.2.151