Journal of Convergence for Information Technology (융합정보논문지)

Convergence Society for SMB (중소기업융합학회)
권호 표지
DOI QR코드

DOI QR Code

Analysis of class satisfaction with Peer Evaluation in Collaborative Learning-based classes

협력학습 기반 수업에서의 동료평가에 대한 수업 만족도 분석

  • Jeong, Sun-Kyeong (University Innovation Center, Seoul National University) ;
  • Park, Nam-Su (Institute for Innovative Education, Sahmyook University)
  • 정선경 (서울대학교 대학혁신센터) ;
  • 박남수 (삼육대학교 교육혁신원)
  • Received : 2022.01.12
  • Accepted : 2022.03.20
  • Published : 2022.03.28
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study is to analyze class satisfaction with peer evaluation in Collaborative Learning-based classes. For collaborative learning-based classes, problem-based learning and project-based learning were selected. Educational implications were derived by designing Instructional procedures of Collaborative Learning-based classes, Peer evaluation types and questionnaire design, Peer evaluation progress of Collaborative Learning-based classes, Class satisfaction research and analysis In Collaborative Learning-based classes. The subjects of the study were participants in Collaborative Learning-based classes selected as problem-based learning and project-based classes. For class satisfaction with peer evaluation in Collaborative Learning-based classes, a survey was conducted on 168 participants A University in Korea. The research tool was designed as Learning procedures for peer evaluation Collaborative Learning-based classes is Team Building, Plan to the Task, To do Task, Mid-check on task, Task completion, Presentation & Evaluation, Reflection & Self-Evaluation. The content validity of items was confirmed by CVR of 12 experts. In the research results, the average class satisfaction of peer evaluation is 4.05(SD=91), followed by class concentration, diligence, voluntary, learning atmosphere. As a result of t-testing the difference in class type between collaborate learning-based classes, the satisfaction of PBL was higher than that of PjBL and a statistically significant difference was observed. The result of this study have significance in providing implications for class design and operation for the application and expansion of peer evaluation in higher education. However, there is a limit to generalization as a result of research using convenience.

본 연구의 목적은 협력학습 기반 수업에서의 동료평가에 대한 수업 만족도를 분석하는 것이다. 협력학습 기반 수업에서 동료평가를 위한 수업 절차 설계, 동료평가 유형과 문항 개발, 동료평가 실시, 수업만족도 조사 및 분석하여 교육적 시사점을 도출하고자 하였다. 연구대상은 문제중심학습과 프로젝트 기반 수업으로 선정된 협력학습 기반 수업 참여자를 대상으로 하였다. 협력학습 기반 수업에서의 동료평가에 대한 수업 만족도는 수도권 소재 A대학에서 협력기반 수업 참여자 168명을 대상으로 설문조사를 진행하였다. 연구도구는 동료평가를 위한 협력학습 절차는 팀 구성, 과제 수행 계획, 과제수행, 중간평가, 과제 수행 완료, 발표 및 평가, 자기평가로 설계하였고, 동료평가는 팀내. 팀간 평가로 유형화 하였고, 단계별 동료평가문항을 설계하였다. 동료평가 문항의 내용타당도는 전문가 12인의 CVR로 평정하였다. 연구결과에서 동료평가의 수업만족도는 평균 4.05(SD=.91)로 높게 나타났고 수업의 집중, 수업의 성실성, 자발성, 학습 분위기의 순으로 나타났다. 수업 만족도 수준 차이 검증 결과, 성별과 학년에서는 차이가 나타나지 않았으며, 수업 유형에서는 문제중심학습이 프로젝트기반 학습에 비하여 만족도 수준이 높게 나타났고 통계적으로 유의미하였다. 본 연구의 결과는 고등교육에서의 동료평가 적용 및 확대를 위한 수업설계와 운영의 시사점을 제공하는 데에 의의를 가진다.

Keywords

References

  1. I. S. Park & M. S. Kim. (2021). A Case Study on the Operation of Process-Based Evaluationin COVID-19. Journal of Curriculum Integration, 15(2), 57-77. DOI : http://doi.org/10.35304/JCI.15.2.03
  2. G. Ruel, A. Nauta & N. Bastiaans. (2003). Free-riding and team performance in project education. s.n. University of Groningen. 1-21.
  3. Y. O. Nam & B. M. Yu. (2016). An Analysis of Structural Relationship of Team Members Characteristics, Team Mental Model and Team Effectiveness Depending on Team Activity Style. Journal of Learner-Centered Curriculum and Instruction, 16(9), 517-541. DOI : 10.22251/jlcci.2016.16.9.517
  4. K. Y. Yim. (2011). Self-efficacy in Group Investigation Collaborative Learning. Theory and practice of Education, 16(2), 19-36.
  5. H. J. Choi. (2021). Effects of Simulation Practice Applying Team-Based Collaborative Learning: Focusing on Advanced Life support. The Journal of Learner-Centered Curriculum and Instruction, 21(17), 343-354. https://doi.org/10.22251/jlcci.2021.21.17.343
  6. M. Scardamalia & C. Bereiter. (1994). Computer support for knowledge-building communities. The journal of the learning sciences, 3(3), 265-283. https://doi.org/10.1207/s15327809jls0303_3
  7. R. E. Slavin. (2011). Cooperative learning. Learning and cognition in education, 160-166.
  8. D. W. Johnson & R. T. Johnson. (1996). Conflict resolution and peer mediation programs in elementary and secondary schools: A review of the research. Review of educational research, 66(4), 459-506. https://doi.org/10.3102/00346543066004459
  9. J. R. Graham & K. Barter. (1999). Collaboration: A social work practice method. Families in society, 80(1), 6-13. https://doi.org/10.1606/1044-3894.634
  10. R. L. Oxford. (1997). Cooperative learning, collaborative learning, and interaction: Three communicative strands in the language classroom. The modern language journal, 81(4), 443-456. https://doi.org/10.1111/j.1540-4781.1997.tb05510.x
  11. J. Cooper & R. Mueck. (1990). Student involvement in learning: Cooperative learning and college instruction. Journal on excellence in college teaching, 1(1), 68-76.
  12. D. W. Johnson & R. T. Johnson. (2004). Cooperation and the use of technology. Handbook of research on educational communications and technology, 785-811.
  13. I, G, Kang. (2003). A Structural Comparison of Cooperative leaning and Collaborative Learning. The Research Institute of Korean Education, 18, 183-197.
  14. S. J. Kim & S. H. Kim. (2017). Correlation between Tutor, Peer, Self-Evaluation and Paper Test in Problem-Based Learning. Journal of the Korea Academia-Industrial cooperation Society, 18(7), 275-283. DOI : 10.5762/KAIS.2017.18.7.275
  15. I. A. Kang & E. S. Jung. (2010). A Qualitative Analysis on the Differences between The Student-Selected Teams and The Learning Style-based Teams in terms of Their Satisfactory Levels on the Learning Activities. The Korean Journal of Educational Methodology Studies, 22(3), 67-95. https://doi.org/10.17927/TKJEMS.2010.22.3.67
  16. S. W. Kim, S. S. Kim, C. J. Hyuck & S. B. Lee. (2017). An Analysis of Secondary School Teachers' Evaluation Professionality on Bloom's Taxonomy and Achievement Standards. Journal of Educational Evaluation, 30(2), 173-197.
  17. K. H. Lee, H. Y. Kang, E. S. Ko, D. H. Lee, B. Shin, H. C. Lee & S. H. Kim. (2016). Exploration of the direction for the practice of process-focused assessment. Journal of Educational Research in Mathematics, 26(4), 819-834.
  18. H. C. Shin, H. G. Yun & K. S. Cho. (2013). Developing guidelines for designing efficient feedback in writing education system based on peer review. Jourmal of the HCI Society of Korea, 475-478
  19. S. J. Chae. (2004). A study on reliability and validity of student assessment in problem based learning -focused on the case of a medical college, Unpublished doctoral dissertation, Sungshin Women's University.
  20. S. J. Chea. (2006). A study on concordance of student assessment in Problem Based Learning of medical schools-focused on the tutor, peer, self-assessment. The Journal of Yeolin Education, 14(1), 331-349.
  21. M. K. Lee. (2016). The effects of college English classes using cooperative learning on students' English proficiency and social skills. The English Teachers Association in Korea, 22(2), 213-236.
  22. Y. Lee. (2016). The Effect of Team-Formation and Collaborative Learning Style on College Students' Learning Outcomes: An Application of Team-based Learning Model. The Korea Educational Review, 22(4). 115-139.
  23. M. A. Lee. (2017). University Students' Perceptions on the Level of Basic Elements Embedded in Cooperative Learning and Class Satisfaction. Journal of Educational Innovation Research, 27(1), 115-132. DOI : 10.21024/pnuedi.27.1.201703.115
  24. H. H. Kim. (2019). A Study on the Effects of Collaborative Learning in 4-year University in Korea. The Journal of Korean Teacher Education, 36(4), 205-233. DOI : 10.24211/tjkte.2019.36.4.205
  25. K. McCarthy, J. Reilly, L. McGinty & B. Smyth. (2004). Thinking positively-explanatory feedback for conversational recommender systems. In Proceedings of the European Conference on Case-Based Reasoning (ECCBR-04) Explanation Workshop, 115-124.
  26. D. Blom & K. Poole. (2004). Peer assessment of tertiary music performance: Opportunities for understanding performance assessment and performing through experience and self-reflection. British Journal of Music Education, 21(1), 111-125. https://doi.org/10.1017/S0265051703005539
  27. M. J. Kim. (2012). Developing and Validating a Multi-purpose Peer Assessment System for University Education. Journal of Korean Association for Educational Information and Media, 18(4), 468-491.
  28. E. B. Lee, O. H. Lee & S. S. Jang. (2015). The feasibility study of the use of self-evaluation and peer-evaluation in a computer practice class at higher education. The Journal of Educational Information and Media, 21(2), 65-89
  29. H. Y. Hwang & H. R. Hahn. (2020). Comparative Study of Self, Peer, and Instructor assessment in a Single Paragraph Writing. Korean Journal of General Education, 14(1), 107-130.
  30. H. J. Kim & S. Y. Chang. (2020). Effects of learners' participation in the development of evaluation criteria upon self-assessment and peer assessment: Focusing on higher education English literature classes. The Korea Association Of Foreign Languages Education, 27(3), 73-93. DOI : 10.15334/FLE.2020.27.3.73
  31. E. S. Jeong. (2018). A Survey of Students' Perceptions Toward Peer Evaluation in the Team Project-based ACT course. Journal of Learner-Centered Curriculum and Instruction, 18(2), 771-794. DOI : 10.22251/jlcci.2018.18.1.771
  32. Y. J. Kim & K. Y. Lim. (2019). Development Research of Peer Feedback System: Feedback between Teams in Project-Based Learning. The Journal of Educational Information and Media, 25(4), 627-655. DOI : 10.15833/KAFEIAM.25.4.627
  33. S. Kim. (2019). The Relationship and Evaluation Criteria of Self Evaluation and Peer Evaluation based on Team Contribution in Problem-Based Learning (PBL): A Case Study of classes of History Education in College. EDUCATIONAL RESEARCH, 74, 71-94. https://doi.org/10.17253/swueri.2019.74..004
  34. H. Won. (2018) A Study on the Effect of Intimacy of Peers on Task Activities in PBL Class : focused on cooperativeness and team contribution in peer evaluation. Teaching Korean as a Foreign Language, 50, 149-174. DOI : 10.21716/TKFL.50.149
  35. S. W. Um. (2019). A Study on the Model of Korean Writing Course Using Flipped Learning. The Korean Journal of Literacy Research, 10(1), 61-83. https://doi.org/10.37736/kjlr.2019.02.10.1.61
  36. H. S. Kang. (2020). Perceptions on Peer Assessment in a University Elective Course. Journal of Learner-Centered Curriculum and Instruction, 20(8), 167-189. DOI : 10.22251/jlcci.2020.20.8.167
  37. Y. S. Chae. (2017) Case study on Game Production Project Class with Project-Based Learning. The Journal of Image and Cultural Contents, 13, 55-69. DOI : 10.24174/jicc.2017.12.13.55
  38. E. J. Oh. (2019). Research on the Effectiveness of Peer Instruction and Students' Involvement. Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, 9(7), 199-208. DOI : 10.35873/ajmahs.2019.9.7.018
  39. S. J. Kwon. (2015). The Design Research of Awareness Information Using Learning Analytics in Computer-Supported Collaborative Learning. Asia pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, 5(5), 351-359. DOI : 10.14257/AJMAHS.2015.10.16.
  40. S. A. Kyun, Y. J. Yang & H. R. Jung. (2018). Analyses of the university professors' recognition on the introduction of new technologies to universities and the transformation of the current university system in the 4th industrial revolution era. Asia pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, 8(8), 873-882. DOI : 10.21742/AJMAHS.2018.08.41
  41. P. Dillenbourg. (1999). What do you mean by collaborative learning? In P. Dillenbourg(Ed.), Collaborative-learning: Cognitive and Computational Approaches. Oxford; UK, Elsevier Publishing.
  42. H. Jung & S. Woo (2021). Developing of Facilitating-chatbot on Computer Supported Collaborative Learning and Usability Evaluation. Journal of Digital Contents Society, 22(7), 1049-1057. DOI : 10.9728/dcs.2021.22.7.1049
  43. Y. J. Joo & K. Y. Go. (2016). The effects of achievement motivation, quality of teaching and learning, students' approaches to learning and peer interaction on outcomes of collaborative learning. Korean Association For Learner-Centered Curriculum And Instruction, 16(3), 85-103.
  44. J. W. Thomas. (2000). A review of research on project-based learning. San Rafael, CA: Autodesk Foundation.
  45. K. J. Topping. (2009). Peer assessment. Theory into practice, 48(1), 20-27. https://doi.org/10.1080/00405840802577569
  46. K. A. Van Lehn, M. T. H. Chi, W. Baggett & R. C. Murray. (1995). Progress report: Towards a theory of learning during tutoring. Pittsburgh, PA: Learning Research and Development Center. University of Pittsburgh.
  47. S. Gibb. (1999). The usefulness of theory: A case study in evaluating formal mentoring schemes. Human Relations, 52(8), 1055-1075. https://doi.org/10.1177/001872679905200804
  48. J. D. Karpicke & H. L. Roediger. (2008). The critical importance of retrieval for learning. Science, 319, 966-968. https://doi.org/10.1126/science.1152408
  49. S. J. Bae & J. Y. Park. (2016). The validity of using cumulative peer assessed scores for final grades in college courses, Korean Journal Of Cognitive Science, 27(2), 221-245. DOI : 10.19066/cogsci.2016.27.2.002
  50. M. J. Kim. (2005). Peer assessment as a learning method : The effects of assessor and assessee's roles on meta cognition, performance, and motivation. Journal of Educational Technology, 21(4), 1-28. https://doi.org/10.17232/KSET.21.4.1
  51. E. J. Oh. (2019) Research on the Effectiveness of Peer Instruction and Students' Involvement. Asia pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, 9(7), 199-208. DOI : 10.35873/ajmahs.2019.9.7.018
  52. M. S. Green, G. Harari & E. Kristal-Boneh. (1994). Excess winter mortality from ischaemic heart disease and stroke during colder and warmer years in Israel: An evaluation and review of the role of environmental temperature. The European Journal of Public Health, 4(1), 3-11. https://doi.org/10.1093/eurpub/4.1.3
  53. C. Kulkarni et al. (2013). Peer and self assessment in massive online classes. ACM Transactions on Computer-Human Interaction (TOCHI), 20(6), 1-31. https://doi.org/10.1145/2505057
  54. J. Fluckiger, Y. T. Y. Vigil, R. Pasco & K. Danielson. (2010). Formative feedback: Involving students as partners in assessment to enhance learning. College teaching, 58(4), 136-140. https://doi.org/10.1080/87567555.2010.484031
  55. R. A. Schmidt & R. A. Bjork. (1992). New conceptualizations of practice: Common principles in three paradigms suggest new concepts for training. Psychological science, 3(4), 207-218. https://doi.org/10.1111/j.1467-9280.1992.tb00029.x
  56. Y. J. Kim. (2016). Effects of Providing Peer Feedback on Academic Self-efficacy, Academic Achievement and Satisfaction of Feedback Provider in Project-based Collaborative Learning. Doctoral dissertation. Ewha Womans University, Seoul.
  57. Y. H. Lee & J. Yun. (2021). University Class Model using Peer Assessment Based on Collective Intelligence : Focusing on the case of Dankook University. Journal of Education & Culture, 27(5), 163-190 DOI : 10.24159/joec.2021.27.5.163
  58. J. Y. Park & J. A. Park. (2018). The Current State and Prospects of Peer Assessment. KOREAN JOURNAL OF COGNITIVE SCIENCE, 29(2), 85-104. DOI : 10.19066/cogsci.2018.29.2.001
  59. E. C. Lee. (2019). Analysis of the Characteristics of Free-riding Learner in Online Collaborative Learning. JOURNAL OF THE KOREA CONTENTS ASSOCIATION. 19(10), 385-396. https://doi.org/10.5124/jkma.2019.62.7.385