Korean Medical Education Review (의학교육논단)

Yonsei university college of medicine (연세대학교 의과대학)
권호 표지
DOI QR코드

DOI QR Code

Adapting an Integrated Program Evaluation for Promoting Competency-Based Medical Education

역량바탕의학교육을 촉진하기 위한 교육평가: 통합평가모형 적용

  • Ju, Hyunjung (Educational Evaluation Committee, Inje University College of Medicine) ;
  • Oh, Minkyung (Educational Evaluation Committee, Inje University College of Medicine) ;
  • Lee, Jong-Tae (Department of Preventive Medicine, Inje University College of Medicine) ;
  • Yoon, Bo Young (Educational Evaluation Committee, Inje University College of Medicine)
  • 주현정 (인제대학교 의과대학 교육평가위원회) ;
  • 오민경 (인제대학교 의과대학 교육평가위원회) ;
  • 이종태 (인제대학교 의과대학 예방의학교실) ;
  • 윤보영 (인제대학교 의과대학 교육평가위원회)
  • Received : 2020.12.28
  • Accepted : 2021.02.04
  • Published : 2021.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam's Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick's four-level model of an outcome-oriented approach. Kirkpatrick's model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick's model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.

Keywords

References

  1. Frank JR, Snell LS, Cate OT, Holmboe ES, Carraccio C, Swing SR, et al. Competency-based medical education: theory to practice. Med Teach. 2010;32(8):638-45. https://doi.org/10.3109/0142159X.2010.501190
  2. Frye AW, Hemmer PA. Program evaluation models and related theories: AMEE guide no. 67. Med Teach. 2012;34(5):e288-99. https://doi.org/10.3109/0142159X.2012.668637
  3. Sung TJ. The basis of educational evaluation. 3rd ed. Seoul: Hakjisa; 2019.
  4. Kirkpatrick DL, Kirkpatrick JD. Evaluating training programs. 3rd ed. San Francisco (CA): Berrett-Koehler Publishers; 2006.
  5. Stufflebeam DL. The CIPP model for evaluation. In: Kellaghan T, Stufflebeam DL, editors. International handbook of educational evaluation. Norwell (MA): Kluwer Academic publishers; 2003. p. 31-61.
  6. Stufflebeam DL, Zhang G. The CIPP evaluation model: how to evaluate for improvement and accountability. New York (NY): The Guilford Press; 2017.
  7. Lee SY, Shin JS, Lee SH. How to execute Context, Input, Process, and Product evaluation model in medical health education. J Educ Eval Health Prof. 2019;16:40. https://doi.org/10.3352/jeehp.2019.16.40
  8. Dubrowski A, Morin MP. Evaluating pain education programs: an integrated approach. Pain Res Manag. 2011;16(6):407-10. https://doi.org/10.1155/2011/320617
  9. Korean Institute of Medical Education and Evaluation. Accreditation Standards of Korean Institute of Medical Education and Evaluation 2019 [Internet]. Seoul: Korean Institute of Medical Education and Evaluation; 2020 [cited 2020 Feb 21]. Available from: https://kimee.or.kr/board/data/?uid=1318&mod=document&pageid=1.
  10. Educational Evaluation Committee. Educational evaluation report. Busan: Inje University College of Medicine; 2019.
  11. Lee JT, Kim DJ, Kim YS, Kim TJ, Rho HR, Yoon BY, et al. Curriculum brochure of Inje University College of Medicine. Busan: Inje Univerisity College of Medicine; 2019.
  12. Kirkpatrick JD, Kirkpatrick WK. Kirkpatrick's four levels of training evaluation. Alexandra (VA): ATD Press; 2016.
  13. Harden RM, Laidlaw JM. Evaluating the curriculum. In: Harden RM, Laidlaw JM, editors. Essential skills for a medical teacher: an introduction to teaching and learning in medicine. 2nd ed. Edinburgh: Elsevier; 2017. p. 259-66.
  14. Branch RM. Instructional design: the ADDIE approach. New York (NY): Springer; 2009.
  15. Gagne RM, Wager WW, Golas KC, Keller JM. Principles of instructional design. 5th ed. Belmont (CA): Wadsworth, Cengage Learning; 2005.