의학교육논단 (Korean Medical Education Review)

  • 제22권3호
  • /
  • Pages.198-206
  • /
  • 2020
  • /
  • 2092-5603(pISSN)
  • /
  • 2093-6370(eISSN)
연세대학교 의과대학 (Yonsei university college of medicine)
권호 표지
DOI QR코드

DOI QR Code

의과대학의 컴퓨터기반시험 프로그램 및 시험환경 만족도 분석

Analysis of the Satisfaction with Computer Based Test Program and Test Environment in Medical School

  • 김순구 (계명대학교 의과대학 교육지원센터) ;
  • 이애화 (계명대학교 의과대학 교육지원센터) ;
  • 황일선 (계명대학교 의과대학 교육지원센터)
  • Kim, Soon Gu (Education Support Center, Keimyung University School of Medicine) ;
  • Lee, Aehwa (Education Support Center, Keimyung University School of Medicine) ;
  • Hwang, Ilseon (Education Support Center, Keimyung University School of Medicine)
  • 투고 : 2020.07.23
  • 심사 : 2020.10.14
  • 발행 : 2020.10.31
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

This study aimed to identify needed improvements to current evaluation methods in medical school computer-based test (CBT) programs and test environments. To that end, an analysis of the importance and satisfaction was conducted through a survey of 3rd and 4th year medical students who had sufficient experience with CBT programs. Importance performance analysis methodology using the correlation coefficient was applied to assess average satisfaction and importance. The first quadrant (keep up the good work) was a factor of review and time management and test facilities among the conveniences of the CBT program. The second quadrant (concentrate here) was a factor of the convenience of the CBT program and computer monitor and chair factor within the test facilities. The third quadrant (low priority) was a factor of cheating and computer failure. The fourth quadrant (possible overkill) was the location, spacing, and temperature factors of the test facilities. Improvements are needed to reduce 'eye fatigue' and help students focus and understand the questions in the CBT programs. It is necessary to improve computer monitors, desks and chairs, and consider the subject's body type and manager in order to cope with computer breakdown and peripheral failures. Spare computers are needed. These findings are meaningful in that they have been able to identify factors that require improvement in the CBT program and test environment resulting from changes in assessment tools.

키워드

참고문헌

  1. Park JH, Son JY, Kim S, Park JH, Son JY, Kim S. Experiences with establishing and implementing learning management system and computer-based test system in medical college. Korean J Med Educ. 2012;24(3):213-22. https://doi.org/10.3946/kjme.2012.24.3.213
  2. Im EJ, Lee WK, Lee YC, Choe BH, Chung SK, Lee TH, et al. Development of computer-based test (CBT) and student recognition survey on CBT. Korean J Med Educ. 2008;20(2):145-54. https://doi.org/10.3946/kjme.2008.20.2.145
  3. Lee JM, Kam B. A deterrent method for cheating in CBT(computer-based testing) applications. Asia Pac J Multimed Serv Converg Art Humanit Sociol. 2018;8(1):825-35.
  4. Korea Health Personnel Licensing Examination Institute. Announcement of examination method changing for the national examination to physician, dentist and oriental doctor [Internet]. Seoul: Korea Health Personnel Licensing Examination Institute [cited 2020 Oct 22]. Available from: http://www.kuksiwon.or.kr/notice/brd/m_51/view.do?seq=2692&srchFr=&srchTo=&srchWord=&srchTp=&itm_seq_1=0&itm_seq_2=0&multi_itm_seq=0&company_cd=&company_nm.
  5. Back SG, Hee CS. Computerized adaptive test. Seoul: Wonmisa; 1998.
  6. Kim IS. An overview of computer-assisted English testing research and suggestions for developing a performance-based computer adaptive English listening test for elementary school students. J Humanit. 2003;9:55-87.
  7. Kwon OY, Rhee SY, Choi JM, Kim YS, Kwon OY, Rhee SY, et al. Usefulness of ubiquitous-based testing for evaluations in medical education. Korean J Med Educ. 2015;27(1):3-10. https://doi.org/10.3946/kjme.2015.27.1.3
  8. Kim SH, Cho SY. Security improvement methods for computer-based test systems. Converg Secur J. 2018;18(2):33-40.
  9. Jeong HH. The score comparability of CBT and PBT: focusing on difference related to gender and learning ability. J Educ Technol. 2010;26(3):81-104. https://doi.org/10.17232/KSET.26.3.81
  10. Kwon KH, Min SW, Nah K. A study of direction for usability enhancement of UBT. J Digit Design. 2015;15(3):259-76. https://doi.org/10.17280/jdd.2015.15.3.025
  11. Krantz JH. Tell me, what did you see?: the stimulus on computers. Behav Res Methods Instrum Comput. 2000;32(2):221-9. https://doi.org/10.3758/BF03207787
  12. Kveton P, Jelinek M, Voboril D, Klimusova H. Computer-based tests: the impact of test design and problem of equivalency. Comput Hum Behav. 2007;23(1):32-51. https://doi.org/10.1016/j.chb.2004.03.034
  13. Martilla JA, James JC. Importance-performance analysis. J Mark. 1977;41(1):77-9. https://doi.org/10.1177/002224297704100112
  14. Ki KC, Kim JC. An evaluation of education service through IPA. J Train Dev. 2006;12:37-53.
  15. Sung M, Eom W, Kim YH. An analysis of private university students' educational needs using the importance-performance analysis of learning competencies. CNU J Educ Stud. 2016;37(2):73-96. https://doi.org/10.18612/cnujes.2016.37.2.73
  16. Bae G, Lee SG, Park C, Kim DJ. A tourist survey on East Coast marine attractions using importance performance analysis. Culin Sci Hosp Res. 2020;26(1):159-68. https://doi.org/10.20878/cshr.2020.26.1.016
  17. Duke CR, Persia MA. Performance-importance analysis of escorted tour evaluations. J Travel Tour Mark. 1996;5(3):207-23. https://doi.org/10.1300/J073v05n03_03
  18. Deng W. Using a revised importance-performance analysis approach: the case of Taiwanese hot springs tourism. Tour Manag. 2007;28(5):1274-84. https://doi.org/10.1016/j.tourman.2006.07.010
  19. Matzler K, Sauerwein E, Heischmidt K. Importance-performance analysis revisited: the role of the factor structure of customer satisfaction. Serv Ind J. 2003;23(2):112-29. https://doi.org/10.1080/02642060412331300912
  20. Oh H. Revisiting importance-performance analysis. Tour Manag. 2001;22(6):617-27. https://doi.org/10.1016/S0261-5177(01)00036-X
  21. Breiter D, Milman A. Attendees' needs and service priorities in a large convention center: application of the importance-performance theory. Tour Manag. 2006;27(6):1364-70. https://doi.org/10.1016/j.tourman.2005.09.008
  22. Crompton JL, Duray NA. An investigation of the relative efficacy of four alternative approaches to importance-performance analysis. J Acad Mark Sci. 1985;13(4):69-80. https://doi.org/10.1007/BF02737200
  23. Shin SH, Han SH. A study on importance-satisfaction analysis of exhibit service quality by revised-IPA. J Tour Leis Res. 2018;30(11):517-30. https://doi.org/10.31336/JTLR.2018.11.30.11.517
  24. Yun BR, Park Y. The relationship of nearly white background colors and readability of tablet PC. Sci Emot Sensib. 2014;17(2):35-44. https://doi.org/10.14695/KJSOS.2014.17.2.35

피인용 문헌

  1. Evaluation of Student Satisfaction with Ubiquitous-Based Tests in Women’s Health Nursing Course vol.9, pp.12, 2021, https://doi.org/10.3390/healthcare9121664