Journal of Korean Society of Industrial and Systems Engineering (산업경영시스템학회지)

Society of Korea Industrial and System Engineering (한국산업경영시스템학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on the Importance of Non-face-to-face Lecture Properties and Performance Satisfaction Analysis AHP and IPA: Focusing on Comparative Analysis of Professors and Students

AHP와 IPA를 활용한 비대면 강의 속성의 중요도와 실행만족도 분석 연구 : 교수자, 학습자 비교분석을 중심으로

  • 김민경 (한양대학교 일반대학원 경영학과) ;
  • 이태원 (한양대학교 경영대학) ;
  • 김선영 (국립목포대학교 영어교육과)
  • Received : 2021.08.09
  • Accepted : 2021.09.13
  • Published : 2021.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Non-face-to-face lectures have become a necessity rather than an option since COVID-19, and in order to improve the quality of university education, it is necessary to explore the properties of non-face-to-face lectures and make active efforts to improve them. This study, focusing on this, aims to provide basic data necessary for decision-making for non-face-to-face lecture design by analyzing the relative importance and execution satisfaction of non-face-to-face lecture attributes for professors and students. Based on previous research, a questionnaire was constructed by deriving 4 factors from 1st layer and 17 from 2nd layer attributes of non-face-to-face lectures. A total of 180 valid samples were used for analysis, including 60 professors and 120 students. The importance of the non-face-to-face lecture properties was calculated by obtaining the weights for each stratified element through AHP(Analytic Hierachy Process) analysis, and performance satisfaction was calculated through statistical analysis based on the Likert 5-point scale. As a result of the AHP analysis, both the professor group and the student group had the same priority for the first tier factors, but there was a difference in the priorities between the second tier factors, so it seems necessary to discuss this. As a result of the IPA(Importance Performance Analysis) analysis, the professor group selected the level of interaction as an area to focus on, and it was confirmed that research and investment in teaching methods for smooth interaction are necessary. The student group was able to confirm that it is urgent to improve and invest in the current situation so that the system can be operated stably by selecting the system stability. This study uses AHP analysis for professors and students groups to derive relative importance and priority, and calculates the IPA matrix using IPA analysis to establish the basis for decision-making on future face-to-face and non-face-to-face lecture design and revision. It is meaningful that it was presented.

Keywords

References

  1. Al-Fraihat, D., Joy, M., and Sinclair, J., "A comprehensive model for evaluating e-learning systems success", Distance Learning, 2018, Vol. 15, No. pp. 57.
  2. Bojovic, Z., Bojovic, P.D., Vujosevic, D., and Suh, J., Education in times of crisis: Rapid transition to distance learning, Computer Applications in Engineering Education, 2020, Vol. 28, No. 6, pp. 1-23. https://doi.org/10.1002/cae.22194
  3. Chung, H.J. and Kim, K.W., An AHP Analysis of University Students' Criteria for Registration in Foreign Language Courses, The Journal of Learner-Centered Curriculum and Instruction, 2016, Vol. 16, No. 8, pp. 723-745.
  4. DeLone, W.H. and McLean, E.R., TheDeLone and McLean Model of InformationSystems Success: A Ten-year Update, Journal of Management Information Systems, Vol. 19, No. 4, 2003, pp. 9-30. https://doi.org/10.1080/07421222.2003.11045748
  5. Do, J.W., An Investigation of Design Constraints in the Process of Converting Face-to-face course into Online Course, Journal of Education & Culture (JOEC), 2020, Vol. 26, No. 2, pp. 153-173. https://doi.org/10.24159/JOEC.2020.26.2.153
  6. Eom, M.R., A Survey On Competencies Of E-Learning Instructional Designers Using An Importance-Performance Analysis(IPA), Journal of Human Resource Management Research, 2008, Vol. 15, No. 3, pp. 89-107.
  7. Eom, M.R., Lee, H.J., Choi, K.U., Jeon, M.H., and Hyun, M.Y., Exploring the Ways to Support Online Class Operations through Analysis of the Perceptions of Instructors and Students, Korean Council for University Education, 2020, Vol. 3, No. 2, pp. 1-26.
  8. Eringfeld, Simone, Higher education and its post-coronial future: utopian hopes and dystopian fears at Cambridge University during Covid-19, Studies in Higher Education Oxford, 2021, Vol. 46, No. 1, pp. 146-157. https://doi.org/10.1080/03075079.2020.1859681
  9. Forman, E.H. and M.A. Selly, Decision by Objectives: How to Convince Others That You Are Right, World Scientific, 2001.
  10. Fox, R., MOOC Impact beyond Innovation, In Reforming Learning and Teaching in Asia-Pacific Universities, edited by Ng, C. C., R. Fox, and M. Nakano, [Singapore] Springer, 2016, pp. 159-172.
  11. Han, Y.J. and Han, C.H., The Performance Evaluation of Universitiesusing DEA and AHP Model, Journal of Society of Korea Industrial and Systems Engineering, 2014, Vol. 37, No. 3, pp. 51-63. https://doi.org/10.11627/jkise.2014.37.3.51
  12. Hwang, Y.H. and Kim, C.S., Perceptions toward Non-faceto-face Online Class Operations during the COVID-19 Pandemic: Focusing on University Students' Satisfaction and Anxiety, The Linguistic Association of Korea, 2021, Vol. 29, No. 1, pp. 71-91.
  13. Isaac, O., Aldholay, A., Abdullah, Z., and Ramayah, T. Online learning usage within Yemeni higher education: The role of compatibility and task-technology fit as mediating variables in the IS success model, Computers & Education, 2019, Vol. 136, pp. 113-129. https://doi.org/10.1016/j.compedu.2019.02.012
  14. Issues related to distance learning in universities and tasks for improvement, National Assembly Research Service, 2020.
  15. Joo, Y.J., Cho, H.K., and Jo, I.H., Test development and verifying the validity andreliability for measuring a effectiveness of e-learning course in a Korean company, Journal of Corporate Education and Talent Research, 2008, No. 10, Vol. 2, pp. 1-20.
  16. Jung, H.R and Woo, Y.H., Perceptions of Distance University Learners' Satisfaction on Online Lecture Content by Age Group, The Journal of the Korea Contents Association, 2020, Vol. 20, No. 7, pp. 429-437. https://doi.org/10.5392/JKCA.2020.20.07.429
  17. Jung, J.S. and Horta, H., and Postiglione, G. A., Living in uncertainty: the COVID-19 pandemic and higher education in Hong Kong, Studies in Higher Education Oxford, 2021, Vol. 46, No. 1, pp. 107-120. https://doi.org/10.1080/03075079.2020.1859685
  18. Jung, J.Y., A Study on the Method for Quality Management of Higher Education in the Post Corona, Institute for Educational Research, 2020, Vol. 33, No. 3, pp. 171-192. https://doi.org/10.35283/erft.2020.33.3.171
  19. Jung, Y.J., Kang, H.E., Park, S.H., A Study on Critical Factor Analysis of Selection Attributes of Overseas Direct Purchase Using AHP and IPA, Korean Business Education Review, 2019, Vol. 34, No. 3, pp. 233-253. https://doi.org/10.23839/kabe.2019.34.3.233
  20. Jung, Y.S. and Seo, J.H., The direction of distance education in the non-face-to-face era, Keris Issue Report, 2020.
  21. Kim, B.Y. and Han, S.W., A Study on Satisfaction with Involuntary University Online Lecture by Corona 19, Da Vinci Mirae Institute of General Education, 2020, Vol. No. 13, pp. 7-31.
  22. Kim, H.R. and Oh, H.J., Exploring Ways to Improve Real-Time Online Chinese Classes: Focusing on the IPA Method, Chinese Language Education and Research, 2021, Vol. 34, pp. 73-91. https://doi.org/10.24285/CLER.2021.7.34.73
  23. Kim, J.W., Park, Y.S., Kim, K.Y., Yang, K.S., An analysis of College Professors' and Students' Perceptions and Experiences of online classes under the COVID-19 situation, Sungshin Women's University Educational Research Institute, 2021, Vol. 80, pp. 33-58.
  24. Kim, S.M., Analysis of Press Articles in Korean Media on Online Education related to COVID-19, Journal of Digital Contents Society, 2020, Vol. 21, No. 6, pp. 1091-1100. https://doi.org/10.9728/dcs.2020.21.6.1091
  25. Kim, Y.D., Lee, J.A., and Oh, M.J., A Study on Relative Importance of Project team members Competencies Using AHP, Korea Industrial and Systems Engineering, 2020, Vol. 43, No. 3, pp. 216-227. https://doi.org/10.11627/jkise.2020.43.3.216
  26. Kim, Y.S., Research on the Importance and Satisfaction of Restaurants using IPA : Focusing on 5-Star Hotels in Seoul Area, The Journal of the Korea Contents Association, 2021, Vol. 21, No. 6, pp. 505-512. https://doi.org/10.5392/JKCA.2021.21.06.505
  27. Kong, D.Y., Coorientational Analysis among Distance Learning Systems Users- Instructors, Leaners and IT practitioners, Korea University, 2021.
  28. Korean Association of Private University Presidents, 2021, http://kapup.org/sub/sub03_02.php?boardid=edu2&mode=view&idx=117&sk=&sw=&offset=&category=%ED%95%99%EC%83%9D&goPage=.
  29. Korean Association of University Professors, 2020, http://www.dhnews.co.kr/news/articleView.html?idxno=119450.
  30. Lee, J.H. and Yun, H.L., Needs Analysis for Activating Overseas Korean Language Education Using IPA- Target on Higher Education Institutions in New Southern & New Northern Areas, Journal of Korean Language Education, 2021, Vol. 32, No. 1, pp. 177-207. https://doi.org/10.18209/IAKLE.2021.32.1.177
  31. Lee, K.N., An Analysis of the Relative Priority of Intellectual Property e-learning Contents Using the Analytic Hierarchy Process(AHP), The Journal of Intellectual Property, 2016, Vol. 11, No. 1, pp. 227-253. https://doi.org/10.34122/jip.2016.03.11.1.227
  32. Lee, S.K., Lee, H.R., and Yu, J.H., The Effect of PMIS Quality on Project Management Success, Korea Institute of Building Construction, 2010, Vol. 10, No. 6, pp. 117-126. https://doi.org/10.5345/JKIC.2010.12.6.117
  33. Lee, S.Y. and Park, S.W., The Business Model with Open Market System for Invigorating e-Learning, The Journal of the Korea Contents Association, 2011, Vol. 11, No. 1, pp. 302-316. https://doi.org/10.5392/JKCA.2011.11.1.302
  34. Lee, Y.H., Park, Y.J. and Yun, J.H., Exploring the "Types" through Case Analysis on Operation of Distance Education in Universities Responding to COVID-19, The Korea Association of Yeolin Education, 2020, Vol. 28, No. 3, pp. 211-234. https://doi.org/10.18230/tjye.2020.28.3.211
  35. Leem, J.H., Kim, M.H., and Lee, S.H., Development of an Online Instructional Design Model for Higher Education in the era with COVID-19, Korea Association for Educational Information and Media, 2021, Vol. 27, No. 1, pp. 281-311. https://doi.org/10.15833/KAFEIAM.27.1.281
  36. Lee-Pos, A., e-Learning Success Model: AnInformation Systems Perspective, Electronic Journal of e- Learning, 2009, Vol. 7, No. 1, pp. 61-70.
  37. Martilla, J.A. and James, J.C., Important-Performance Analysis, Journal of Marketing, 1997, Vol. 41, No. 1, pp. 13-17.
  38. Noh, S.D., Psychological Impact and Overcoming Factors of College Students Due to the COVID-19 Incident, The Korean Society for Practical Theology, 2020, Vol. 72, pp. 331-356.
  39. Park, S.H., Lee, T.W., Kim, S.C., Investigating the Impacts of the Quality of Project Management Information System on Project Performance and User Satisfaction, Korea Industrial and Systems Engineering, 2018, Vol. 41, No. 3, pp. 50-60. https://doi.org/10.11627/jkise.2018.41.3.050
  40. Saaty, T., An Eigenvalue Allocation Model for Prioritization and Planning. Energy management and Policy Center: University of Pennsylvania, 1972.
  41. Seo, C.G. and Lee, S.Y., An Empirical Study on the Factors Affecting e-Learning Learners Satisfaction, The Korea Association Of Information Systems(Kais), 2009, Vol. 18, No. 3, pp. 1-25.
  42. Seo, C.G., Study on the Instructors' Factors Affecting Student Performance Under e-Learning Environment, The Society of Digital Policy & Management, 2013, Vol. 11, No. 8, pp. 341-347.
  43. Seo, C.G., Study on the e-Learning Quality Evaluation Using AHP, The Journal of Internet Electronic Commerce Resarch, 2015, pp. 337-347
  44. Shin, S.H. and Shim, J.H., Developing a teaching assessment tool for smart-learning based corporational education, Journal of Corporate Education and Talent Research, 2018, Vol. 20, pp. 59-82. https://doi.org/10.46260/KSLP.20.1.3
  45. Siegle, D., The changing nature of universities: Going online, Gifted ChildToday, 2011, Vol. 34, No. 3, pp. 56-61. https://doi.org/10.1177/107621751103400313
  46. Song, C.J., A Study on the Teaching and Learning Activities, Student-teacher Communication, and Course Satisfaction, Asian Journal of Education, 2014, Vol. 15, No. 2, pp. 171-200. https://doi.org/10.15753/aje.2014.15.2.007
  47. Song, H.D. and Lee, Y.C., Exploring Factors and Indicators for Measuring Quality of Non-Contact University Lectures, Global Creative Leader: Education & Learning, 2020, Vol. 10, No. 4, pp. 245-273. https://doi.org/10.34226/GCL.2020.10.4.245
  48. Song, S.Y. and Kim, H.K., Exploring Factors Influencing College Students' Satisfaction and Persistent Intention to Take Non-Face-to-Face Courses during the COVID-19 Pandemic, Education Research Institute, 2020, Vol. 21, No. 4, pp. 1099-1126.
  49. Yang, G.S. and Park, M.H., Analysis of weighted lecture evaluation results, Gatholic University Research Report, 2012.
  50. Yang, J.Y. and Moon, S.J., A Study on the Structural Relationship between the Quality of University On-line Class and Lecture Satisfaction Due to COVID-19: Focusing on the Moderating Effect of Communication, Tourism Management Research Organization, 2021, Vol. 25, No. 2, pp. 305-330. https://doi.org/10.18604/tmro.2021.25.2.15