Development of the Performance Measurement Model of Electronic Medical Record System - Focused on Balanced Score Card -

균형성과표를 활용한 전자의무기록시스템의 성과측정 모형개발

  • 이경희 (서울의료원) ;
  • 김영훈 (을지대학교 대학원 의료경영학과) ;
  • 부유경 (을지대학교 대학원 의료경영학과)
  • Received : 2016.08.24
  • Accepted : 2016.09.23
  • Published : 2016.12.30

Abstract

The purpose of this study are suggest to performance measurement model of Electronic Medical Record(EMR) and Key Performance Index(KPI). For data collection, 665 questionnaires were distributed to medical record administrators and insurance reviewers at 31 hospitals, and 580 questionnaires were collected(collection rate: 87.2%). Regarding methodology, Critical Success Factor(CSF) and index of the information system were derived based on previous studies, and these were set as performance measurement factors of EMR system. The performance measurement factors were constructed by perspective using BSC, and analysis on causal relationship between factors was conducted. A model of causal relationship was established, and performance measurement model of EMR system was proposed through model validation. Analysis on causal relationship between performance management factors revealed that utility cognition of the learning & growth perspective factor had causal relationship with job efficiency(${\beta}=0.20$) and decision support(${\beta}=0.66$) of the internal process perspective factors, and security had causal relationship with system satisfaction(${\beta}=0.31$) of the customer perspective factor. System quality had causal relationship with job efficiency(${\beta}=0.66$) and decision support(${\beta}=0.76$) of the internal process perspective factors, all of which were statistically significant(P<0.01). Job efficiency of the internal process perspective had causal relationship with system satisfaction(${\beta}=0.43$), and decision support had causal relationship with decision support satisfaction(${\beta}=0.91$) and job satisfaction (${\beta}=0.74$), all of which were statistically significant(P<0.01). System satisfaction of the customer perspective had causal relationship with job satisfaction(${\beta}=0.12$), job satisfaction had causal relationship with cost reduction(${\beta}=0.53$) of the financial perspective, and decision support satisfaction had causal relationship with productivity improvement(${\beta}=0.40$)of the financial perspective(P<0.01). Also, cost reduction of the financial perspective had causal relationship with productivity improvement(${\beta}=0.37$), all which were statistically significant(P<0.05). Suitability index verification of the performance measurement model whose causal relationship was found to be statistically significant revealed that $X^2/df=2.875$, RMR=0.036, GFI=0.831, AGFI=0.810, CFI=0.887, NFI=0.838, IFI=0.888, RMSEA=0.057, PNFI=0.781, and PCFI=0.827, all of which were in suitable levels. In conclusion, the performance measurement indices of EMR system include utility cognition, security, and system quality of the learning & growth perspective, decision support and job efficiency of the internal process perspective, system satisfaction, decision support satisfaction, and job satisfaction of the customer perspective, and productivity improvement and cost reduction of the financial perspective. In this study, it is expected that the performance measurement indices and model of EMR system which are suggested by the author, will be a measurement tool available for system performance measurement of EMR system in medical institutions.

Keywords

References

  1. Kim TS. A Study on Hospital Information Systems Influenced by the Characteristics of Organizations and Information Systems, Daehan Academy of Management Information Systems 2006;19:105-128.
  2. Lee J, Shin T, Lim J. A PLS Path Modeling Approach on the Cause-and-Effect Relationships among BSC Critical Success Factors for IT Organizations. The Korea Society of Management Information Systems 2007;17(4):208-227.
  3. Choi KS. The End-User Toward Explorative /Exploitive Use and End-User Performance in Hospital Information System [dissertation]. Department of Management Information Systems Graduate School of Chosun University 2013.
  4. William H. DeLone and Ephraim R. McLean. The DeLone and McLean Model of Information Systems Success: A Ten-Year Update. In: International Journal of Electronic Commerce 2003;19(4):9-30.
  5. Stacie Petter, William Delone, Ephraim McLean. Measuring information system success: models, dimensions, measures, and interrelationships. European journal of information systems 2008; 17:236-263. https://doi.org/10.1057/ejis.2008.15
  6. Jeffrey S. McCullough, Michelle Casey. The Effect of Health Information Technology on Quality in U.S Hospital. In: Health Affairs 2010;29(4).
  7. Peter A. Salzarulo, Kurt M. Bretthauer. The impact of variablilty and Patient Information on Health Care System Performance. In: Production and operations management 2011;20(6): 848-859. https://doi.org/10.1111/j.1937-5956.2010.01210.x
  8. I-Chiu Chang, Yi-Chang Li. Electonic medical record quality and its impact on user satisfaction-Healthcare provider's point of view. In: Journal of Government Information Quargerly 2012;29:235-242. https://doi.org/10.1016/j.giq.2011.07.006
  9. Carrie Anna McGinn, Sonya Grenier, Julie Duplante, Nicola Show, Claude Sicotte, Luc Mathieu et al. Comparison of user groups' perspectives of barriers and facilitators to implementing electronic health records: a systematic review. In: BMC Medicine 2011;9:46. https://doi.org/10.1186/1741-7015-9-46
  10. Indah Mohd Amin, Surya Sumarni Hussein. Assessing user satisfaction of using hospital information system in malaysia. International Conference on Social Science and Humanity 2011;l(5).
  11. F.Bravi, D.Gibertoni, A. Marcon, C. Sicotte, E. Minvielle, P. Rucci. Hospital network performance: A survey of hospital starkholders' perspectives. In: Journal of Health Policy 2012.
  12. Eiman AI-Jafar. Exploring Patient Satisfaction Before and After Electronic Health Record Implementation: The Kuwait Experience. In: Journal of Health Information Management 2013;1(12).
  13. Xiaodong Deng, William J.Doll, Anthony R. Hendrickson, Joseph A.Scazzero. A multi-group analysis of structural invariance: an illustration using the technology acceptance model. In: Information & Management 2005;42:745-759. https://doi.org/10.1016/j.im.2004.08.001
  14. Vincent S. Lai, Honglei Li. Technology acceptance model for internet banking: an invariance analysis. Information & Management 2005;42:373-386. https://doi.org/10.1016/j.im.2004.01.007
  15. Raafat Saade, Bouchaib Bahli. The impact of cognitive absorption on perceived usefulness and perceived ease of use in on-line learning: an extention of the technology acceptance model. In: Information & Management 2005;42:317-327. https://doi.org/10.1016/j.im.2003.12.013
  16. Mark Thouin, James J. Hoffman. The Effect of Information technology investment on firm-level performance in the health care industry. In: Health Care Management Review 2008;33(1): 60-69. https://doi.org/10.1097/01.HMR.0000304491.03147.06
  17. Girosi, F., Fonkych,K., Bigelow, J. Technical Executive Summary in Support of "Can Electronic Medical Record Systems Transform Healthcare?" and "Promoting Health Information Technology". RAND Health 2005.
  18. Neil S. Fleming. Exploring Financial and Non-Financial Costs and Benefits of Health Informaion Technology. In: The agency healthcare Research and Qualit 2009;9.
  19. Troy R. Mills. Electronic Medical Record Systems in Critical Access Hospitals. Perspectives in Health Information Management 2010.
  20. Pankaj Setia, Monika Setia, Ranjani Krishnan. The Effects of the Assimilation and Use of IT Applications on Financial Performance in Healthcare Organizations 2011;12:274-298.
  21. Steven R. Eastaugh. Health informartion technology Impact on Productivity. J Health Care Finance 2012;39(2):64-81.
  22. Maris Martinsons, Robert Davison, Dennis Tse. The balanced scorecard: a foundation for the strategic mansgement of information systems. In: Decision Support Systems 1999;25:71-88. https://doi.org/10.1016/S0167-9236(98)00086-4
  23. Van Gembergen. Measuring and improving corporate information technology through the balanced scored. In: UFSIA 2000.
  24. Wim Van Grembergen, The Balanced Scored and IT Governance, In: Journal of Past issue 2000;2.
  25. Kathleen E. Voelker, Jonathon S. Rakich, and G. Richard F. The Balanced Scorecard in Healthcare Organizations: A performance Measurement and Strategic Planning Methodology. In: Research and Perspectives on Healthcare 2001;79(3).
  26. William N. Zelman, George H.Pink, and Catherine B.Matthias. Use of the Balanced Scorecard in Health Care. In: Journal of health Care Finance 2003;29(4).
  27. Kim. S. Economic analysis of hospital information system by information economics approach. Seoul: Yonsei University 2010.
  28. Chae. YM, Gwak EA. Management Issues for Hosptal Information Systems in Korea. Healthcare Informatics Research 2005;NOv(4):323-336.
  29. Noh MJ, Kim DY, An Effect of the Innovative Characteristics of the Electronic Medical Record on the Satisfaction, Trust, and Loyalty. Korea Association of Business Eduacation 2012;27(4): 87-109.
  30. Park CS, Lee HW, Go SH. A Case Study on the Hospital Information Systems Usability. Information systems review 2008;10(3):289-311.
  31. Chae. YM, Parkk CB, Kang SH, Kim HS, Kim HH. Performance evaluation of information system for tertiary University Hospital. Healthcare Informatics Research 2011.
  32. Lee KA, Lee JH. A Study on the Value of Web Sites: With a Modified Technology Acceptance Model. Information System Review 2001;3(1).
  33. David F.D. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly 1989;13(3):319-339. https://doi.org/10.2307/249008
  34. Im HJ, Sim JT, Lee SS. The Study on Impact of Introduction Characteristics Factor of EMR System on Perceived Usefulness and Ease of Use and Behavioral Intention to Use. Journal of the Korea industrial information systems society 2009; 14(2).
  35. Lee DH. Analysis and Design of Appropriate Hospital Affair Process on HIS, Korea Knowledge information Technology society 2008;8.
  36. Jack J. Baroudi and Wanda J. Orlikowski. Ashort form measure of user information satisfaction. In: Journal of MIS 1987.
  37. Boonchai Kijsanayotin, Supasit Pannarrunothai, Stuart M. Speedie. Factors influencing health information technology adoption in Thailand's community health centers: Applying the UTAUT model. In: nternational journal of informations, 2008;7(8):404-416.