Journal of the Korean Operations Research and Management Science Society (한국경영과학회지)

The Korean Operations Research and Management Science Society (한국경영과학회)
권호 표지

An Empirical Study on Development of IS Evaluation Indices : In Case of Public Sectors

정보시스템 평가지표 개발에 관한 실증적 연구 : 공공부문을 중심으로

  • Published : 2003.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this research, the comprehensive evaluation model of IS(information systems) for public sectors is theoretically constructed through reviewing and integrating previous IS evaluation-related research. This model is hypothesized to consist of five sectors(System Sector, User Sector, Organization and Management Sector, Resource Management Sector and Strategic Contribution Sector), ten evaluation items belonging to these five evaluation sectors, and sixty two evaluation indices for these ten evaluation items. The results of empirical analyses to test the validity of the research model show that the evaluation sectors turn out to be the same ones as proposed in the hypothetical model. The evaluation items(System Quality, Information Quality, Service Quality) in System Sector proves to be consistent with the hypothetical model. However, in case of User Sector, two evaluation items(Perceived Usefulness and User Satisfaction) which are included in the hypothetical model are found to be merged into one item(User Satisfaction). And, it is shown that four evaluation items such as the Efficiency of Internal Process, Customer Satisfaction, Organizational Innovation, and the Degree of Informatization competence improvement are included in Organization and Management Sector, differently from the research model in which the items, Organizational innovation and the Degree of Informatization competence improvement, are not divided. As a final result, sixty two evaluation indices that comprise all the evaluation items belonging to five sectors are found to be reduced to fifty seven ones through factor analyses, criterion-related validity tests and reliability analyses.

Keywords

References

  1. 경영과학의 응용 v.2 MIS 성과에 대한 평가모형 김상훈;이진주
  2. 법영사 정보시스템 진단과 감리 김현수
  3. 한국과학기술원 테크노경영대학원,박사학위논문 MIS 평가의 계층적 접근방법 정문상
  4. 사회과학조사방법론(2판) 채서일
  5. 정보화사업평가편람 한국전산원
  6. 정보화사업 평가방법론 연구 한국전산원
  7. 공공부문 정보화사업 평가를 위한 BSC 모형 한국전산원
  8. Information & management v.24 no.1 A comparative evaluation of the impact of eletronic and voice mail on organizational communication Adams,D.A.;P.A.Todd;R.R.Nelson
  9. MIS Quarterly v.24 no.4 Time Files When You're Having Fun : Cognitive Absorption and Beliefs about Information Technology Usage Agarwel,R.;E.Karahanna
  10. Planning and Control Systems : A Framework for Analysis Anthony,R.N.
  11. Management Science v.29 no.1 Development of A Tool for Measuring and Analyzing Computer User Satisfaction Baily,J.E.;S.W.Pearson
  12. Journal of MIS v.4 no.4 A Short-Form Measure of User Information Satisfation : A Psychometric Evaluation and Notes on Use Baroudi,J.J.;W.J.Orlikowski
  13. Management Science v.24 no.9 The Process and Product of System Design Boland,R.J.
  14. Communications of the ACM v.20 no.3 Cost/Unilization : A Measure of System Performance Borovits,I.;P.Ein-Dor
  15. Computer Systems Performance Evaluation Borovits,I.;S.Neumann
  16. Communications of the ACM v.36 no.12 The Productivity Paradox of Information Brynjolfsson,E.
  17. Information Systems Research v.8 no.2 Business Stategy Orientation, Information Systems Strategic Orientation, and Strategic Alignment Chan,Yolande,E.;S.L.Huff;D.W.Barclay;D,C,Copeland
  18. Strategy and Structure Chandler,A.
  19. MIS Quarterly v.6 no.1 A Multiple Criteria Approach for Evaluating Information Systems Chandler,J.S.
  20. MIS Quarterly v.13 no.3 Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology Davis,F.D.
  21. Information Systems Research v.3 no.1 Information Systems Success : The Quest for the Dependent Variable DeLone,W.H.;E.R.McLean
  22. System Sciences, 2002. HICSS. Proceedings of the 35th Annual Hawaii International Conference on Information systems success revisited DeLone,W.H.;E.R.McLean
  23. Journal of Management Information Systems v.19 no.4 The DeLone and McLean Model of Information Systems Success : A TEn-Year Update DeLone,W.H.;E.R.McLean
  24. Information Systems Research v.6 no.2 A Comfirmatory Factor Analysis of the User Information Satisfaction Instrument Doll,W.J.;T.S.Raghunathan;J.S.Lim;Y.P.Gupta
  25. MIS Quarterly v.12 no.2 The Measurement of End-User Computing Satisfation Doll,W.C.;G.Torkzadeh
  26. Information Systems Research v.14 no.2 Creating A Balanced IS Measurement Program Edberg,Dana.T.
  27. Information Technology Evaluation Methods and Management Integrating the Balanced Scorecard and Software Measurement Frameworks Eickelmann,N.
  28. Decision Sciences v.17 no.3 Organizational Context, User Involvement, and The Usefulness of Information Systems Franz,C.R.;D.Robey
  29. TIMS Studies in Management Science v.13 no.4 A Study of the Implementation Process Ginzberg,M.
  30. Information Technology Evaluation Methods and Management Information Technology Governance through the Balanced Scorecard Grembergen,W.V.;Snall;Ronald
  31. MIS Quarterly v.5 no.3 Evaluating Information System Effectiveness. Part I. Comparing Evaluation Approaches Hamilton,S.;N.L.Chervany
  32. MIS Quarterly v.5 no.4 Evaluating Information system Effectiveness. Part II. Comparing Evaluator Viewpoints HAmilton,S.;N.L.Chervany
  33. MIS Quarterly Productivity, Business Profitability, and Consumer Surplus : Three Measures of Information Technology Value Hitt,Lorin;Brynjolfsson,Erik
  34. Journal of Systems Management EDP Effectiveness Evaluation Hurtado,C.D.
  35. Information & Management v.40 no.1 Information Systems Evaluation : Navigating Through the Problem Domain Irani,Zahir
  36. Communications of the ACM v.26 no.10 The Measurement of User Information Satisfaction Ives,B.M.H.Olson;J.J.Baroudi
  37. Working Paper, Dept. of Operations and Systems Management, Indiana University Development of an Instrument to Measure User Satisfaction with Management Information Systems Jenkins,A.M.;J.A.Ricketts
  38. MIS Quarterly v.26 no.2 Measuring Information System Service Quality : SERVQUAL from the Other Side Jianh,J.J.;G.Klein;C.L.Carr
  39. Harvard Business Review Balanced Scorecard : Measures That Drive Performance Kaplan,R.S.;D.P.Norton
  40. Translating Strategy into Action - Te Balanced Scorecard Kaplan,R.S.;D.P.Norton
  41. IBM Systems Journal v.2 no.1 Information technology and the management difference : A fusion map Keen,P.G.W.
  42. Decision Sciences v.25 no.5-6 Perceived Service Quality and User Satisfaction with the Information Services Function Kettinger,W.J.;C.C.Lee
  43. Proceedings of Decision Sciences Institute Global Measures of Information Services Quality : A Cross-National Study of Hong Kong, Korea, the Netherlands and the U.S.A Kettinger,W.J.;C.C.Lee;S.Lee
  44. MIS Quarterly v.21 no.2 Pragmatic Perspectives on the Measurement of Information Systems Service Quality Kettinger,W.J.;C.C.Lee
  45. MIS Quarterly v.2 no.3 Evaluating Management Information Systems King,W.R.;J.R.Rodriguez
  46. Computing Surveys v.10 no.1 Cost-Benefit Analysis in Information Systems Development and Operation King,J.L.;E.L.Schrems
  47. Information and Management v.11 no.2 An Exploratory Contingency Model of User Participation and MIS Use Eunhong,Kim;Lee,Jinjoo
  48. Decision Science Perceived Usefulness and Information : A Psychometric Examination Larker,Davis F.;V.Parker Lessig
  49. Journal of MIS v.13 no.1 Key Prescriptions for strategic Information Systems Planning Lederer,Albert L.;Sethi,Vijay
  50. Data Base v.4 no.1 Performance Evaluation and the Management of Information Services Lucas,H.C.,Jr.
  51. MIS Quarterly v.2 no.2 Empirical Evidence for a Descriptive Model of Implementation Lucas,H.C.,Jr.
  52. Journal of MIS v.16 no.4 Impacts of Information Technology Investment on Organizational Performance Mahwood,M.A.;G.J.Mann
  53. MIS Quarterly v.3 no.1 A User Behavior Toward his MIS Maish,A.M.
  54. Information & Management v.1 no.5 Measuring Information Output : A Communication Systems Approach Mason,Richard O.
  55. Information Technology Evaluation Methods and Management Using a Balanced Scorecard Framework to Leverage the Value Delivered by IS Meyerson,Bram
  56. Information Resource Management Journal v.10 no.1 A Comprehensive Model for Assessing the Quality and Productivity of the Information Systems Function : Toward a Theory for Information Systems Assessment Myers,B.L.;L.A.Kappelman;V.R.Prybutok
  57. Communications of the ACM The Impactof Office Automation on the Organization : Some Implications for Research and Practice Olson,M.H.;H.C.Lucas
  58. Journal of Marketing v.49 no.4 A Conceptural Model of Service Quality and its Implications for Future Research Parasuraman,A.;V.A.Zeithaml;L.L.Berry
  59. Jorunal of Retailing v.64 no.1 SERVQUAL : A Multiple-Item Scale for Measuring Cnsumer Perceptions of Service Quality Parasuraman,A.;V.A.Zeithaml;L.L.Berry
  60. Translating Performance Metrics from the Private to the Public Sector Paul Arveson
  61. MIS Quarterly v.19 no.2 Service Quality : A Measure of Information Systems Effectiveness Pitt,L.F.;R.T.Watson;C.B.Kavan
  62. MIS Quarterly v.21 no.2 Measuring Information Systems Service Quality : Concerns for a Complete Canvas Pitt,L.F.;R.T.Watson;C.B.Kavan
  63. Competitive Strategy Porter,M,E,
  64. MIS Quarterly v.20 no.1 Measuring the Linkage Between Business and Information Technology Objectives Reich,Blaise H.;Benbasat,Izak
  65. Journal of Management Information Systems v.12 no.2 The Keys to Executive Information Systems Success Rainer,R.K.;H.J.Watson
  66. Sloan Management Review Develop Long-Trem Competitiveness Through IT Assets Ross,Jeanne W.;Beath;Mathis;Cynthia;Goodhue,L.Dale
  67. European Journal of Marketing v.27 no.1 Integration and Effectiveness of Marketing Information Systems Saaksjarve,M.V.T.;J.M.Talvinen
  68. Journal of MIS v.8 no.4 Measuring Performance of the Information Systems Function Saunders,C.S.;J.W.Jones
  69. Information Systems Research v.8 no.3 A Respecification and Extension of the DeLone and McLean Model of IS Success Seddon,P.B.
  70. Management Science v.40 no.12 Development of Measures to Assess the Extent to which an Information Technology Application Provides Competitive Advantage Sethi,Vijay;W.R.King
  71. Warren The Mathematical Theory of Communication Shannon,Claude E.;Weaver
  72. MIS Quarterly v.12 no.2 Measuring Information Systems Performance : Experience with the Management by Results System at Security Pacific Bank Singleton,C.E.;E.R.McLean;E.R.Altman
  73. Journal of Management Information Systems v.16 no.4 A Framework for Assessing the Relationship Between Information Technology Investments nad Firm Performance Sircar,S.;Turnbow,L.Joe;B.Bordoloi
  74. A Discussion Paper on Measurement Practices IT Performance Measurement Steyaert.J.
  75. The Business Value of Computers Strassmann,Paul A
  76. Journal of Systems Management v.30 no.6 Performance Appraisal-Part 1 Sutton,R.H.R.L.Mathis
  77. Management Science v.21 no.1 Management Information Systems : Appreciation and Involvement Swanson,E.B.
  78. Information Systems Research v.7 no.2 Top Management Support, External Expertise nad Information Systems Implementation in Small Businesses Thong,James Y.L.;Yap,Chee-Sing;K.S.Raman
  79. Up and Running : Integrating Information Technology and The Organization Walton,R.
  80. MIS Quarterly v.22 no.1 Measuring Information Systems Service Quality : Lessons From Two Longitudinal Case Studies Watson,R.T.;L.F.Pitt;C.B.Kavan
  81. Strategic Information Systems Wiseman,C.