Design of DEA/(AR-I, ARGM) Models and Sensitivity Analysis for Performance Evaluation on Governmental Funding Projects for IT Small and Medium-sized Enterprises

IT중소기업 정부자금 지원정책 성과 평가를 위한 DEA/(AR-I, ARGM) 모형 설계 및 민감도 분석

  • Park, Sungmin (Dept. of Business Administration, Baekseok University) ;
  • Kim, Heon (Dept. of Business Administration, Baekseok University) ;
  • Baek, Donghyun (Dept. of Business Administration, Hanyang University)
  • 박성민 (백석대학교 경상학부) ;
  • 김헌 (백석대학교 경상학부) ;
  • 백동현 (한양대학교 경상대학 경영학부)
  • Published : 2008.06.30

Abstract

Recently, it has been strongly required to establish a systematic and sustainable performance investigation and evaluation framework on governmental funding projects for IT small and medium-sized enterprises. In this paper, Data Envelopment Analysis (DEA) models are adopted for performance evaluation on governmental funding projects for IT small and medium-sized enterprises. A new data structure is proposed for the DEA performance evaluation. Generally, in using DEA models, DEA multipliers restriction is critical to achieve the reliability of DEA optimal solutions. Based on the outputs and inputs considered in this study, Acceptance Region (AR) constraints are generated and incorporated into the DEA models so as to improve the reliability of DEA efficiency scores. Associated with AR Type I (AR-I), AR Global Model (ARGM) constraints, DEA/ (AR-I, ARGM) models are designed and then sensitivity analysis follows investigating the robustness of DEA efficiency scores relating to AR constraints adjustment. Finally, a performance evaluation is illustrated regarding governmental direct funding projects from Ministry of Information and Communication (MIC) in Korea where each project unit (i.e. Decision Making Unit (DMU)) is determined whether it is efficient or not. By using DEA/(AR-I, ARGM) models designed in this paper, robustly efficient DMUs are gradually identified according to the successive AR constraints adjustment. Among 25 DMUs, results show that 6 DMUs such as B, E, G, Q, S, Y are determined as robustly efficient against AR constraints intermediate adjustment.

Keywords

References

  1. Allen, R., Athanassopoulos, A., Dyson, R. G. and Thanassoulis, E. (1997),Weights Restrictions and Value Judgements in Data Envelopment Analysis, Annals of Operations Research, 73, 13-34 https://doi.org/10.1023/A:1018968909638
  2. Bae, Y., Kim, J. and Kim, S. (2006), Assessment of Ammunition Companies Using the IDEA Model, IE Interfaces, 19(4), 291-299
  3. Banker, R. D., Bardhan, I. and Cooper, W. W. (1996), A Note on Returns to Scale in DEA, European Journal of Operational Research, 88(3), 583-585 https://doi.org/10.1016/0377-2217(94)00281-9
  4. Banker, R. D., Charnes, A. and Cooper,W.W. (1984), Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis, Management Science, 30(9), 1078-1092 https://doi.org/10.1287/mnsc.30.9.1078
  5. Banker, R. D., Conrad, R. F. and Strauss, R. P. (1986), A Comparative Application of Data Envelopment Analysis and Translog Methods: An Illustrative Study of Hospital Production, Management Science, 32(1), 30-44 https://doi.org/10.1287/mnsc.32.1.30
  6. Bessent, A., Bessent, W., Kennington, J. and Reagan, B. (1982), An Application of Mathematical Programming to Assess Productivity in the Houston Independent School District, Management Science, 28(12), 1355-1367 https://doi.org/10.1287/mnsc.28.12.1355
  7. Callen, J. L. (1991), Data Envelopment Analysis: Partial Survey and Applications for Management Accounting, Journal of Management Accounting Research, 3(Fall), 35-56
  8. Charnes, A. and Cooper, W. W. (1980), Auditing and Accounting for Program Efficiency and Management Efficiency in Not-for-profit Entities, Accounting, Organizations and Society, 5(1), 87-107 https://doi.org/10.1016/0361-3682(80)90025-2
  9. Charnes, A., Cooper, W. W., Huang, Z. M. and Sun, D. B.(1990), Polyhedral Cone-ratio DEA Models With an Illustrative Application to Large Commercial Banks, Journal of Econometrics, 46(1-2), 73-91 https://doi.org/10.1016/0304-4076(90)90048-X
  10. Charnes, A., Cooper, W. W. and Rhodes, E. (1978), Measuring the Efficiency of Decision Making Units, European Journal of Operational Research, 2(6), 429-444 https://doi.org/10.1016/0377-2217(78)90138-8
  11. Charnes, A., Cooper,W.W. and Rhodes, E. (1981), Evaluating Program and Managerial Efficiency: An Application of Data Envelopment Analysis to Program Follow Through, Management Science, 27(6), 668-697 https://doi.org/10.1287/mnsc.27.6.668
  12. Cooper,W.W., Seiford, L.M. and Tone, K. (2007), Data Envelopment Analysis: A Comprehensive Text With Models, Applications, References and DEA-Solver Software, 2nd ed., New York: Springer
  13. Cooper, W. W., Seiford, L. M. and Zhu, J. (2004), Handbook on Data Envelopment Analysis, Boston : Springer (Kluwer Academic Publishers)
  14. Frontline Systems, Inc. (2007), Premium Solver Platform Version 7.1 for Microsoft Excel, http://www.solver.com/Default.htm, U. S. A
  15. Gi, Y., Mun, T. and Sohn, S. (2004), Efficiency Analysis on Loan Projects for Information Literacy Promotion Using DEA and Logistic Regression Analysis, Technology Innovation Study, 12(1), 25-48
  16. Gregoriou, G. N. and Zhu, J. (2005), Evaluating Hedge Fund and CTA Performance, New Jersey: John Wiley & Sons
  17. Hwang, S. (2006), STEPI Policy Study 2006-12, Methodology of Economic Assessment for Classified R&D Programs, Science & Technology Policy Institute(STEPI), Korea
  18. Hwang, Y. and Hwang, S. (2005), STEPI Policy Study 2004-20, An Assessment of the Performance Evaluation System for Government R&D, Science & Technology Policy Institute(STEPI), Korea
  19. Kim, G. (2006), Information Literacy of Regional Government Administration with DEA, Korea Academy Information, Inc., Korea
  20. Kim, S. (2006), Introduction to Management Science, Younggimunhwasa, Korea
  21. Kim, J. and Kim, S. (2007), A Real Estate Price AppraisalModel Based on the Data Envelopment Analysis-Assurance Region(DEA-AR), Housing Studies Review, 15(1), 29-61
  22. Korea National Statistical Office(KNSO)(2007), Korean Statistical Information Service(KOSIS) National Statistics Portal, http://www.kosis.kr/, KNSO, Korea
  23. Lee, D. and Yang,W. (2004), Performance Evaluations of Professional Baseball Players Using DEA/OERA, IE Interfaces, 17(4), 440-449
  24. Ministry of Information and Communication(MIC)(2006)1, 2006 Annual State Report of Small and Medium-sized Enterprises Funding Projects of MIC, MIC, Korea
  25. Ministry of Information and Communication(MIC)(2006)2, Final Revision on IT SMERP 2010 Plan for Promoting a Sound Ecosystem of IT Small and Medium-sized Enterprises and Venture Business, MIC, Korea
  26. Ministry of Information and Communication(MIC)(2006)3, IT839 Strategy, http://www.mic.go.kr/, MIC, Korea
  27. Ministry of Information and Communication(MIC) Institute for Information Technology Advancement(IITA)(2006)1, Performance Analysis on Information and Communication Promotion Fund (Technology Development Investment Projects), MIC IITA, Korea
  28. Ministry of Information and Communication(MIC) Institute for Information Technology Advancement(IITA)(2006)2, Performance Analysis on Information and Communication Promotion Fund (VIII)(Technology Development Investment Projects), SI Media, Inc., Korea
  29. Ministry of Information and Communication(MIC) Institute for Information Technology Advancement(IITA)(2007)1, A Guideline for Performance Evaluation on Information and Communication Promotion Fund Projects in 2006, Advisory Committee of Information and Communication Promotion Fund, Korea
  30. Ministry of Information and Communication(MIC) Institute for Information Technology Advancement(IITA)(2007)2, Performance Analysis on Information and Communication Promotion Fund(IT Small and Medium-sized Enterprises Technology Development Projects), MIC IITA, Korea
  31. Park, K., Kim, Y. and Jung, H.(2005), Assessing Hospital Efficiency and Profit Dynamics Using DEA and DEA Window Analysis, Korean Management Review, 34(1), 267-287
  32. Parks, R. B. (1983), Technical Efficiency of Public Decision Making Units, Policy Studies Journal, 12(2), 337-346 https://doi.org/10.1111/j.1541-0072.1983.tb00275.x
  33. Pedraja-Chaparro, F., Salinas-Jimenez, J. and Smith, P.(1997), On the Role ofWeight Restrictions in Data Envelopment Analysis, Journal of Productivity Analysis, 8, 215-230 https://doi.org/10.1023/A:1007715912664
  34. Rhim, H., Yoo, S. and Kim, Y. (1999), A DEA/AHP Hybrid Model for Evaluation & Selection of R&D Projects, Journal of the Korean Operations Research and Management Science Society, 24(4), 1-12
  35. Roll, Y., Cook,W. D. and Golany, B. (1991), Controlling FactorWeights in Data Envelopment Analysis, IIE Transactions, 23(1), 2-9 https://doi.org/10.1080/07408179108963835
  36. Roll, Y. and Golany, B. (1993), Alternate Methods of Treating Factor Weights in DEA, Omega, The International Journal of Management Science, 21(1), 99-109
  37. Science, Technology, Information and Communication Committee (STICC)(2006), Investigation Report on the Management Plan for 2007 Information and Communication Promotion Fund, STICC, Korea
  38. Seiford, L. M. and Thrall, R. M. (1990), Recent Development in DEA: The Mathematical Programming Approach to Frontier Analysis, Journal of Econometrics, 46(1-2), 7-38 https://doi.org/10.1016/0304-4076(90)90045-U
  39. Sherman, H. D. and Gold, F. (1985), Bank Branch Operating Efficiency : Evaluation With Data Envelopment Analysis, Journal of Banking and Finance, 9(2), 297-315 https://doi.org/10.1016/0378-4266(85)90025-1
  40. Sohn, S. and Joo, Y. (2004), Data Envelopment Analysis and Logistic Model for BRAIN KOREA 21, IE Interfaces, 17(3), 249-260
  41. Thompson, R. G., Langemeier, L. N., Lee, C. T., Lee, E. and Thrall, R. M. (1990), The Role of Multiplier Bounds in Efficiency Analysis With Application to Kansas Farming, Journal of Econometrics, 46(1-2), 93-108 https://doi.org/10.1016/0304-4076(90)90049-Y
  42. Winston, W. L. (2004), Operations Research : Applications and Algorithms, 4th ed., Belmont California : Thomson Brooks/Cole
  43. Wong, Y-H. B. and Beasley, E. (1990), RestrictingWeight Flexibility in Data Envelopment Analysis, Journal of Operational Research Society, 41(9), 829-835 https://doi.org/10.2307/2583498
  44. Zhu, J. (2003), Quantitative Models for Performance Evaluation and Benchmarking : Data Envelopment Analysis With Spreadsheets and DEA Excel Solver, Boston : Springer(Kluwer Academic Publishers)