Journal of the Korean Operations Research and Management Science Society (한국경영과학회지)

The Korean Operations Research and Management Science Society (한국경영과학회)
권호 표지
DOI QR코드

DOI QR Code

Feedback Order and Problem-Solving Experience in Competitive Problem-Solving : An Empirical Analysis of Online Innovation Contests

경쟁적 문제 해결 과정에서 피드백 순서와 문제 해결 경험 : 온라인 혁신 경진 대회의 실증 분석

  • Received : 2012.11.25
  • Accepted : 2013.01.31
  • Published : 2013.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study suggests that as receiving feedback is moved back, the effectiveness of problem-solving increases. Utilizing data from innovation contests in which a number of problem solvers compete with each other, we answer questions such as whether the order of receiving first feedback affects problem-solving effectiveness and how problem-solving experience moderates the relationship between the first feedback order and problem-solving effectiveness. Empirical results based on data collected from Kaggle, an online platform for innovation contests, showed that the order that contest participants receive the first feedback increases problem-solving effectiveness. Furthermore, the more prior experience of contest participants accentuates the suggested relationship between the order of receiving the first feedback and problem-solving effectiveness.

Keywords

References

  1. 강희택, 오한모, "지식관리시스템에서 지각된 피드백, 동기, 지식기여간의 관계에 대한 실증분석", 한국경영과학회지 , 제37권, 제1호(2012), pp.73-88.
  2. 박성희, 박경민, "회계기준 및 시장기준 성과피드백이 기술탐색에 미치는 영향", 한국경영과학회지 , 제36권, 제1호(2011), pp.57-68.
  3. Afuah, A. and C.L. Tucci, "Crowdsourcing as a Solution to Distant Search," Academy of Management Review, Vol.37, No.3(2012), pp.355-375. https://doi.org/10.5465/amr.2010.0146
  4. Argote, L. and E. Miron-Spektor, "Organizational Learning : From Experience to Knowledge," Organization Science, Vol.22, No.5(2011), pp. 1123-1137. https://doi.org/10.1287/orsc.1100.0621
  5. Athanasopoulos, G. and R.J. Hyndman, "The Value of Feedback in Forecasting Competitions," International Journal of Forecasting, Vol.27, No.3(2011), pp.845-849. https://doi.org/10.1016/j.ijforecast.2011.03.002
  6. Audia, P.G. and J.A. Goncalo, "Past Success and Creativity over Time : A Study of Inventors in the Hard Disk Drive Industry," Management Science, Vol.53, No.1(2007), pp.1-15. https://doi.org/10.1287/mnsc.1060.0593
  7. Bockstedt, J., C. Druehl, and A. Mishra, "Do Participation Strategy and Experience Impact the Likelihood of Winning in Unblind Innovation Contests?," Working Paper, (2011), Retrieved(http://ssrn.com/abstract=1961244).
  8. Bothner, M.S., J.-H. Kang, and T.E. Stuart, "Competitive Crowding and Risk Taking in a Tournament : Evidence from NASCAR Racing," Administrative Science Quarterly, Vol.52, No.2 (2007), pp.208-247.
  9. Boudreau, K.J., N. Lacetera, and K.R. Lakhani, "Incentives and Problem Uncertainty in Innovation Contests : An Empirical Analysis," Management Science, Vol.57, No.5(2011), pp.843- 863. https://doi.org/10.1287/mnsc.1110.1322
  10. Bowman, E.H. and G.T. Moskowitz, "Real Options Analysis and Strategic Decision Making," Organization Science, Vol.12, No.6(2001), pp.772-777. https://doi.org/10.1287/orsc.12.6.772.10080
  11. Carpenter, J., "May the Best Analyst Win," SCIENCE, Vol.331, No.6018(2011), pp.698-699. https://doi.org/10.1126/science.331.6018.698
  12. Chen, W.-R., "Determinants of Firms' Backward-and Forward-looking R&D Search Behavior," Organization Science, Vol.19, No.4 (2008), pp.609-622. https://doi.org/10.1287/orsc.1070.0320
  13. Cyert, R.M. and J.G. March, A Behavioral Theory of the Firm, Prentice-Hall, Englewood Cliffs, NJ, 1963.
  14. Dane, E., "Reconsidering the Trade-off between Expertise and Flexibility : A Cognitive Entrenchment Perspective," Academy of Management Review, Vol.35, No.4(2010), pp.579-603. https://doi.org/10.5465/AMR.2010.53502832
  15. Davidson, R. and J. MacKinnon, Estimation and Inference in Econometrics, Oxford University Press, New York, 1993.
  16. Denrell, J., C. Fang and D.A. Levinthal, "From T-mazes to Labyrinths : Learning from Modelbased Feedback," Management Science, Vol.50, No.10(2004), pp.1366-1378. https://doi.org/10.1287/mnsc.1040.0271
  17. Denrell, J. and J.G. March, "Adaptation as Information Restriction : The Hot Stove Effect," Organization Science, Vol.12, No.5(2001), pp. 523-538. https://doi.org/10.1287/orsc.12.5.523.10092
  18. Fiske, S.T. and S.E. Taylor, Social Cognition, Addison-Wesley, Reading, MA, 1984.
  19. Gavetti, G. and D.A. Levinthal, "Looking Forward and Looking Backward : Cognitive and Experiential Search," Administrative Science Quarterly, Vol.45, No.1(2000), pp.113-137. https://doi.org/10.2307/2666981
  20. Jeppesen, L.B. and K.R. Lakhani, "Marginality and Problem-solving Effectiveness in Broadcast Search," Organization Science, Vol.21, No. 5(2010), pp.1016-1033. https://doi.org/10.1287/orsc.1090.0491
  21. Kaplan, S. and M. Tripsas, "Thinking about Technology : Applying a Cognitive Lens to Technical Change," Research Policy, Vol.37, No.5(2008), pp.790-805. https://doi.org/10.1016/j.respol.2008.02.002
  22. Katila, R. and E.L. Chen, "Effects of Search Timing on Innovation : The Value of not Being in Sync with Rivals," Administrative Science Quarterly, Vol.53, No.4(2008), pp.593-625. https://doi.org/10.2189/asqu.53.4.593
  23. Kauffman, S., J. Lobo, and W.G. Macready, "Optimal Search on a Technology Landscape," Journal of Economic Behavior and Organization, Vol.43, No.2(2000), pp.141-166. https://doi.org/10.1016/S0167-2681(00)00114-1
  24. Knudsen, T. and D.A. Levinthal, "Two Faces of Search : Alternative Generation and Alternative Evaluation," Organization Science, Vol.18, No.1(2007), pp.39-54. https://doi.org/10.1287/orsc.1060.0216
  25. Kornish, L.J. and K.T. Ulrich, "Opportunity Spaces in Innovation : Empirical Analysis of Large Sample of Ideas," Management Science, Vol.57, No.1(2011), pp.107-128. https://doi.org/10.1287/mnsc.1100.1247
  26. Lehman, D.W., J. Hahn, R. Ramanujam, and B.J. Alge, "The Dynamics of the Performancerisk Relationship within a Performance Period : The Moderating Role of Deadline Proximity," Organization Science, Vol.22, No.6(2011), pp. 1613-1630. https://doi.org/10.1287/orsc.1100.0626
  27. Levinthal, D.A. and J.G. March, "A Model of Adaptive Organizational Search," Journal of Economic Behavior and Organization, Vol.2, No.4(1981), pp.307-333. https://doi.org/10.1016/0167-2681(81)90012-3
  28. Lurie, N.H. and J.M. Swaminathan, "Is timely Information Always Better? The Effect of Feedback Frequency on Decision Making," Organizational Behavior and Human Decision Processes, Vol.108, No.2(2009), pp.315-329. https://doi.org/10.1016/j.obhdp.2008.05.005
  29. Maggitti, P.G., K.G. Smith, and R. Katila, "The Complex Search Process of Invention," Research Policy, In Press(2012).
  30. March, J.G. and J.P. Olsen, Ambiguity and Choice in Organizations, University Press of Norway, Bergen, 1976.
  31. March, J.G. and H.A. Simon, Organizations, 2nd ed. Blackwell, Cambridge, MA, 1993.
  32. Martin, X. and W. Mitchell, "The Influence of Local Search and Performance Heuristics on New Design Introduction in a New Product Market," Research Policy, Vol.26, No.7-8(1998), pp.753-771. https://doi.org/10.1016/S0048-7333(97)00037-1
  33. Neter, J., M. Kutner, W. Wasserman, and C. Nachtsheim, Applied Linear Statistical Models, McGraw-Hill/Irwin, Chicago, 1996.
  34. Nickerson, J.A. and T.R. Zenger, "A Knowledge-based Theory of the Firm : The Problem-solving Perspective," Organization Science, Vol.15, No.6(2004), pp.617-632. https://doi.org/10.1287/orsc.1040.0093
  35. Papke, L.E. and J.M. Wooldridge, "Econometric Methods for Fractional Response Variables with an Application to 401(k) Plan Participation Rates," Journal of Applied Econometrics, Vol.11, No.6 (1996), pp.619-632. https://doi.org/10.1002/(SICI)1099-1255(199611)11:6<619::AID-JAE418>3.0.CO;2-1
  36. Ramalho, E.A., J.J.S. Ramalho, and J.M.R. Murteira, "Alternative Estimating and Testing Empirical Strategies for Fractional Regression Models," Journal of Economic Surveys, Vol. 25, No.1(2011), pp.19-68. https://doi.org/10.1111/j.1467-6419.2009.00602.x
  37. Ramalho, J. and J.V.D. Silva, "A Two-part Fractional Regression Model for the Financial Leverage Decisions of Micro, Small, Medium and Large Firms," Quantitative Finance, Vol.9, No.5(2009), pp.621-636. https://doi.org/10.1080/14697680802448777
  38. Shane, S., "Prior Knowledge and the Discovery of Entrepreneurial Opportunities," Organization Science, Vol.11, No.4(2000), pp.448-469. https://doi.org/10.1287/orsc.11.4.448.14602
  39. Taylor, A. and H.R. Greve, "Superman or the Fantastic Four? Knowledge Combination and Experience in Innovative Teams," Academy of Management Journal, Vol.49, No.4(2006), pp.723-740. https://doi.org/10.5465/AMJ.2006.22083029
  40. Valentino-Devries, J., "May the Best Algorithm Win.," Wall Street Journal, 2011.
  41. Walsh, J.P., "Managerial and Organizational Cognition : Notes from a Trip Down Memory Lane," Organization Science, Vol.6, No.3(1995), pp.280-321. https://doi.org/10.1287/orsc.6.3.280
  42. Winter, S.G., G. Cattani, and A. Dorsch, "The Value of Moderate Obsession : Insights from a New Model of Organizational Search," Organization Science, Vol.18, No.3(2007), pp.403-419. https://doi.org/10.1287/orsc.1070.0273
  43. Wooten, J.O. and K.T. Ulrich, "Idea Generation and the Role of Feedback : Evidence from Field Experiments with Innovation Tournaments," Working Paper, 2012, Retrieved(http://ssrn.com/abstract=1838733).