지능정보연구 (Journal of Intelligence and Information Systems)

  • 제23권3호
  • /
  • Pages.29-44
  • /
  • 2017
  • /
  • 2288-4866(pISSN)
  • /
  • 2288-4882(eISSN)
한국지능정보시스템학회 (Korea Intelligent Information System Society)
권호 표지
DOI QR코드

DOI QR Code

온라인 상품평의 내용적 특성이 소비자의 인지된 유용성에 미치는 영향

Impact of Semantic Characteristics on Perceived Helpfulness of Online Reviews

  • 박윤주 (서울과학기술대학교 경영학과) ;
  • 김경재 (동국대학교_서울 경영대학 경영정보학과)
  • Park, Yoon-Joo (Department of Business Administration, Seoul National University of Science and Technology) ;
  • Kim, Kyoung-jae (Department of MIS, Dongguk University_Seoul)
  • 투고 : 2017.06.22
  • 심사 : 2017.09.19
  • 발행 : 2017.09.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

인터넷 상거래에서, 소비자들은 기존에 제품을 구매한 다른 사용자들이 작성한 상품평에 많은 영향을 받는다. 그러나, 상품평이 점차 축적되어감에 따라, 소비자들이 방대한 상품평을 일일이 확인하는데 많은 시간과 노력이 소요되고, 또한 무성의하게 작성된 상품평들은 오히려 소비자들의 불편을 초래하기도 한다. 이에, 본 연구는 온라인 상품평의 유용성에 영향을 미치는 요인들을 분석하여, 소비자들에게 실제로 도움이 될 수 있는 상품평을 선별적으로 제공하는 예측모형을 도출하는 것을 목적으로 한다. 이를 위해, 텍스트마이닝 기법을 사용하여, 상품평에 포함되어있는 다양한 언어적, 심리적, 지각적 요소들을 추출하였으며, 이러한 요소들 중에서 상품평의 유용성에 영향을 미치는 결정요인이 무엇인지 파악하였다. 특히, 경험재인 의류군과 탐색재인 전자제품군에 대한 상품평의 특성 및 유용성 결정요인이 상이할 수 있음을 고려하여, 제품군별로 상품평의 특성을 비교하고, 각각의 결정요인을 도출하였다. 본 연구에는 아마존닷컴(Amazon.com)의 의류군 상품평 7,498건과 전자제품군 상품평 106,962건이 사용되었다. 또한, 언어분석 소프트웨어인 LIWC(Linguistic Inquiry and Word Count)를 활용하여 상품평에 포함된 특징들을 추출하였고, 이후, 데이터마이닝 소프트웨어인 RapidMiner를 사용하여, 회귀분석을 통한, 결정요인 분석을 수행하였다. 본 연구결과, 제품에 대한 리뷰어의 평가가 높고, 상품평에 포함된 전체 단어 수가 많으며, 상품평의 내용에 지각적 과정이 많이 포함되어 있는 반면, 부정적 감정은 적게 포함된 상품평들이 두 제품 모두에서 유용하다고 인식되는 것을 알 수 있었다. 그 외, 의류군의 경우, 비교급 표현이 많고, 전문성 지수는 낮으며, 한 문장에 포함된 단어 수가 적은 간결한 상품평이 유용하다고 인식되고 있었으며, 전자제품의 경우, 전문성 지수가 높고, 분석적이며, 진솔한 표현이 많고, 인지적 과정과 긍정적 감정(PosEmo)이 많이 포함된 상품평이 유용하게 인식되고 있었다. 이러한 연구결과는 향후, 소비자들이 효과적으로 유용한 상품평들을 확인하는데 도움이 될 것으로 기대된다.

In Internet commerce, consumers are heavily influenced by product reviews written by other users who have already purchased the product. However, as the product reviews accumulate, it takes a lot of time and effort for consumers to individually check the massive number of product reviews. Moreover, product reviews that are written carelessly actually inconvenience consumers. Thus many online vendors provide mechanisms to identify reviews that customers perceive as most helpful (Cao et al. 2011; Mudambi and Schuff 2010). For example, some online retailers, such as Amazon.com and TripAdvisor, allow users to rate the helpfulness of each review, and use this feedback information to rank and re-order them. However, many reviews have only a few feedbacks or no feedback at all, thus making it hard to identify their helpfulness. Also, it takes time to accumulate feedbacks, thus the newly authored reviews do not have enough ones. For example, only 20% of the reviews in Amazon Review Dataset (Mcauley and Leskovec, 2013) have more than 5 reviews (Yan et al, 2014). The purpose of this study is to analyze the factors affecting the usefulness of online product reviews and to derive a forecasting model that selectively provides product reviews that can be helpful to consumers. In order to do this, we extracted the various linguistic, psychological, and perceptual elements included in product reviews by using text-mining techniques and identifying the determinants among these elements that affect the usability of product reviews. In particular, considering that the characteristics of the product reviews and determinants of usability for apparel products (which are experiential products) and electronic products (which are search goods) can differ, the characteristics of the product reviews were compared within each product group and the determinants were established for each. This study used 7,498 apparel product reviews and 106,962 electronic product reviews from Amazon.com. In order to understand a review text, we first extract linguistic and psychological characteristics from review texts such as a word count, the level of emotional tone and analytical thinking embedded in review text using widely adopted text analysis software LIWC (Linguistic Inquiry and Word Count). After then, we explore the descriptive statistics of review text for each category and statistically compare their differences using t-test. Lastly, we regression analysis using the data mining software RapidMiner to find out determinant factors. As a result of comparing and analyzing product review characteristics of electronic products and apparel products, it was found that reviewers used more words as well as longer sentences when writing product reviews for electronic products. As for the content characteristics of the product reviews, it was found that these reviews included many analytic words, carried more clout, and related to the cognitive processes (CogProc) more so than the apparel product reviews, in addition to including many words expressing negative emotions (NegEmo). On the other hand, the apparel product reviews included more personal, authentic, positive emotions (PosEmo) and perceptual processes (Percept) compared to the electronic product reviews. Next, we analyzed the determinants toward the usefulness of the product reviews between the two product groups. As a result, it was found that product reviews with high product ratings from reviewers in both product groups that were perceived as being useful contained a larger number of total words, many expressions involving perceptual processes, and fewer negative emotions. In addition, apparel product reviews with a large number of comparative expressions, a low expertise index, and concise content with fewer words in each sentence were perceived to be useful. In the case of electronic product reviews, those that were analytical with a high expertise index, along with containing many authentic expressions, cognitive processes, and positive emotions (PosEmo) were perceived to be useful. These findings are expected to help consumers effectively identify useful product reviews in the future.

키워드

참고문헌

  1. Baek, H., J. Ahn, and Y. Choi (2012), "Helpfulness of Online Consumer Revers: Reader's Objectives and Review Cues", International Journal of Electronic Commerce, vol.17 (2), pp.99-126. https://doi.org/10.2753/JEC1086-4415170204
  2. Cao, Q., D., W. J., and Gan, Q. W (2011). "Exploring Determinants of Voting for the 'Helpfulness' of Online User Reviews: A Text Mining Approach," Decision Support Systems, vol.50 (2), pp.511-521. https://doi.org/10.1016/j.dss.2010.11.009
  3. Chevalier, J. A. & D. Mayzlin, (2003), "The Effect of Word of Mouth on Sales: Online Book Reviews", Journal of Marketing Research, vol.43(3), pp.345-354. https://doi.org/10.1509/jmkr.43.3.345
  4. Cho, S.-H., M.Y. Yi (2014), "Business Implications of the Factors that Determine Online Review Helpfulness", Entrue Journal of Information Technology, vol.13(1), pp.29-40.
  5. Choi, J.-W., and H.-J. Lee, "The Effects of Customer Product Review on Social Presence in Personalized Recommender Systems", Journal of Intelligence and Information Systems, Vol. 17, No. 3 (2011), 115-130.
  6. Forman, C., A. Ghose, B. Wiesenfeld (2008), "Examining the Relationship between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets", Information Systems Research, vol.19(3), pp.291-313. https://doi.org/10.1287/isre.1080.0193
  7. Ghose, A. and P.G. Ipeirotis (2011), "Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics", IEEE Transactions on Knowledge and Data Engineering, vol.23 (10), pp.1498-1512. https://doi.org/10.1109/TKDE.2010.188
  8. Hong, Won Eui, M.Y. Yi (2015), "Helpfulness in Unhelpfulness: A Study of the Flip Side of the Coin on Review Helpfulness", KAIST MS. thesis
  9. Hyunmi Baek, J. H. Ahn, S. W. Ha (2011), "Identifying Factors Affecting Helpfulness of Online Reviews: The Moderating Role of Product Price", The Journal of Society for e-Business Studies, vol.16(3), pp.93-112.
  10. Kim, Y., and M. Song, "A Study on Analyzing Sentiments on Movie Reviews by Multi-Level Sentiment Classifier", Journal of Intelligence and Information Systems, Vol. 22, No. 3 (2016), 71-89. https://doi.org/10.13088/jiis.2016.22.3.071
  11. Korfiatis, N., E. Garcia-Bariocanal, and S. Sanchez-Alonso (2012), "Evaluating Content Quality and Helpfulness of Online Product Reviews: The Interplay of Review Helpfulness vs. Review Content", Electronic Commerce Research and Applications, vol.11(3), pp.205-217. https://doi.org/10.1016/j.elerap.2011.10.003
  12. Lee, G.N, Y.J. Won, C.H. Cho, G.H Lee, E.A. Na, H.S. Hwang and M.J. Shin, 2010 Survey on the Internet Usage, Seoul: Korea Internet & Security Agency, 2010.
  13. Lee, H. G., H. Kwak (2013), "Investigation of Factors Affecting the Effects of Online Consumer Reviews", Informatization Policy, vol.20(3), pp.3-17.
  14. Lee, S.J. Lee, J. Y. Choeh, J. H. Choi (2014), "The Determinant Factors Affecting Economic Impact, Helpfulness, and Helpfulness Votes of Online", Journal of IT Service, vol.13(1), pp.43-55. https://doi.org/10.9716/KITS.2014.13.1.043
  15. Lee, M., and H. J. Lee, "Increasing Accuracy of Classifying Useful Reviews by Removing Neutral Terms", Journal of Intelligence and Information Systems, Vol. 22, No. 3 (2016), 129-142. https://doi.org/10.13088/jiis.2016.22.3.129
  16. Mahony, M. P., & B. B. Smyth (2010), A Classification-Based Review Recommender", Knowledge-Based Systems, vol.23(4), pp.323 -329. https://doi.org/10.1016/j.knosys.2009.11.004
  17. McAuley and Leskovec2013] Julian McAuley and Jure Leskovec. 2013. Hidden factors and hidden topics: Understanding rating dimensions with review text. In Proceedings of the 7th ACM Conference on Recommender Systems, RecSys' 13, pp.165-172.
  18. McAuley, J., R. Pandey, and J. Leskovec (2015), "Inferring Networks of Substitutable and Complementary Products", In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp.785-794.
  19. Mudambi, S.M. and D. Schuff (2010), "What Makes a Helpful Online Review? A Study of Customer Reviews on Amazon.com", MIS Quarterly, vol.34(1), pp.185-200. https://doi.org/10.2307/20721420
  20. Pan, Y., and J. Q. Zhang (2011) "Born unequal: a study of the helpfulness of user-generated product reviews", Journal of Retailing, vol.87(4), pp.598-612. https://doi.org/10.1016/j.jretai.2011.05.002
  21. Wan, Y. (2015), The Matthew Effect in Social Commerce, Electronic Markets, pp.1-12.
  22. Yin, G., L. Wei, W. Xu, and M. Chen (2014), "Exploring Heuristic Cues for Consumer Perceptions of Online Reviews Helpfulness: The Case of Yelp. com.", PACIS 2014 Proceedings, 52.