DOI QR코드

DOI QR Code

Intelligent VOC Analyzing System Using Opinion Mining

오피니언 마이닝을 이용한 지능형 VOC 분석시스템

  • 김유신 (국민대학교 비즈니스IT전문대학원) ;
  • 정승렬 (국민대학교 비즈니스IT전문대학원)
  • Received : 2013.06.28
  • Accepted : 2013.07.09
  • Published : 2013.09.30

Abstract

Every company wants to know customer's requirement and makes an effort to meet them. Cause that, communication between customer and company became core competition of business and that important is increasing continuously. There are several strategies to find customer's needs, but VOC (Voice of customer) is one of most powerful communication tools and VOC gathering by several channels as telephone, post, e-mail, website and so on is so meaningful. So, almost company is gathering VOC and operating VOC system. VOC is important not only to business organization but also public organization such as government, education institute, and medical center that should drive up public service quality and customer satisfaction. Accordingly, they make a VOC gathering and analyzing System and then use for making a new product and service, and upgrade. In recent years, innovations in internet and ICT have made diverse channels such as SNS, mobile, website and call-center to collect VOC data. Although a lot of VOC data is collected through diverse channel, the proper utilization is still difficult. It is because the VOC data is made of very emotional contents by voice or text of informal style and the volume of the VOC data are so big. These unstructured big data make a difficult to store and analyze for use by human. So that, the organization need to automatic collecting, storing, classifying and analyzing system for unstructured big VOC data. This study propose an intelligent VOC analyzing system based on opinion mining to classify the unstructured VOC data automatically and determine the polarity as well as the type of VOC. And then, the basis of the VOC opinion analyzing system, called domain-oriented sentiment dictionary is created and corresponding stages are presented in detail. The experiment is conducted with 4,300 VOC data collected from a medical website to measure the effectiveness of the proposed system and utilized them to develop the sensitive data dictionary by determining the special sentiment vocabulary and their polarity value in a medical domain. Through the experiment, it comes out that positive terms such as "칭찬, 친절함, 감사, 무사히, 잘해, 감동, 미소" have high positive opinion value, and negative terms such as "퉁명, 뭡니까, 말하더군요, 무시하는" have strong negative opinion. These terms are in general use and the experiment result seems to be a high probability of opinion polarity. Furthermore, the accuracy of proposed VOC classification model has been compared and the highest classification accuracy of 77.8% is conformed at threshold with -0.50 of opinion classification of VOC. Through the proposed intelligent VOC analyzing system, the real time opinion classification and response priority of VOC can be predicted. Ultimately the positive effectiveness is expected to catch the customer complains at early stage and deal with it quickly with the lower number of staff to operate the VOC system. It can be made available human resource and time of customer service part. Above all, this study is new try to automatic analyzing the unstructured VOC data using opinion mining, and shows that the system could be used as variable to classify the positive or negative polarity of VOC opinion. It is expected to suggest practical framework of the VOC analysis to diverse use and the model can be used as real VOC analyzing system if it is implemented as system. Despite experiment results and expectation, this study has several limits. First of all, the sample data is only collected from a hospital web-site. It means that the sentimental dictionary made by sample data can be lean too much towards on that hospital and web-site. Therefore, next research has to take several channels such as call-center and SNS, and other domain like government, financial company, and education institute.

기업 경영에 있어서 고객의 소리(VOC)는 고객 만족도 향상 및 기업의사결정에 매우 중요한 정보이다. 이는 비단 기업뿐만 아니라 대고객, 대민원 업무를 처리하는 모든 조직에 있어서도 동일하다. 때문에 최근에는 기업뿐만 아니라 공공, 의료, 금융, 교육기관 등 거의 모든 조직이 VOC를 수집하여 활용하고 있다. 이러한 VOC는 방문, 전화, 우편, 인터넷게시판, SNS 등 다양한 채널을 통해 전달되지만, 막상 이를 제대로 활용하기는 쉽지 않다. 왜냐하면, 고객이 매우 감정적인 상태에서 고객의 주관적 의사를 음성 또는 문자로 표출하기 때문에 그 형식이나 내용이 정형화되어 있지 않고 저장하기도 어려우며 또한 저장하더라도 매우 방대한 분량의 비정형 데이터로 남기 때문이다. 본 연구는 이러한 비정형 VOC 데이터를 자동으로 분류하고 VOC의 유형과 극성을 판별할 수 있는 오피니언 마이닝 기반의 지능형 VOC 분석 시스템을 제안하였다. 또한 VOC 오피니언 분석의 기준이 되는 주제지향 감성사전 개발 프로세스와 각 단계를 구체적으로 제시하였다. 그리고 본 연구에서 제시한 시스템의 효용성을 검증하기 위하여 의료기관 홈페이지에서 수집한 4,300여건의 VOC 데이터를 이용하여 병원에 특화된 감성어휘와 감성극성값을 도출하여 감성사전을 구축하고 이를 통해 구현된 VOC분류 모형의 정확도를 비교하는 실험을 수행하였다. 그 결과 "칭찬, 친절함, 감사, 무사히, 잘해, 감동, 미소" 등의 어휘는 매우 높은 긍정 오피니언 값을 가지며, "퉁명, 뭡니까, 말하더군요, 무시하는" 등의 어휘들은 강한 부정의 극성값을 가지고 있음을 확인하였다. 또한 VOC의 오피니언 분류 임계값이 -0.50일 때 가장 높은 분류 예측정확도 77.8%를 검증함으로써 오피니언 마이닝 기반의 지능형 VOC 분석시스템의 유효성을 확인하였다. 그러므로 지능형 VOC 분석시스템을 통해 VOC의 실시간 자동 분류 및 대응 우선순위를 도출하여 고객 민원에 대해 신속히 대응한다면, VOC 전담 인력을 효율적으로 운용하면서도 고객 불만을 초기에 해소할 수 있는 긍정적 효과를 기대해 볼 수 있을 것이다. 또한 VOC 텍스트를 분석하고 활용할 수 있는 오피니언 마이닝 모형이라는 새로운 시도를 통해 향후 다양한 분석과 실용 프레임워크의 기틀을 제공할 수 있을 것으로 기대된다.

Keywords

References

  1. Ghose, A., P. G. Ipeirotis, and A. Sundararajan, "Opinion Mining Using Econometrics : A Case Study on Reputation Systems," Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, (2007), 416-423.
  2. Cha, S., J. Kang, and J. Choi, "A Study on Social media Opinion Mining based Enterprise Crisis Management," Proceedings of KIISE Conference, Vol.39, No.1(2012), 142-144.
  3. Chen, H. and D. Zimbra, "AI and Opinion Mining," IEEE Intelligent Systems, Vol.25, Issue.3 (2010), 74-80.
  4. Choi, Y.-J. and H. Choi, "A Study on the Customer Satisfaction Strategies of the Online Company Using VOC," Journal of Korean Industrial Economics and Business, Vol.3, No.1(2011), 73-93.
  5. Hu, M. and B. Liu, "Mining and summarizing customer review," Proceedings of the tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2004, 168-177.
  6. Conrad, J. G. and F. Schilder, "Opinion Mining in Legal Blogs," Proceedings of the 11th ACM International Conference on Artificial Intelligence and Law, 2007, 231-236.
  7. Ju, J.-M. and S.-G. Hwang, "Establishment of VOC analysis system for efficient CRM," Journal of the Korean Society for Quality Management, Vol.32, No.1(2004), 75-91.
  8. Kim, Y., "Case Analysis of Specific Unification CRM and BSC," Journal of the Korea Service Management Society, Vol.8, No.3(2007), 277-292.
  9. Kim, Y., News Big Data Opinion Mining Model for Predicting KOSPI Movement, Kookmin University Graduate School of Business IT, 2012.
  10. Kim, Y., N. Kim, and S. R. Jeong, "Stock-Index Invest Model Using News Big Data Opinion Mining," Journal of Intelligence and Information Systems, Vol.18, No.2(2012), 143-156.
  11. Takeuchi, H., L. V. Subramaniam., T. Nasukawa, and S. Roy, "Getting insights from the voices of customers : Conversation mining at a contact center," Information Science, Vol.179 Issue.11 (2009), 1584-1591. https://doi.org/10.1016/j.ins.2008.11.026
  12. Yang, J.-Y., J. Myung, and S.-G. Lee, "A Sentiment Classification Method using Context Information in Product Review Summarization," Journal of KIISE : Databases, Vol.36, No.4(2009), 254-262.
  13. Yu, Y., Y. Kim., N. Kim, and S. R. Jeong, "Predicting the Direction of the Stock Index by Using a Domain‐Specific Sentiment Dictionary," Journal of Intelligence and Information Systems, Vol.19, No.1(2013), 92-110.
  14. Yune, H., H.-J. Kim, and J.-Y. Chang, "An Efficient Search Method of Product Review using Opinion Mining Techniques," Journal of KIISE : Computing Practices and Letters, Vol.16, No.2(2010), 222-226.
  15. Zhuang, L., F. Jing, and X. Y. Zhu, "Movie Review Mining and Summarization," Proceedings of the 15th ACM International Conference on Information and Knowledge Management, (2006), 43-50.

Cited by

  1. A Method of Predicting Service Time Based on Voice of Customer Data vol.15, pp.1, 2016, https://doi.org/10.9716/KITS.2016.15.1.197
  2. Visualizing the Results of Opinion Mining from Social Media Contents: Case Study of a Noodle Company vol.20, pp.4, 2014, https://doi.org/10.13088/jiis.2014.20.4.89
  3. Investigating the Impact of Corporate Social Responsibility on Firm's Short- and Long-Term Performance with Online Text Analytics vol.22, pp.2, 2016, https://doi.org/10.13088/jiis.2016.22.2.013
  4. A Design of Satisfaction Analysis System For Content Using Opinion Mining of Online Review Data vol.17, pp.3, 2016, https://doi.org/10.7472/jksii.2016.17.3.107
  5. VOC 기반 연관규칙 마이닝을 이용한 통신선로설비의 장애 예측 vol.11, pp.4, 2015, https://doi.org/10.17662/ksdim.2015.11.4.013
  6. 고객센터 상담내용 분석을 통한 이탈 요인에 관한 실증 연구 vol.22, pp.4, 2013, https://doi.org/10.7838/jsebs.2017.22.4.141
  7. SNS 감성분석을 이용한 정보 추출 방법론에 관한 연구 vol.16, pp.6, 2013, https://doi.org/10.12815/kits.2017.16.6.141
  8. VOC와 외부채널간의 고객 피드백 차이 분석 vol.41, pp.3, 2013, https://doi.org/10.11627/jkise.2018.41.3.129
  9. 비정형 데이터 분석을 통한 선거 여론조사 예측력 개선 방안 연구 vol.31, pp.5, 2013, https://doi.org/10.5351/kjas.2018.31.5.655
  10. 평점과 리뷰 텍스트 감성분석을 결합한 추천시스템 향상 방안 연구 vol.25, pp.1, 2013, https://doi.org/10.13088/jiis.2019.25.1.219
  11. 장비점검 일지의 비정형 데이터분석을 통한 고장 대응 효율화 사례 연구 vol.21, pp.1, 2013, https://doi.org/10.7472/jksii.2020.21.1.127