Journal of the Korea Institute of Information and Communication Engineering (한국정보통신학회논문지)

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

A Method for Selective Storing and Visualization of Public Big Data Using XML Structure

XML구조를 이용한 공공 빅데이터의 선별 저장 및 시각화 방법

  • Received : 2017.10.03
  • Accepted : 2017.11.05
  • Published : 2017.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

In recent years, there have been tries to open public data from various government agencies along with publicization of public information for the public interest. In other words, various kinds of electronic data generated and collected by the public institutions as a result of their work are opened in the public portal sites. However, users who use it are limited in their use of big data due to lack of understanding of data format, lack of data processing knowledge, difficulty in accessing and managing data, and lack of visualization data to understand collected and stored data. Therefore, in this study, we propose a big data collection, storing and visualization platform that can collect big data provided by various public sites using data set URL and API regardless of data format, re-process collected data using XML structure.

최근들어 공공 정보화와 함께 정부기관, 지자체 및 다양한 정부산하기관에서 보유하고 있는 데이터를 공개하고 있는 추세이다. 즉, 공공기관이 업무수행의 결과물로 생성 및 수집한 다양한 전자화된 형태의 데이터를 공공데이터 포털사이트에서 개방하고 있다. 하지만 이를 사용하는 사용자는 데이터 형식의 이해와 데이터 처리 지식의 부족, 데이터에 대한 접근과 관리의 어려움, 수집 및 저장한 데이터의 이해를 위한 시각화 기술의 부족 등으로 빅데이터의 활용에 제한을 받고 있다. 따라서 본 연구에서는 다양한 공공 사이트에서 제공하는 빅데이터를 데이터셋의 URL 및 API를 사용하여 데이터 포맷에 관계없이 데이터를 수집하며, 수집된 데이터를 XML 구조를 이용하여 재가공하여 데이터베이스화하며, 데이터 융합을 통한 시각화가 가능하도록 하는 공공 빅데이터 수집, 선별 저장 및 시각화 플랫폼을 제안한다.

Keywords

References

  1. X. Wu, X. Zhu, D. Wu and W. Ding, "Data mining with big data," IEEE Transactions on Knowledge and Data Engineering, vol. 26, no. 1, pp. 97-107, Jan. 2014. https://doi.org/10.1109/TKDE.2013.109
  2. C. Cheng and C. Zhang, "Data-intensive applications, challenges, techniques and technologies: A survey on Big Data," Information Sciences. vol. 275, pp. 314-347, Aug. 2014. https://doi.org/10.1016/j.ins.2014.01.015
  3. G. Kim, S. Trimi and J. Chung, "Big-data applications in the government sector," Communications of the ACM, vol. 57, no. 3, pp. 78-85, Mar. 2014. https://doi.org/10.1145/2500873
  4. Y. Kang, K. Kim, M. Han, J. Kim, "A Study on the Business Strategies based on Big Data Analysis," Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, vol.5, no.5, pp.145-152, 2015.
  5. S. Bang, H. Ha and C. Kim, "A Study on Big Data-based Software Architecture Design for Utilizing Public Open Data," Journal of Advanced Information Technology and Convergence. vol. 13, no. 10, pp. 99-107, Oct. 2015.
  6. Y. Chol, "A Study on the Development of Public Big Data Platform Reference Model," Journal of Information Technology and Architecture. vol. 12, no. 4, pp. 495-503, April 2015.
  7. M. Kim and D. Choi, "An Analysis of the Public Data for Making the Ambient Intelligent Service," JOURNAL OF DIGITAL CONVERGENCE, vol. 12, no. 12, pp. 313-321, Dec. 2014. https://doi.org/10.14400/JDC.2014.12.12.313
  8. Y. Moon and J. Jung, "The visualization of application utilizing public data," The Treatise on The Plastic Media. vol. 18, no. 1, pp. 63-76, Jan. 2015.
  9. K. Lee, G. Nam, J. Sim, K. Cho and W. Ryu, "Construction of Knowledge Base for The Utilization of Big Data in Public Domain," Communications of the Korean Institute of Information Scientists and Engineer. vol. 30, no. 6, pp. 40-46, 2012.
  10. S. Ju, J. Jeong and G. Ryu, "Big Data Technology Trends Big Data Visualization and Public Data Visualization Examples," It's Smart Media. vol. 2, no. 3, pp. 37-43, 2013.
  11. J. Lee and G. Oh, "A study of application development case built on public section big data - PET 119 IN SUWON," Journal of The Korea Big Data Service Society. vol. 2, no. 1, pp. 19-24, 2015.
  12. S. Lee and S. Shin, "Design of Health Warning Model on the Basis of CRM by use of Health Big Data," Journal of the Korea Institute of Information and Communication Engineering. vol. 20, no. 8, pp. 1460-1465, 2016. https://doi.org/10.6109/jkiice.2016.20.8.1460
  13. M. Lee and B. On, "An Example of Public Data Visualization based on the Big Data Approach," Information & communications magazine. vol. 29, no. 11, pp. 36-42, 2012.
  14. S. Lee, J. Jung, G. Cha, G. Son, S. Kim and J. Kim, "Social safety net system through big data analysis of public data," Journal of Satellite, Information and Communications. vol. 10, no. 4, pp. 77-82, 2015.
  15. I. Ha, B. Bak and B. Ahn, "MapReduce functions to analyze sentiment information from social big data," International Journal of Distributed Sensor Networks-Special issue on Advanced Big Data Management and Analytics for Ubiquitous Sensors.vol. 2015. Jan. 2015.

Cited by

  1. 빅데이터 연구 논문의 주제 분야 연관관계 분석: 동시 인용 관계를 적용하여 vol.35, pp.1, 2017, https://doi.org/10.3743/kosim.2018.35.1.013
  2. 기계학습 클러스터링을 이용한 승하차 패턴에 따른 서울시 지하철역 분류 vol.18, pp.4, 2017, https://doi.org/10.7236/jiibc.2018.18.4.13