• Title/Summary/Keyword: Data archiving

Search Result 179, Processing Time 0.029 seconds

An Index Splitting Technique for Numerous Sensor Data Archiving (대용량 센서 데이터 아카이빙을 위한 색인 분할 기법)

  • Cho, Dae-Soo
    • Journal of Korea Spatial Information System Society
    • /
    • v.9 no.1
    • /
    • pp.31-43
    • /
    • 2007
  • Sensor data have the characteristics such as numerous and continuous data. Therefore, it is required to develop an index which could retrieve a specific sensor data efficiently from numerous sensed data. The index should have an efficient delete operation for the past data to support the data archiving. In this paper, we have proposed and implemented an index splitting technique to support the sensor data archiving. These splitted indexes compose of a virtual index (that is, index management component), which is shown as single tree from outside. Experimental results show that in the case of 100,000 insert operations the splitted index performs 8% better than the traditional TB-tree maximumly. And the splitted index outperforms TB-tree with retrieving queries when the region of query is small and the size of time domain is large.

  • PDF

Development of Metadata Elements for Intensive Web Archiving (선택적 웹 아카이빙을 위한 메타데이터 요소 개발)

  • Kim, Hee-Jung;Lee, Hye-Won
    • Journal of the Korean Society for information Management
    • /
    • v.24 no.2
    • /
    • pp.143-160
    • /
    • 2007
  • As digital preservation becomes increasingly important, interest in web archiving has correspondingly increased. The processes of web archiving depend on the types of acquisition methods employed, the organization and storage of data, their completeness, and their scope. This study develops metadata for intensive web archiving. Several web archiving projects are reviewed and analyzed. As a result, administrative metadata has been suggested in addition to the basic elements from the Dublin Core.

Multi-Behavior Analysis Based on Google Archiving Data (구글 아카이빙 데이터 기반 멀티 행위 분석)

  • Yeeun Kim;Sara Hong;Seongmin Kim
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.33 no.5
    • /
    • pp.737-751
    • /
    • 2023
  • The importance of digital forensics in the cloud environment is increasing as businesses and individuals move their data from On-premise to the cloud. Cloud data can be stored on various devices, including mobile devices and desktops, and encompasses a variety of user behavior artifacts, such as information generated from linked accounts and cloud services. However, there are limitations in securing and analyzing digital evidence due to environmental constraints of the cloud, such as distributed storage of data and lack of artifact linkage. One solution to address this is archiving services, and Google's Takeout is prime example. In this paper, user behavior data is analyzed for cloud forensics based on archiving data and necessary items are selected from an investigation perspective. Additionally, we propose the process of analyzing selectively collected data based on time information and utilizing web-based visualization to meaningfully assess artifact associations and multi-behaviors. Through this, we aim to demonstrate the value of utilizing archiving data in response to the increasing significance of evidence collection for cloud data.

A Study on Improving the OASIS Selection Guidelines (OASIS의 선정지침 개선(안)에 관한 연구)

  • Noh, Young-Hee;Go, Young-Sun
    • Journal of the Korean BIBLIA Society for library and Information Science
    • /
    • v.23 no.3
    • /
    • pp.105-137
    • /
    • 2012
  • The historical, social, and cultural value of Internet resources is indisputable, therefore many national institutions have created Web archiving projects to hand down this heritage to future generations. The selection guidelines are the most crucial aspect of these projects because they aid in differentiating which resources are worth collecting and preserving from the large number of web resources available. The purpose of this study was to suggest improvements for the OASIS Selection Guidelines by analyzing the selection guidelines of other domestic and international Web archiving projects. First, based on the results of Web archiving projects abroad, we proposed improvements for the definition of Web data and other terms, the basic principles of the collection, collection methods, and collection cycle. Second, we proposed substantial improvements in the target resources for archiving, and also stated what kind of web resources must be excluded from Web archiving. Finally, we discussed the relationship between data collection methods and the legal deposit of online resources, the necessity of constructing a database for selected target materials, and the necessity of cooperative archiving policies.

NVST DATA ARCHIVING SYSTEM BASED ON FASTBIT NOSQL DATABASE

  • Liu, Ying-Bo;Wang, Feng;Ji, Kai-Fan;Deng, Hui;Dai, Wei;Liang, Bo
    • Journal of The Korean Astronomical Society
    • /
    • v.47 no.3
    • /
    • pp.115-122
    • /
    • 2014
  • The New Vacuum Solar Telescope (NVST) is a 1-meter vacuum solar telescope that aims to observe the fine structures of active regions on the Sun. The main tasks of the NVST are high resolution imaging and spectral observations, including the measurements of the solar magnetic field. The NVST has been collecting more than 20 million FITS files since it began routine observations in 2012 and produces maximum observational records of 120 thousand files in a day. Given the large amount of files, the effective archiving and retrieval of files becomes a critical and urgent problem. In this study, we implement a new data archiving system for the NVST based on the Fastbit Not Only Structured Query Language (NoSQL) database. Comparing to the relational database (i.e., MySQL; My Structured Query Language), the Fastbit database manifests distinctive advantages on indexing and querying performance. In a large scale database of 40 million records, the multi-field combined query response time of Fastbit database is about 15 times faster and fully meets the requirements of the NVST. Our slestudy brings a new idea for massive astronomical data archiving and would contribute to the design of data management systems for other astronomical telescopes.

KITSAT-3 Image Product Generation System

  • Shin, Dong-Seok;Choi, Wook-Hyun;Kwak, Sung-Hee;Kim, Tag-Gon
    • Proceedings of the KSRS Conference
    • /
    • 1999.11a
    • /
    • pp.43-47
    • /
    • 1999
  • In this paper, we describe the configuration of the KITSAT-3 image data receiving, archiving, processing and distribution system in operation. Following the low-cost and software-based design concept, the whole system is composed of three PCs : two for data receiving, archiving and processing which provide a full dual-redundant configuration and one for image catalog browsing which can be accessed by public users. Except that receiving and archiving PCs have serial data ingest boards plugged in, they are configured by general peripherals. This basic and simple hardware configuration made it possible to show that a very low cost system can support a full ground operation for the utilization of high-resolution satellite image data.

  • PDF

A Study of Digital Archiving Policies for National S&T Information Resources (과학기술 분야 디지털 아카이빙을 위한 정책연구)

  • Seol, Moon-Won
    • Journal of Information Management
    • /
    • v.36 no.4
    • /
    • pp.23-49
    • /
    • 2005
  • The purpose of this study is to suggest the directions for building national digital archiving strategies. This present paper begins with surveying S&T information resources especially in public sector, and analyse the priority criteria for appraising and selecting the resources for long-term preservation. Emphasis is placed on identifying the critical tasks for each type of resources including scientific data, technical reports, theses, journal, web, e-prints, etc. and some levels of organizations in the national digital archiving framework. Based on the analysis, it suggests some strategic agenda for developing national digital archiving system.

A Study on the Development of Collaborative Model for Archiving an Electronic Book (전자책 아카이빙을 위한 협력모형 개발에 관한 연구)

  • Cho, Hyun-Yang;Jang, Bo-Sung;Yoo, Bo-Hyeon
    • Journal of the Korean BIBLIA Society for library and Information Science
    • /
    • v.21 no.4
    • /
    • pp.161-178
    • /
    • 2010
  • The purpose of this study is to develop a collaborative model for the archiving and preservation of an electronic book(e-book). In this study the way of the archiving and preservation for the e-book to deal with the technology evolution was suggested. Accordingly, the survey was made for obtaining the present status of the production and distribution of the domestic Online e-book. It is the same as the operation status of the archiving and preservation for the Online e-book worldwide. A collaborative model for accessible to preserved data, regardless of time period, was proposed for archiving the e-book, based on the OAIS reference model. There are three different models, suggested for domestic; the safe place model by law, the individual preservation/Peer-to-Peer model, and the preservation center model for e-book archiving. Among them, the safe place model by law was proposed for the optimum model of archiving an e-book at present.

Research and Development of Base Technology for Archiving Web Records (웹기록물 아카이빙 기반기술 연구 개발)

  • Cha, Seung-Jun;Lee, Kyu-Chul
    • Proceedings of the Korea Database Society Conference
    • /
    • 2008.05a
    • /
    • pp.359-368
    • /
    • 2008
  • Although the important information are significantly increasing in the Web, it is easily disappeared because of the Web's characteristics. The purpose of this paper is researching and developing of base technology for archiving web records. First developing about the workflow which is the procedure of web archiving, and developing about metadata elements, the essential condition of preserving web records and accessing archived resources. Finally developing the architecture defined the overall items of web records archiving.

  • PDF

Development of Deposit Process and Function Design for Web Archiving of Digital Resources (디지털 자원의 웹 아카이빙을 위한 납본 프로세스 개발 및 기능 설계)

  • Oh, Sang-Hoon;Choi, Young-Sun
    • Journal of the Korean Society for information Management
    • /
    • v.25 no.4
    • /
    • pp.5-23
    • /
    • 2008
  • The National Library of Korea is administering a legal deposit system for the printedpublications. Whereas, OASIS(Online Archiving & Searching Internet Sources) has to design a system to collect, manage and preserve web sites and web resources for Web Archiving. The purpose of this study is to develop a digital deposit process for digital resources. As a result, this study defines the subjects and objects for digital deposits, and describes the definitions and the functions according to digital deposit steps. Also, this study designs the data flow diagram and proposes the function definitions on unit works and the structure for the flow of information.