• 제목/요약/키워드: method of processing

검색결과 17,838건 처리시간 0.046초

Concurrency Control Method to Provide Transactional Processing for Cloud Data Management System

  • Choi, Dojin;Song, Seokil
    • International Journal of Contents
    • /
    • 제12권1호
    • /
    • pp.60-64
    • /
    • 2016
  • As new applications of cloud data management system (CDMS) such as online games, cooperation edit, social network, and so on, are increasing, transaction processing capabilities for CDMS are required. Several transaction processing methods for cloud data management system (CDMS) have been proposed. However, existing transaction processing methods have some problems. Some of them provide limited transaction processing capabilities. Some of them are hard to be integrated with existing CDMSs. In this paper, we proposed a new concurrency control method to support transaction processing capability for CDMS to solve these problems. The proposed method was designed and implemented based on Spark, an in-memory distributed processing framework. It uses RDD (Resilient Distributed Dataset) model to provide fault tolerant to data in the main memory. In our proposed method, database stored in CDMS is loaded to main memory managed by Spark. The loaded data set is then transformed to RDD. In addition, we proposed a multi-version concurrency control method through immutable characteristics of RDD. Finally, we performed experiments to show the feasibility of the proposed method.

Comparison of Sentiment Analysis from Large Twitter Datasets by Naïve Bayes and Natural Language Processing Methods

  • Back, Bong-Hyun;Ha, Il-Kyu
    • Journal of information and communication convergence engineering
    • /
    • 제17권4호
    • /
    • pp.239-245
    • /
    • 2019
  • Recently, effort to obtain various information from the vast amount of social network services (SNS) big data generated in daily life has expanded. SNS big data comprise sentences classified as unstructured data, which complicates data processing. As the amount of processing increases, a rapid processing technique is required to extract valuable information from SNS big data. We herein propose a system that can extract human sentiment information from vast amounts of SNS unstructured big data using the naïve Bayes algorithm and natural language processing (NLP). Furthermore, we analyze the effectiveness of the proposed method through various experiments. Based on sentiment accuracy analysis, experimental results showed that the machine learning method using the naïve Bayes algorithm afforded a 63.5% accuracy, which was lower than that yielded by the NLP method. However, based on data processing speed analysis, the machine learning method by the naïve Bayes algorithm demonstrated a processing performance that was approximately 5.4 times higher than that by the NLP method.

이미지 프로세싱을 이용한 부유구조물의 2차원 위치 계측장치 개발 (Development of Two Dimensional Position Measuring Device for Floating Structure Using an Image Processing Method)

  • 지명석;김성근;김상봉
    • 한국해양공학회지
    • /
    • 제8권2호
    • /
    • pp.166-172
    • /
    • 1994
  • This paper presents an image processing method for two dimensional position measurement of a floating structure. This method is based on image processing technique using concept of window and threshold processing to track the target object. The experimental results for position measurement of the target object in two dimensional water tank demonstrate the validity of this method.

  • PDF

화상처리기술을 이용한 옹이의 검출 (Detection of Knots by Image Processing Technique)

  • 김병남;이형우
    • 한국가구학회지
    • /
    • 제12권1호
    • /
    • pp.27-37
    • /
    • 2001
  • Automation of wood processing is strongly required to improve the productivity and quality of wood products in wood industry which is one of the most labor-intensive industries. Classification of surface defects on wood boards such as knots is one of the important steps towards a completely automated wood processing system. In this study the possibility of detection of knots by image processing technique was investigated. Algorithm for the automatic determination of threshold value was developed to enhance the flexibility of image processing system. Two different approaches, grid method and tile method, were developed to enhance the speed in extracting features from images. Grid method showed slightly higher processing speed and tile method proved much more stable in determining threshold values. Tile size of $5{\times}5$ pixels or $6{\times}6$ pixels was found to be proper to get stable results with resonable processing time.

  • PDF

정비작업의 생산성 향상을 위한 전자문서자동화시스템 모형 - 건설장비 정비작업을 중심으로 - (Electronic Document Automation System Model for Improving Productivity in maintenance work - in Inspection Process of Construction Equipment Maintenance -)

  • 공명달
    • 대한안전경영과학회지
    • /
    • 제19권3호
    • /
    • pp.49-58
    • /
    • 2017
  • This paper suggests a specific model that could efficiently improve the interaction and the interface between MES(Manufacturing Execution System) server and POP(Point of Production) terminal through electronic document server and electronic pen, bluetooth receiver and form paper in disassembly and process inspection works. The proposed model shows that the new method by electronic document automation system can more efficiently perform to reduce processing time for maintenance work, compared with the current approach by handwritten processing system. It is noted in case of the method by electronic document automation system that the effects of proposed model are as follows; (a) While the processing time per equipment for maintenance by the current method was 300 minutes, the processing time by the new method was 50 minutes. (b) While the processing error ratio by the current method was 20%, the error ratio by the new method was 1%.

빅데이터 환경에서 스트림 질의 처리를 위한 인메모리 기반 점진적 처리 기법 (In-Memory Based Incremental Processing Method for Stream Query Processing in Big Data Environments)

  • 복경수;육미선;노연우;한지은;김연우;임종태;유재수
    • 한국콘텐츠학회논문지
    • /
    • 제16권2호
    • /
    • pp.163-173
    • /
    • 2016
  • 최근 대용량의 스트림 데이터를 분산 처리하기 위한 연구들이 진행되고 있다. 본 논문에서는 빅데이터 환경에서 실시간 스트림 데이터의 점진적 처리 기법을 제안한다. 제안하는 기법은 처음 스트림 데이터가 입력되면 임시 큐에 데이터를 저장하고 마스터 노드에 저장되어 데이터와 비교과정을 통해 마스터 노드에 동일한 데이터가 있는 경우 마스터 노드에서 가지고 있는 노드의 정보를 이용하여 해당 노드의 메모리에서 기존 처리 결과를 재사용한다. 기존 처리 결과가 없다면 처리하고 처리 결과를 메모리에 저장한다. 분산 환경에서 점진적인 스트리밍 데이터 처리를 위해 노드의 작업 지연을 계산하여 노드의 부하를 파악하고 처리 시간 계산을 통해 각 노드의 성능을 고려한 잡 스케쥴링 기법을 제안한다. 제안하는 기법의 우수성을 보이기 위해 기존 기법과의 질의 수행 시간 비교를 위한 성능평가를 수행한다.

개선된 CENTRIST 알고리즘을 적용한 병렬처리 기반 보행자 인식 구현 (Implementation of Parallel Processing Based Pedestrian Detection Using a Modified CENTRIST Algorithm)

  • 정준모
    • 전기전자학회논문지
    • /
    • 제18권3호
    • /
    • pp.398-402
    • /
    • 2014
  • 본 논문은 ROI-CENTRIST 기반 보행자 인식 알고리즘의 병렬처리 방식을 제안한다. 기존의 보행자 인식 방식만을 이용하여 임베디드 환경에서 보행자 인식을 실시간으로 처리하기에는 어려움이 존재한다. 이러한 문제는 기존의 알고리즘에 ROI를 적용한 방식을 병렬로 처리함으로써 해결할 수 있다. 본 논문에서 제안하는 ROI-CENTRIST 기반 보행자 인식의 병렬처리 방식은 기존의 CENTRIST 기반 보행자 인식 방식보다 약 10% 향상된 5.2 fps의 성능을 보인다.

영상처리기법을 이용한 표면균열길이 측정 (Measurement of Surface Crack Length Using Image Processing Technology)

  • 남승훈;김용일;김시천;류대현
    • 대한기계학회:학술대회논문집
    • /
    • 대한기계학회 2001년도 춘계학술대회논문집A
    • /
    • pp.96-101
    • /
    • 2001
  • The development of a new experimental method is required to easily observe the growth behavior of fatigue cracks. To satisfy the requirement, an image processing technique was introduced to fatigue testing. The length of surface fatigue crack could be successfully measured by the image processing system. At first, the image data of cracks were stored into the computer while the cyclic loading was interrupted. After testing, crack length was determined using image processing software which was developed by ourselves. Block matching method was applied to the detection of surface fatigue cracks. By comparing the data measured by image processing system with the data measured by manual measurement with a microscope, the effectiveness of the image processing system was established. If the proposed method is used to monitor and observe the crack growth behavior automatically, the time and efforts for fatigue test could be dramatically reduced.

  • PDF

화상처리에 의한 XLPE의 트리열화관측 (Tree aging observation of XLPE by image processing)

  • 임장섭;김태성;길촌승
    • E2M - 전기 전자와 첨단 소재
    • /
    • 제8권5호
    • /
    • pp.551-557
    • /
    • 1995
  • For the observation of treeing, a visual measurement with an optical microscope has been used to explain breakdown mechanism in high-voltage systems. The conventional directed visual method of tree aging observation is difficult to measure in short time processing, and it is impossible to analyze on tree degradation area, progressed direction, tree pattern, etc. By using an image processing technique, the tree features which appear immediately after the tree initiation as well as changes in the configuration of the tree can be easily measured and observed than using the conventional visual methods. In this paper, we have developed a tree observating system by using image processing for tree growth, degradation area and other treeing progress. As an experimental result, it can be concluded that the image processing method is a more effective alternative than directed visual observation method. As a matter of fact, it is possible to record the image of tree propagation immediately after its first appearance and explain the characteristics of tree growth froth the computer processing image.

  • PDF

실내공간에 사용되는 재활용 신재료의 소재 및 가공방법 연구 (A Study on the Base Material Specific and Processing Methods of Recycled New Materials in Space)

  • 서지은;정희정
    • 한국실내디자인학회논문집
    • /
    • 제21권3호
    • /
    • pp.22-30
    • /
    • 2012
  • Nowadays the issue of environmental pollution and ecological destruction is not a simple issue but an important issue to be continuously considered. It is deemed that a study for recycled new materials is immediately required and this study is to analyze features and processing methods of new materials which can be used to interior space. We found the recycled new materials used for space through researching various web sits. And then we analyzed what the base materials are and classified that base materials are whether natural or artificial of the recycled materials. We classified processing methods of the recycled new materials after researching general processing methods. The result of this study would be an important material to the research and development of new finishing materials with consideration of environment and to the research for a guideline of applicable new materials. The results of this study are as follows : First, we could classify widely 2 categories into natural material and artificial material and then 10 subcategories into metal, glass, wood, rubber, stone, plastic, leather or fabric, ceramic, concrete and so on, and analyzed that which material is mostly used and whether it is single material or multiple material. In order to analyze the feature of processing method. Second, we could classify into 4 categories such as junction, surface process, molding, and insert, and found out which processing method is applied based on objects of research. Third, as an analysis result of the recycled new material feature, in order to develop various new materials, it is required to study on combination and application of 2 materials or more rather than single material. Four, as a analysis result of the processing method feature, I would like to suggest that development and application of various processing methods are required. Especially, it is necessary to grope for a way to develop new functional materials for interior space through a systemic research and analysis of processing method of other fields. Furthermore, a way to reuse recycled new materials should be considered in a stage of selection and application of processing method.

  • PDF