• Title/Summary/Keyword: accuracy

Search Result 33,382, Processing Time 0.057 seconds

Voting and Ensemble Schemes Based on CNN Models for Photo-Based Gender Prediction

  • Jhang, Kyoungson
    • Journal of Information Processing Systems
    • /
    • v.16 no.4
    • /
    • pp.809-819
    • /
    • 2020
  • Gender prediction accuracy increases as convolutional neural network (CNN) architecture evolves. This paper compares voting and ensemble schemes to utilize the already trained five CNN models to further improve gender prediction accuracy. The majority voting usually requires odd-numbered models while the proposed softmax-based voting can utilize any number of models to improve accuracy. The ensemble of CNN models combined with one more fully-connected layer requires further tuning or training of the models combined. With experiments, it is observed that the voting or ensemble of CNN models leads to further improvement of gender prediction accuracy and that especially softmax-based voters always show better gender prediction accuracy than majority voters. Also, compared with softmax-based voters, ensemble models show a slightly better or similar accuracy with added training of the combined CNN models. Softmax-based voting can be a fast and efficient way to get better accuracy without further training since the selection of the top accuracy models among available CNN pre-trained models usually leads to similar accuracy to that of the corresponding ensemble models.

Finding Unexpected Test Accuracy by Cross Validation in Machine Learning

  • Yoon, Hoijin
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.12spc
    • /
    • pp.549-555
    • /
    • 2021
  • Machine Learning(ML) splits data into 3 parts, which are usually 60% for training, 20% for validation, and 20% for testing. It just splits quantitatively instead of selecting each set of data by a criterion, which is very important concept for the adequacy of test data. ML measures a model's accuracy by applying a set of validation data, and revises the model until the validation accuracy reaches on a certain level. After the validation process, the complete model is tested with the set of test data, which are not seen by the model yet. If the set of test data covers the model's attributes well, the test accuracy will be close to the validation accuracy of the model. To make sure that ML's set of test data works adequately, we design an experiment and see if the test accuracy of model is always close to its validation adequacy as expected. The experiment builds 100 different SVM models for each of six data sets published in UCI ML repository. From the test accuracy and its validation accuracy of 600 cases, we find some unexpected cases, where the test accuracy is very different from its validation accuracy. Consequently, it is not always true that ML's set of test data is adequate to assure a model's quality.

Deep learning improves implant classification by dental professionals: a multi-center evaluation of accuracy and efficiency

  • Lee, Jae-Hong;Kim, Young-Taek;Lee, Jong-Bin;Jeong, Seong-Nyum
    • Journal of Periodontal and Implant Science
    • /
    • v.52 no.3
    • /
    • pp.220-229
    • /
    • 2022
  • Purpose: The aim of this study was to evaluate and compare the accuracy performance of dental professionals in the classification of different types of dental implant systems (DISs) using panoramic radiographic images with and without the assistance of a deep learning (DL) algorithm. Methods: Using a self-reported questionnaire, the classification accuracy of dental professionals (including 5 board-certified periodontists, 8 periodontology residents, and 31 dentists not specialized in implantology working at 3 dental hospitals) with and without the assistance of an automated DL algorithm were determined and compared. The accuracy, sensitivity, specificity, confusion matrix, receiver operating characteristic (ROC) curves, and area under the ROC curves were calculated to evaluate the classification performance of the DL algorithm and dental professionals. Results: Using the DL algorithm led to a statistically significant improvement in the average classification accuracy of DISs (mean accuracy: 78.88%) compared to that without the assistance of the DL algorithm (mean accuracy: 63.13%, P<0.05). In particular, when assisted by the DL algorithm, board-certified periodontists (mean accuracy: 88.56%) showed higher average accuracy than did the DL algorithm, and dentists not specialized in implantology (mean accuracy: 77.83%) showed the largest improvement, reaching an average accuracy similar to that of the algorithm (mean accuracy: 80.56%). Conclusions: The automated DL algorithm classified DISs with accuracy and performance comparable to those of board-certified periodontists, and it may be useful for dental professionals for the classification of various types of DISs encountered in clinical practice.

A Study on the Test Workpiece for Accuracy Evaluation of 5-Axis Machine Tool (5축 공작기계 정밀도 평가를 위한 표준 공작물에 관한 연구)

  • Youn, Jae-Woong;Kim, Ki-Hwan;Park, Jong Tak
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.31 no.5
    • /
    • pp.431-439
    • /
    • 2014
  • Recently, a demand for precision 5-axis machine tools is significantly increasing, and the maintenance of machine tool accuracy becomes more important. it is very difficult to evaluate to accuracy of 5-axis M/C in the production site since it needs expensive measuring equipment and skilled engineer. On the other hand, evaluation items of 5-axis M/C are not systematically organized in the existing KS and ISO standards. In this study, the evaluation items for 5-axis M/C were derived systematically and a test workpiece was developed to evaluate the machine tool accuracy more easily. The error sources of machine tool can be estimated by machining and measuring of the test workpiece. The correlation between the machine tool accuracy and the accuracy of machined test workpiece was analyzed. As a result, the accuracy of machined test workpiece represented the accuracy of machine tool and the error sources very effectively.

A Study on Accuracy Estimation of Service Model by Cross-validation and Pattern Matching

  • Cho, Seongsoo;Shrestha, Bhanu
    • International journal of advanced smart convergence
    • /
    • v.6 no.3
    • /
    • pp.17-21
    • /
    • 2017
  • In this paper, the service execution accuracy was compared by ontology based rule inference method and machine learning method, and the amount of data at the point when the service execution accuracy of the machine learning method becomes equal to the service execution accuracy of the rule inference was found. The rule inference, which measures service execution accuracy and service execution accuracy using accumulated data and pattern matching on service results. And then machine learning method measures service execution accuracy using cross validation data. After creating a confusion matrix and measuring the accuracy of each service execution, the inference algorithm can be selected from the results.

Measurement of Motion Accuracy by Two-dimensional Probe on NC Machine Tools -2nd Report, Measurement of the Linear Motion Accuracy- (2차원 프로브에 의한 NC공작기계의 운동 정밀도 측정 -제2보 직선운동 정밀도 측정-)

  • JEON, Eon Chan;OYAMADA, Shigenori;TSUTSUMI, Masaomi;KAKUTA, Junichro
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.14 no.7
    • /
    • pp.15-21
    • /
    • 1997
  • This paper presented a linear motion accuracy by using two-dimensional probe with the master block and the square for NC machine tools. This measuring system could be measured motion error due to numerical control system. The results of measurement and simulation for motion error were similar, and so, this system had enough accuracy to measure a linear motion accuracy for NC machine tools. The experimental results are as follows. 1. This measuring system could be measured motion error due to mumerical control system. 2. The results of measurement and simulation for motion error were similar. 3. This measuring system had enough accuracy to measure a linear motion accuracy for NC machine tools.

  • PDF

Development of association rule threshold by balancing of relative rule accuracy (상대적 규칙 정확도의 균형화에 의한 연관성 측도의 개발)

  • Park, Hee Chang
    • Journal of the Korean Data and Information Science Society
    • /
    • v.25 no.6
    • /
    • pp.1345-1352
    • /
    • 2014
  • Data mining is the representative methodology to obtain meaningful information in the era of big data.By Wikipedia, association rule learning is a popular and well researched method for discovering interesting relationship between itemsets in large databases using association thresholds. It is intended to identify strong rules discovered in databases using different interestingness measures. Unlike general association rule, inverse association rule mining finds the rules that a special item does not occur if an item does not occur. If two types of association rule can be simultaneously considered, we can obtain the marketing information for some related products as well as the information of specific product marketing. In this paper, we propose a balanced attributable relative accuracy applicable to these association rule techniques, and then check the three conditions of interestingness measures by Piatetsky-Shapiro (1991). The comparative studies with rule accuracy, relative accuracy, attributable relative accuracy, and balanced attributable relative accuracy are shown by numerical example. The results show that balanced attributable relative accuracy is better than any other accuracy measures.

Development and Comparative Analysis of Mapping Quality Prediction Technology Using Orientation Parameters Processed in UAV Software (무인기 소프트웨어에서 처리된 표정요소를 이용한 도화품질 예측기술 개발 및 비교분석)

  • Lim, Pyung-Chae;Son, Jonghwan;Kim, Taejung
    • Korean Journal of Remote Sensing
    • /
    • v.35 no.6_1
    • /
    • pp.895-905
    • /
    • 2019
  • Commercial Unmanned Aerial Vehicle (UAV) image processing software products currently used in the industry provides camera calibration information and block bundle adjustment accuracy. However, they provide mapping accuracy achievable out of input UAV images. In this paper, the quality of mapping is calculated by using orientation parameters from UAV image processing software. We apply the orientation parameters to the digital photogrammetric workstation (DPW) for verifying the reliability of the mapping quality calculated. The quality of mapping accuracy was defined as three types of accuracy: Y-parallax, relative model and absolute model accuracy. The Y-parallax is an accuracy capable of determining stereo viewing between stereo pairs. The Relative model accuracy is the relative bundle adjustment accuracy between stereo pairs on the model coordinates system. The absolute model accuracy is the bundle adjustment accuracy on the absolute coordinate system. For the experimental data, we used 723 images of GSD 5 cm obtained from the rotary wing UAV over an urban area and analyzed the accuracy of mapping quality. The quality of the relative model accuracy predicted by the proposed technique and the maximum error observed from the DPW showed precise results with less than 0.11 m. Similarly, the maximum error of the absolute model accuracy predicted by the proposed technique was less than 0.16 m.

The Accuracy analysis of a RFID-based Positioning System with Kalman-filter (칼만필터를 적용한 RFID-기반 위치결정 시스템의 정확도 분석)

  • Heo, Joon;Kim, Jung-Hwan;Sohn, Hong-Gyoo;Yun, Kong-Hyun
    • Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
    • /
    • 2007.04a
    • /
    • pp.447-450
    • /
    • 2007
  • Positioning technology for moving object is an important and essential component of ubiquitous. Also RFID(Radio Frequency IDentification) is a core technology of ubiquitous wireless communication. In this study we adapted kalman-filter theory to RFID-based Positioning System in order to trace a time-variant moving object and verify the positioning accuracy using RMSE (Roong technology for moving object is an important and essential component of ubiquitous Mean Square Error). The purpose of this study is to verify an effect of kalman-filter on the positioning accuracy and to analyze what does each design factor have an effect on the positioning accuracy by means of simulations and to suggest a standard of optimal design factor of a RFID-based Positioning System. From the results of simulations, Kalman-filer improved the positioning accuracy remarkably; the detection range of RFID tag is not a determining factor. The smaller standard deviation of detection range improves the positioning accuracy. However it accompanies a smaller fluctuation of the positioning accuracy. The larger detection rate of RFID tag yields the smaller fluctuation in the positioning accuracy and has more stable system and improves the positioning accuracy;

  • PDF

The Effect of firm-specifics on forecast accuracy: The case of IPO firms in Korea (코스닥 신규상장 기업의 특성에 따른 재무분석가의 이익예측력에 관한 연구)

  • Jeon, Seong il;Lee, Ki se
    • Knowledge Management Research
    • /
    • v.13 no.5
    • /
    • pp.1-13
    • /
    • 2012
  • This study investigates whether firm-specifics affect forecast accuracy using a sample of IPO firms in Korea. The forecasts accuracy can be differentiated depending on firm specifics. This study uses the foreign investor, intangible asset and patents as firm specifics. The analysts are divided into two groups by firm-specifies(foreign investors ratio of low and high, intangible asset ratio of low and high, patents of acquisition) and also examine the degree of analysts's forecast accuracy over the two groups. and examined the degree of the analysts' forecast accuracy over the two groups. The sample is composed of 460 IPO (Initial Public Offering) firms listed on the KOSDAQ (Korean Securities Dealers Automated Quotations) for the period from 2001 to 2009. The analysts' forecast accuracy is much higher in the group of high foreign investor but is lower in the group of high intangible assets and patents. Also, the group of high foreign investors respectively interacts with group of high intangible assets ratio and group of patents of acquisition. In result, The analysts' forecast accuracy is higher because foreign investor is decreased information asymmetry. This study compares suggests that patents may be helpful for predicting forecast accuracy.

  • PDF