• ETRI Journal
• /
• v.41 no.4
• /
• pp.437-451
• /
• 2019

Outlier detection techniques play an important role in enhancing the reliability of data communication in wireless sensor networks (WSNs). Considering the importance of outlier detection in WSNs, many outlier detection techniques have been proposed. Unfortunately, most of these techniques still have some potential limitations, that is, (a) high rate of false positives, (b) high time complexity, and (c) failure to detect outliers online. Moreover, these approaches mainly focus on either temporal outliers or spatial outliers. Therefore, this paper aims to introduce novel algorithms that successfully detect both temporal outliers and spatial outliers. Our contributions are twofold: (i) modifying the Hampel Identifier (HI) algorithm to achieve high accuracy identification rate in temporal outlier detection, (ii) combining the Gaussian process (GP) model and graph-based outlier detection technique to improve the performance of the algorithm in spatial outlier detection. The results demonstrate that our techniques outperform the state-of-the-art methods in terms of accuracy and work well with various data types.

• The Korean Journal of Applied Statistics
• /
• v.17 no.2
• /
• pp.327-336
• /
• 2004

Many researchers have used the robust variogram to reduce the effect of outliers in spatial data analysis. Recently it is known that estimating the variogram after replacing outliers is more efficient. In this paper, we suggest a new data cleaner for geostatistic data analysis and compare the efficiency of outlier cleaners.

• Atmosphere
• /
• v.22 no.3
• /
• pp.299-307
• /
• 2012

This study is aimed to validate errors for detected suspicious temperature data using various quality control procedures for 61 weather stations in the Republic of Korea. The quality control algorithms for temperature data consist of four main procedures (high-low extreme check, internal consistency check, temporal outlier check, and spatial outlier check). Errors of detected suspicious temperature data are judged by examining temperature data of nearby stations, surface weather charts, hourly temperature data, daily precipitation, and daily maximum wind direction. The number of detected errors in internal consistency check and spatial outlier check showed 4 days (3 stations) and 7 days (5 stations), respectively. Effective and objective methods for validation errors through this study will help to reduce manpower and time for conduct of quality management for temperature data.

• Proceedings of the KSRS Conference
• /
• v.2
• /
• pp.574-577
• /
• 2006

In this paper, we developed a forest fire detection algorithm which uses a regression function between NDVI and land surface temperature. Previous detection algorithms use the land surface temperature as a main factor to discriminate fire pixels from non-fire pixels. These algorithms assume that the surface temperatures of non-fire pixels are intrinsically analogous and obey Gaussian normal distribution, regardless of land surface types and conditions. And the temperature thresholds for detecting fire pixels are derived from the statistical distribution of non-fire pixels’ temperature using heuristic methods. This assumption makes the temperature distribution of non-fire pixels very diverse and sometimes slightly overlapped with that of fire pixel. So, sometimes there occur omission errors in the cases of small fires. To ease such problem somewhat, we separated non-fire pixels into each land cover type by clustering algorithm and calculated the residuals between the temperature of a pixel under examination whether fire pixel or not and estimated temperature of the pixel using the linear regression between surface temperature and NDVI. As a result, this algorithm could modify the temperature threshold considering land types and conditions and showed improved detection accuracy.

• Spatial Information Research
• /
• v.12 no.4 s.31
• /
• pp.339-349
• /
• 2004

Outliers in spatial databases uuluence on the performance of spatial indexing methods including R-tree. They enlarge the size and overlapping area of MBRs in R-tree which are important factors in determining the performance. In this paper, we give an analysis of outlier effects on R-tree by analytical and experimental work, and propose a method for properly handling outliers. Our experimental results show that our method improves about 15 percents of the performance.

• Journal of applied mathematics & informatics
• /
• v.4 no.2
• /
• pp.419-432
• /
• 1997

A robust estimator for interpolating spatially distributed regionalized variables is introduced. It reduces outlier effects on ob-taining correlation between spatial lags and the correlation between spatial lags and the corresponding semi-variances and produces a significaantly improved semivariogram com-pared with those of conventional estimators. This estimator is applied to a field experimental data set.

• Proceedings of the IEEK Conference
• /
• 2003.11a
• /
• pp.11-14
• /
• 2003

In block-based lossy video compression, severe quantization causes discontinuities along block boundaries so that annoying blocking artifacts are visible in decoded video imases. These blocking artifacts significantly decrease the subjective image quality. In order to reduce the blocking artifacts in decoded images, many algorithms have been proposed However studies on so called, corner outliers, have been very limited. Corner outliers make image edges look disconnected from those of neighboring blocks at cross block boundary. In order to solve this problem, we propose a corner outlier detection and compensation algorithm as post-processing in spatial domain The experiment results show that the proposed method provides much improved subjective image quality.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.41 no.5
• /
• pp.217-223
• /
• 2004

In block-based lossy video compression, severe quantization causes discontinuities along block boundaries so that annoying blocking artifacts are visible in decoded video images. These blocking artifacts significantly decrease the subjective image quality. In order to reduce the blocking artifacts in decoded images, many algorithms have been proposed. However studies on so called comer outlier, have been very limited. Corner outliers make image edges look disconnected from those of neighboring blocks at cross block boundary. In order to solve this problem we propose a corner outlier detection and compensation algorithm as loop-filtering in spatial domain. Experiment results show that the proposed method provides much improved subjective image quality.

• Economic and Environmental Geology
• /
• v.28 no.3
• /
• pp.271-277
• /
• 1995

The geological information analysis based on spatial statistical techniques have been studied in relation to mineral exploration. The applicability of outlier detection using moving-window statistics and directional cross-variography analysis have been verified by using geochemical data sets surveyed in the Taebaek area for mineral exploration. The directional variogram analysis has been basically known as a geostatistical method for spatial continuity measures. In this study, the application of this proposed method was extended to measure spatial correlation or similarity problems between two geochemical elements. For the appraisal of the usefulness of this scheme, five kinds of variogram functions were computed for original data and revised data, obtained by removing outliers detected by moving-window statistics and the results were compared. It is concluded that these advanced spatial statistical methods at the interpretation stage of spatial similarity provide us with valuable quantitative results as decision-supporting information for regional mineral exploration task.

• Journal of the Korean Geotechnical Society
• /
• v.27 no.7
• /
• pp.59-68
• /
• 2011

Subsurface Investigation results always reflect a level of soil uncertainty, which sometimes requires statistical corrections of the data for the appropriate engineering decision. This study suggests a closed-form framework to extract the outlying data points from the testing results using the statistical geo-spatial information analyses with outlier analysis and kring-based crossvalidation. The suggested analysis method is conducted to soil stratification using the borehole data in Yeouido.