• Journal of KIISE:Software and Applications
• /
• v.32 no.7
• /
• pp.674-682
• /
• 2005

This paper proposes classification of multi-spectral satellite image based on fusion of fuzzy G-K (Gustafson-Kessel) algorithm and PCM algorithm. The suggested algorithm establishes the initial cluster centers by selecting training data from each category, and then executes the fuzzy G-K algorithm. PCM algorithm perform using classification result of the fuzzy G-K algorithm. The classification categories are allocated to the corresponding category when the results of classification by fuzzy G-K algorithm and PCM algorithm belong to the same category. If the classification result of two algorithms belongs to the different category, the pixels are allocated by Bayesian maximum likelihood algorithm. Bayesian maximum likelihood algorithm uses the data from the interior of the average intracluster distance. The information of the pixels within the average intracluster distance has a positive normal distribution. It improves classification result by giving a positive effect in Bayesian maximum likelihood algorithm. The proposed method is applied to IKONOS and Landsat TM remote sensing satellite image for the test. As a result, the overall accuracy showed a better outcome than individual Fuzzy G-K algorithm and PCM algorithm or the conventional maximum likelihood classification algorithm.

• Journal of Korea Multimedia Society
• /
• v.8 no.12
• /
• pp.1565-1571
• /
• 2005

Images reconstructed with Maximum-Likelihood Expectation-Maximization (MLEM) algorithm have been observed to have checkerboard effects and have noise artifacts near edges as iterations proceed. To compensate this ill-posed nature, numerous penalized maximum-likelihood methods have been proposed. We suggest a simple algorithm of applying edge detecting process to the MLEM and Bayesian Expectation-Maximization (BEM) to reduce the noise artifacts near edges and remove checkerboard effects. We have shown by simulation that this algorithm removes checkerboard effects and improves the clarity of the reconstructed image and has good properties based on root mean square error (RMS).

• Communications for Statistical Applications and Methods
• /
• v.14 no.1
• /
• pp.111-119
• /
• 2007

In this paper, we develop a nonparametric Bayesian methodology of estimating an unknown distribution function F at the given survival time with current status data under the assumption of Dirichlet process prior on F. We compare our algorithm with the nonparametric maximum likelihood estimator through application to simulated data and real data.

• Communications for Statistical Applications and Methods
• /
• v.27 no.4
• /
• pp.469-486
• /
• 2020

Entropy is an important term in statistical mechanics that was originally defined in the second law of thermodynamics. In this paper, we consider the maximum likelihood estimation (MLE), maximum product spacings estimation (MPSE) and Bayesian estimation of the entropy of an inverse Weibull distribution (InW) under a generalized type I progressive hybrid censoring scheme (GePH). The MLE and MPSE of the entropy cannot be obtained in closed form; therefore, we propose using the Newton-Raphson algorithm to solve it. Further, the Bayesian estimators for the entropy of InW based on squared error loss function (SqL), precautionary loss function (PrL), general entropy loss function (GeL) and linex loss function (LiL) are derived. In addition, we derive the Lindley's approximate method (LiA) of the Bayesian estimates. Monte Carlo simulations are conducted to compare the results among MLE, MPSE, and Bayesian estimators. A real data set based on the GePH is also analyzed for illustrative purposes.

• Proceedings of the Korean Information Science Society Conference
• /
• 2007.06c
• /
• pp.263-266
• /
• 2007

This paper discusses the Bayesian statistical inference. This paper discusses the Bayesian inference, MCMC (Markov Chain Monte Carlo) integration, MCMC method, Metropolis-Hastings algorithm, Gibbs sampling, Maximum likelihood estimation, Expectation Maximization algorithm, missing data processing, and BMA (Bayesian Model Averaging). The Bayesian statistical inference is used to process a large amount of data in the areas of biology, medicine, bioengineering, science and engineering, and general data analysis and processing, and provides the important method to draw the optimal inference result. Lastly, this paper discusses the method of principal component analysis. The PCA method is also used for data analysis and inference.

• Journal of Korean Society for Quality Management
• /
• v.37 no.4
• /
• pp.16-22
• /
• 2009

The inflection S-shaped software reliability growth model (SRGM) proposed by Ohba(1984) is one of the most commonly used models and has been discussed by many authors. The main purpose of this paper is to estimate the parameters of Ohba's SRGM within the Bayesian framework by applying the Markov chain Monte Carlo techniques. While the maximum likelihood estimates for these parameters are well known, the Bayesian method for the inflection S-shaped SRGM have not been discussed in the literature. The proposed methods can be quite flexible depending on the choice of prior distributions for the parameters of interests. We also compare the Bayesian methods with the maximum likelihood method numerically based on the real data.

• Journal of the Korean Data Analysis Society
• /
• v.20 no.6
• /
• pp.2747-2757
• /
• 2018

We consider the MLE (maximum likelihood estimate) and Bayesian estimates of three-parameter bathtub-shaped lifetime distribution based on the progressive type II censoring with binomial removal. Jung, Chung (2018) proposed the three-parameter bathtub-shaped distribution which is the extension of the two-parameter bathtub-shaped distribution given by Zhang (2004). Jung, Chung (2018) investigated its properties and estimations. The maximum likelihood estimates are computed using Newton-Raphson algorithm. Also, Bayesian estimates are obtained under the balanced loss function using MCMC (Markov chain Monte Carlo) method. In particular, BSEL (balanced squared error loss) function is considered as a special form of balanced loss function given by Zellner (1994). For comparing theirs MLEs with the corresponding Bayes estimates, some simulations are performed. It shows that Bayes estimates is better than MLEs in terms of risks. Finally, concluding remarks are mentioned.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.26 no.5
• /
• pp.335-342
• /
• 2016

When dynamics changes occurred in an existing Bayesian Network (BN), the related parameters embedding on the BN have to be updated to new parameters adapting to changed patterns. In this case, these parameters have to be updated with the consideration of the causalities in the BN. This research suggests a framework for updating parameters dynamically using Expectation Maximization (EM) algorithm and Harmony Search (HS) algorithm among several Meta-Heuristics techniques. While EM is an effective algorithm for estimating hidden parameters, it has a limitation that the generated solution converges a local optimum in usual. In order to overcome the limitation, this paper applies HS for tracking the global optimum values of Maximum Likelihood Estimators (MLE) of parameters. The proposed method suggests a learning and propagation framework of BN with dynamic changes for overcoming disadvantages of EM algorithm and converging a global optimum value of MLE of parameters.

• Journal of Korea Water Resources Association
• /
• v.41 no.1
• /
• pp.35-47
• /
• 2008

The low flow analysis is an important part in water resources engineering. Also, the results of low flow frequency analysis can be used for design of reservoir storage, water supply planning and design, waste-load allocation, and maintenance of quantity and quality of water for irrigation and wild life conservation. Especially, for identification of the uncertainty in frequency analysis, the Bayesian approach is applied and compared with conventional methodologies in at-site low flow frequency analysis. In the first manuscript, the theoretical background for the Bayesian MCMC (Bayesian Markov Chain Monte Carlo) method and Metropolis-Hasting algorithm are studied. Two types of the prior distribution, a non-data- based and a data-based prior distributions are developed and compared to perform the Bayesian MCMC method. It can be suggested that the results of a data-based prior distribution is more effective than those of a non-data-based prior distribution. The acceptance rate of the algorithm is computed to assess the effectiveness of the developed algorithm. In the second manuscript, the Bayesian MCMC method using a data-based prior distribution and MLE(Maximum Likelihood Estimation) using a quadratic approximation are performed for the at-site low flow frequency analysis.

• Communications for Statistical Applications and Methods
• /
• v.23 no.2
• /
• pp.131-146
• /
• 2016

In research on behavioral studies, significant attention has been paid to the stage-sequential process for longitudinal data. Latent class profile analysis (LCPA) is an useful method to study sequential patterns of the behavioral development by the two-step identification process: identifying a small number of latent classes at each measurement occasion and two or more homogeneous subgroups in which individuals exhibit a similar sequence of latent class membership over time. Maximum likelihood (ML) estimates for LCPA are easily obtained by expectation-maximization (EM) algorithm, and Bayesian inference can be implemented via Markov chain Monte Carlo (MCMC). However, unusual properties in the likelihood of LCPA can cause difficulties in ML and Bayesian inference as well as estimation in small samples. This article describes and addresses erratic problems that involve conventional ML and Bayesian estimates for LCPA with small samples. We argue that these problems can be alleviated with a small amount of prior input. This study evaluates the performance of likelihood and MCMC-based estimates with the proposed prior in drawing inference over repeated sampling. Our simulation shows that estimates from the proposed methods perform better than those from the conventional ML and Bayesian method.