• Journal of applied mathematics & informatics
• /
• v.33 no.3_4
• /
• pp.387-399
• /
• 2015

In this paper, a new smoothing approximation to the l₁ exact penalty function for constrained optimization problems (COP) is presented. It is shown that an optimal solution to the smoothing penalty optimization problem is an approximate optimal solution to the original optimization problem. Based on the smoothing penalty function, an algorithm is presented to solve COP, with its convergence under some conditions proved. Numerical examples illustrate that this algorithm is efficient in solving COP.

• Communications for Statistical Applications and Methods
• /
• v.20 no.6
• /
• pp.481-490
• /
• 2013

Classification is an important research area as data can be easily obtained even if the number of predictors becomes huge. The support vector machine(SVM) is widely used to classify a subject into a predetermined group because it gives sound theoretical background and better performance than other methods in many applications. The SVM can be viewed as a penalized method with the hinge loss function and penalty functions. Instead of $L_2$ penalty function Fan and Li (2001) proposed the smoothly clipped absolute deviation(SCAD) satisfying good statistical properties. Despite the ability of SVMs, they have drawbacks of non-robustness when there are outliers in the data. We develop a robust SVM method using a weight function with the SCAD penalty function based on the local quadratic approximation. We compare the performance of the proposed SVM with the SVM using the $L_1$ and $L_2$ penalty functions.

• Journal of Biomedical Engineering Research
• /
• v.38 no.5
• /
• pp.219-226
• /
• 2017

Penalized-likelihood (PL) reconstruction methods for transmission tomography are known to provide improved image quality for reduced dose level by efficiently smoothing out noise while preserving edges. Unfortunately, however, most of the edge-preserving penalty functions used in conventional PL methods contain at least one free parameter which controls the shape of a non-quadratic penalty function to adjust the sensitivity of edge preservation. In this work, to avoid difficulties in finding a proper value of the free parameter involved in a non-quadratic penalty function, we propose a new adaptive method of space-variant smoothing with a simple quadratic penalty function. In this method, the smoothing parameter is adaptively selected for each pixel location at each iteration by using the image roughness measured by a pixel-wise standard deviation image calculated from the previous iteration. The experimental results demonstrate that our new method not only preserves edges, but also suppresses noise well in monotonic regions without requiring additional processes to select free parameters that may otherwise be included in a non-quadratic penalty function.

• Journal of the Korean Data and Information Science Society
• /
• v.27 no.6
• /
• pp.1653-1660
• /
• 2016

Smoothly clipped absolute deviation (SCAD) penalty is known to satisfy the desirable properties for penalty functions like as unbiasedness, sparsity and continuity. In this paper, we deal with the regression function estimation and variable selection based on SCAD penalized censored regression model. We use the local linear approximation and the iteratively reweighted least squares algorithm to solve SCAD penalized log likelihood function. The proposed method provides an efficient method for variable selection and regression function estimation. The generalized cross validation function is presented for the model selection. Applications of the proposed method are illustrated through the simulated and a real example.

• Communications for Statistical Applications and Methods
• /
• v.22 no.1
• /
• pp.41-54
• /
• 2015

In this article, we propose nonconcave penalties on a reduced-rank regression model to select variables and estimate coefficients simultaneously. We apply HARD (hard thresholding) and SCAD (smoothly clipped absolute deviation) symmetric penalty functions with singularities at the origin, and bounded by a constant to reduce bias. In our simulation study and real data analysis, the new method is compared with an existing variable selection method using $L_1$ penalty that exhibits competitive performance in prediction and variable selection. Instead of using only one type of penalty function, we use two or three penalty functions simultaneously and take advantages of various types of penalty functions together to select relevant predictors and estimation to improve the overall performance of model fitting.

• Journal of applied mathematics & informatics
• /
• v.29 no.5_6
• /
• pp.1533-1539
• /
• 2011

In this paper, a class of nonlinear bilevel programs, i.e. the lower level problem is linear programs, is considered. Aiming at this special structure, we append the duality gap of the lower level problem to the upper level objective with a penalty and obtain a penalized problem. Using the penalty method, we give an existence theorem of solution and propose an algorithm. Then, a numerical example is given to illustrate the algorithm.

• Journal of the Korean Data and Information Science Society
• /
• v.22 no.3
• /
• pp.613-618
• /
• 2011

The proposed method is based on a penalized log partial likelihood of Cox proportional hazard model with L1-penalty. We use the iteratively reweighted least squares procedure to solve L1 penalized log partial likelihood function of Cox proportional hazard model. It provide the ecient computation including variable selection and leads to the generalized cross validation function for the model selection. Experimental results are then presented to indicate the performance of the proposed procedure.

• Communications for Statistical Applications and Methods
• /
• v.19 no.5
• /
• pp.655-662
• /
• 2012

Classification is an important research field in pattern recognition with high-dimensional predictors. The support vector machine(SVM) is a penalized feature selector and classifier. It is based on the hinge loss function, the non-convex penalty function, and the smoothly clipped absolute deviation(SCAD) suggested by Fan and Li (2001). We developed the algorithm for the multiclass SVM with the SCAD penalty function using the local quadratic approximation. For multiclass problems we compared the performance of the SVM with the $L_1$, $L_2$ penalty functions and the developed method.

• Geomechanics and Engineering
• /
• v.15 no.4
• /
• pp.947-955
• /
• 2018

In this study, we propose a three-dimensional simplified slope stability analysis using a hybrid-type penalty method (HPM). In this method, a solid element obtained by the HPM is applied to a column that divides the slope into a lattice. Therefore, it can obtain a safety factor in the same way as simplified methods on the slip surface. Furthermore, it can obtain results (displacement and strain) that cannot be obtained by conventional limit equilibrium methods such as the Hovland method. The continuity condition of displacement between adjacent columns and between elements for each depth is considered to incorporate a penalty function and the relative displacement. For a slip surface between the bottom surface and the boundary condition to express the slip of slope, we introduce a penalty function based on the Mohr-Coulomb failure criterion. To compute the state of the slip surface, an r-min method is used in the load incremental method. Using the result of the simple three-dimensional slope stability analysis, we obtain a safety factor that is the same as the conventional method. Furthermore, the movement of the slope was calculated quantitatively and qualitatively because the displacement and strain of each element are obtained.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.65 no.4
• /
• pp.547-554
• /
• 2016

Analyze the customer daily load patterns, be used to determine the optimal charging and discharging schedule which can minimize the electrical charges through the battery energy storage system(BESS) installed in consumers is an object of this paper. BESS, which analyzes the load characteristics of customer and reduce the peak load, is essential for optimal charging and discharging scheduling to save electricity charges. This thesis proposes optimal charging and discharging scheduling method, using particle swarm optimization (PSO) and penalty function method, of BESS for reducing energy charge. Since PSO is a global optimization algorithm, best charging and discharging scheduling can be found effectively. In addition, penalty function method was combined with PSO in order to handle many constraint conditions. After analysing the load patterns of target BESS, PSO based on penalty function method was applied to get optimal charging and discharging schedule.