• Title/Summary/Keyword: conjugate gradients

Search Result 17, Processing Time 0.019 seconds

A Deflation-Preconditioned Conjugate Gradient Method for Symmetric Eigenproblems

  • Jang, Ho-Jong
    • Journal of applied mathematics & informatics
    • /
    • v.9 no.1
    • /
    • pp.331-339
    • /
    • 2002
  • A preconditioned conjugate gradient(PCG) scheme with the aid of deflation for computing a few of the smallest eigenvalues arid their corresponding eigenvectors of the large generalized eigenproblems is considered. Topically there are two types of deflation techniques, the deflation with partial shifts and an arthogonal deflation. The efficient way of determining partial shifts is suggested and the deflation-PCG schemes with various partial shifts are investigated. Comparisons of theme schemes are made with orthogonal deflation-PCG, and their asymptotic behaviors with restart operation are also discussed.

NUMERICAL STABILITY OF UPDATE METHOD FOR SYMMETRIC EIGENVALUE PROBLEM

  • Jang Ho-Jong;Lee Sung-Ho
    • Journal of applied mathematics & informatics
    • /
    • v.22 no.1_2
    • /
    • pp.467-474
    • /
    • 2006
  • We present and study the stability and convergence of a deflation-preconditioned conjugate gradient(PCG) scheme for the interior generalized eigenvalue problem $Ax = {\lambda}Bx$, where A and B are large sparse symmetric positive definite matrices. Numerical experiments are also presented to support our theoretical results.

PERTURBATION ANALYSIS OF DEFLATION TECHNIQUE FOR SYMMETRIC EIGENVALUE PROBLEM

  • JANG, HO-JONG
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.5 no.2
    • /
    • pp.17-23
    • /
    • 2001
  • The evaluation of a few of the smallest eigenpairs of large symmetric eigenvalue problem is of great interest in many physical and engineering applications. A deflation-preconditioned conjugate gradient(PCG) scheme for a such problem has been shown to be very efficient. In the present paper we provide the numerical stability of a deflation-PCG with partial shifts.

  • PDF

BACKPROPAGATION BASED ON THE CONJUGATE GRADIENT METHOD WITH THE LINEAR SEARCH BY ORDER STATISTICS AND GOLDEN SECTION

  • Choe, Sang-Woong;Lee, Jin-Choon
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.06a
    • /
    • pp.107-112
    • /
    • 1998
  • In this paper, we propose a new paradigm (NEW_BP) to be capable of overcoming limitations of the traditional backpropagation(OLD_BP). NEW_BP is based on the method of conjugate gradients with the normalized direction vectors and computes step size through the linear search which may be characterized by order statistics and golden section. Simulation results showed that NEW_BP was definitely superior to both the stochastic OLD_BP and the deterministic OLD_BP in terms of accuracy and rate of convergence and might sumount the problem of local minima. Furthermore, they confirmed us that stagnant phenomenon of training in OLD_BP resulted from the limitations of its algorithm in itself and that unessential approaches would never cured it of this phenomenon.

  • PDF

Buckling analysis of FGM Euler-Bernoulli nano-beams with 3D-varying properties based on consistent couple-stress theory

  • Hadi, Amin;Nejad, Mohammad Zamani;Rastgoo, Abbas;Hosseini, Mohammad
    • Steel and Composite Structures
    • /
    • v.26 no.6
    • /
    • pp.663-672
    • /
    • 2018
  • This paper contains a consistent couple-stress theory to capture size effects in Euler-Bernoulli nano-beams made of three-directional functionally graded materials (TDFGMs). These models can degenerate into the classical models if the material length scale parameter is taken to be zero. In this theory, the couple-stress tensor is skew-symmetric and energy conjugate to the skew-symmetric part of the rotation gradients as the curvature tensor. The material properties except Poisson's ratio are assumed to be graded in all three axial, thickness and width directions, which it can vary according to an arbitrary function. The governing equations are obtained using the concept of minimum potential energy. Generalized differential quadrature method (GDQM) is used to solve the governing equations for various boundary conditions to obtain the natural frequencies of TDFG nano-beam. At the end, some numerical results are performed to investigate some effective parameter on buckling load. In this theory the couple-stress tensor is skew-symmetric and energy conjugate to the skew-symmetric part of the rotation gradients as the curvature tensor.

FIRST ORDER GRADIENT OPTIMIZATION IN LISP

  • Stanimirovic, Predrag;Rancic, Svetozar
    • Journal of applied mathematics & informatics
    • /
    • v.5 no.3
    • /
    • pp.701-716
    • /
    • 1998
  • In this paper we develop algorithms in programming lan-guage SCHEME for implementation of the main first order gradient techniques for unconstrained optimization. Implementation of the de-scent techniques which use non-optimal descent steps as well as imple-mentation of the optimal descent techniques are described. Also we investigate implementation of the global problem called optimization along a line. Developed programs are effective and simpler with re-spect to the corresponding in the procedural programming languages. Several numerical examples are reported.

Enhanced Backpropagation : Algorithm and Numeric Examples (개선된 역전파법 : 알고리즘과 수치예제)

  • Han Hong-Su;Choi Sang-Ung;Jeong Hyeon-Sik;No Jeong-Gu
    • Management & Information Systems Review
    • /
    • v.2
    • /
    • pp.75-93
    • /
    • 1998
  • In this paper, we propose a new algorithm(N_BP) to be capable of overcoming limitations of the traditional backpropagation(O_BP). The N_BP is based on the method of conjugate gradients and calculates learning parameters through the line search which may be characterized by order statistics and golden section. Experimental results showed that the N_BP was definitely superior to the O_BP with and without a stochastic term in terms of accuracy and rate of convergence and might surmount the problem of local minima. Furthermore, they confirmed us that the stagnant phenomenon of learning in the O_BP resulted from the limitations of its algorithm in itself and that unessential approaches would never cured it of this phenomenon.

  • PDF

A dynamic analysis algorithm for RC frames using parallel GPU strategies

  • Li, Hongyu;Li, Zuohua;Teng, Jun
    • Computers and Concrete
    • /
    • v.18 no.5
    • /
    • pp.1019-1039
    • /
    • 2016
  • In this paper, a parallel algorithm of nonlinear dynamic analysis of three-dimensional (3D) reinforced concrete (RC) frame structures based on the platform of graphics processing unit (GPU) is proposed. Time integration is performed using Newmark method for nonlinear implicit dynamic analysis and parallelization strategies are presented. Correspondingly, a parallel Preconditioned Conjugate Gradients (PCG) solver on GPU is introduced for repeating solution of the equilibrium equations for each time step. The RC frames were simulated using fiber beam model to capture nonlinear behaviors of concrete and reinforcing bars. The parallel finite element program is developed utilizing Compute Unified Device Architecture (CUDA). The accuracy of the GPU-based parallel program including single precision and double precision was verified in comparison with ABAQUS. The numerical results demonstrated that the proposed algorithm can take full advantage of the parallel architecture of the GPU, and achieve the goal of speeding up the computation compared with CPU.

Matrix Completion Algorithm for Internet of Things Localization (사물 인터넷의 최적화를 위한 행렬 완성 알고리듬)

  • Nguyen, Luong Trung;Shim, Byonghyo
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2015.11a
    • /
    • pp.4-7
    • /
    • 2015
  • In this paper, we propose a matrix completion algorithm for Internet of Things (IoT) localization. The proposed algorithm recovers the Gram matrix of sensors by performing optimization over the Riemannian manifold of fixed-rank positive semidefinite matrices. We compute and show the closed forms of all the differentially geometric components required for applying nonlinear conjugate gradients combined with Armijo line search method. The numerical experiments show that the performance of the proposed algorithm in solving IoT localization is outstanding compared with the state-of-the-art matrix completion algorithms both in noise and noiseless scenarios.

  • PDF

The Iterated Ritz Method: Basis, implementation and further development

  • Dvornik, Josip;Lazarevic, Damir;Uros, Mario;Novak, Marta Savor
    • Coupled systems mechanics
    • /
    • v.7 no.6
    • /
    • pp.755-774
    • /
    • 2018
  • The Ritz method is known as very successful strategy for discretizing continuous problems, but it has never been used for solving systems of algebraic equations. The Iterated Ritz Method (IRM) is a novel iterative solver based on the discretized Ritz procedure applied at each iteration step. With an appropriate choice of coordinate vectors, the method may be efficient in linear, nonlinear and optimization problems. Additionally, some iterative methods can be explained as special cases of this approach, which helps to understand advantages and limitations of these methods and gives motivation for their improvement in sense of IRM. In this paper, some ideas for generation of efficient coordinate vectors are presented. The algorithm was developed and tested independently and then implemented into the open source program FEAP. Method has been successfully applied to displacement based (even ill-conditioned) models of structural engineering practice. With this original approach, a new iterative solution strategy has been opened.