等几何分析的多重网格共轭梯度法

提高NURBS基函数阶数可以提高等几何分析的精度,同时也会降低多重网格迭代收敛速度.将共轭梯度法与多重网格方法相结合,提出了一种提高收敛速度的方法,该方法用共轭梯度法作为基础迭代算法,用多重网格进行预处理.对Poisson(泊松)方程分别用多重网格方法和多重网格共轭梯度法进行了求解,计算结果表明:等几何分析中采用高阶NURBS基函数处理三维问题时,多重网格共轭梯度法比多重网格法的收敛速度更快.     

一种求解鞍点问题的预处理并行算法

研究了一种求解鞍点问题的并行预处理变形共轭梯度算法.通过应用迭代法进行预处理后,再采用变形共轭梯度求解的模式.首先构造系数矩阵近似逆的多项式表达式,以此作为预处理矩阵的逆矩阵,对方程组进行预处理;然后采用变形共轭梯度法并行求解预处理后的线性方程组.为减少运算量,采用迭代方式并行计算多项式与向量的乘法运算.通过调整迭代次数,即调整多项式次数,检验各种次数的多项式进行预处理后的求解方程的效果.数值试验结果表明,该算法明显优于未预处理的变形共轭梯度法,且当预处理迭代次数取4时效果最好.     

一种求解大型Lyapunov矩阵方程的预处理并行算法

研究了一种求解大型Lyapunov矩阵方程的并行预处理变形共轭梯度法.首先将处理小型矩阵方程的Smith预处理方法引入该问题的求解,将原矩阵方程转变为Stein方程,然后采用变形共轭梯度法并行求解预处理后的矩阵方程.其中遇到的难点是需要确定参数μ及求矩阵(A+μI)的逆.基于估计特征值的Gerschgorin圆定理给出了参数μ的估值,再采用变形共轭梯度法并行求得矩阵(A +μ l)的逆,从而形成预处理后的矩阵方程.通过数值试验,该算法与未预处理的变形共轭梯度法相比较,预处理算法明显优于未预处理的算法,而且其并行效率高达0.85.     

求解三维Wilson元离散化线性系统的PCG方法

非协调元方法是克服三维弹性问题体积闭锁的一种有效方法,它具有自由度少、精度高等优点,但要提高其有限元分析的整体效率还必须为相应的离散化系统设计快速求解算法.考虑了Wilson元离散化系统的快速求解.当Poisson(泊松)比ν→0.5时,该离散系统为一高度病态的正定方程组,预处理共轭梯度(PCG)法是求解这类方程组最为有效的方法之一.另外,在实际应用中,由于结构的特殊性,网格剖分时常常会产生具有大长宽比的各向异性网格,这也将大大影响PCG法的收敛性.该文设计了一种基于"距离矩阵"的代数多重网格(DAMG)法的PCG法,并应用于近不可压缩问题Wilson元离散系统的求解.这种基于"距离矩阵"的代数多重网格法,能更有效地求解各向异性网格问题,再结合有效的磨光算子,相应的PCG法对求解近不可压缩问题具有很好的鲁棒性(robustness)和高效性.     

径向基函数在非线性PDE形状优化中的应用

提出了一种求解非线性偏微分方程形状优化问题的径向基函数方法.灵敏度分析结果采用的共轭方法;形状的演化通过最优性准则方法得到;控制方程和共轭方程的求解用的是径向基函数方法.由于径向基函数方法是真正的无网格方法,比网格依赖方法有更好的适应性.提供的数值算例说明了所提算法的稳定性和有效性.此外,所得方法可以灵活地与其他优化算法相结合,从而可以解决更复杂的非线性偏微分方程中的最优形状设计问题.     

求解非线性等式和不等式约束优化问题的三项记忆梯度广义投影算法

利用广义投影矩阵，对求解无约束规划的三项记忆梯度算法中的参数给一条件，确定它们的取值范围，以保证得到目标函数的三项记忆梯度广义投影下降方向，建立了求解非线性等式和不等式约束优化问题的三项记忆梯度广义投影算法，并证明了算法的收敛性．同时给出了结合FR，PR，HS共轭梯度参数的三项记忆梯度广义投影算法，从而将经典的共轭梯度算法推广用于求解约束规划问题．数值例子表明算法是有效的．     

一类新型DL共轭梯度法研究

提出了求解无约束优化问题的新型DL共轭梯度方法. 同已有方法不同之处在于,该方法构造了一种修正的Armijo线搜索规则,它不仅能给出当前迭代步步长, 而且还能同时确定计算下一步搜索方向时需要用到的共轭参数值. 在较弱的条件下, 建立了算法的全局收敛性理论. 数值试验表明,新型共轭梯度算法比同类方法具有更好的计算效率.     

基于代数神经网络的煤自燃预测

代数神经网络算法能够克服BP神经网络易于陷入局部极小和收敛慢的问题,通过优选激励函数和采用代数算法计算权值,将复杂的非线性优化问题转化为简单的代数方程组求解问题,提高了神经网络的精度与收敛速度.在使用代数神经网络算法进行煤自燃预测的实例中,采用均值规格化数据预处理,解决了煤自燃指标气体异动对分类结果的过度扰动.实验结果表明了算法的有效性和实用性.     

二维椭圆型方程反问题中优化算法的比较

近年来，决定椭圆型方程系数反问题在地磁、地球物理、冶金和生物等实际问题上有着广泛的应用．本文讨论了二维的决定椭圆型方程系数反问题的数值求解方法．由误差平方和最小原则，这个反问题可化为一个变分问题，并进一步离散化为一个最优化问题，其目标函数依赖于要决定的方程系数．本文着重考察非线性共轭梯度法在此最优化问题数值计算中的表现，并与拟牛顿法作为对比．为了提高算法的效率我们适当选择加快收敛速度的预处理矩阵．同时还考察了线搜索方法的不同对优化算法的影响．数值实验的结果表明，非线性共轭梯度法在这类大规模优化问题中相对于拟牛顿法更有效．     

一个求解非线性不等式约束优化问题的带有共轭梯度参数的广义梯度投影算法

本文提出一个求解非线性不等式约束优化问题的带有共轭梯度参数的广义梯度投影算法.算法中的共轭梯度参数是很容易得到的,且算法的初始点可以任意选取.而且,由于算法仅使用前一步搜索方向的信息,因而减少了计算量.在较弱条件下得到了算法的全局收敛性.数值结果表明算法是有效的.     

New accelerated conjugate gradient algorithms as a modification of Dai-Yuan’s computational scheme for unconstrained optimization

New accelerated nonlinear conjugate gradient algorithms which are mainly modifications of Dai and Yuan’s for unconstrained optimization are proposed. Using the exact line search, the algorithm reduces to the Dai and Yuan conjugate gradient computational scheme. For inexact line search the algorithm satisfies the sufficient descent condition. Since the step lengths in conjugate gradient algorithms may differ from 1 by two orders of magnitude and tend to vary in a very unpredictable manner, the algorithms are equipped with an acceleration scheme able to improve the efficiency of the algorithms. Computational results for a set consisting of 750 unconstrained optimization test problems show that these new conjugate gradient algorithms substantially outperform the Dai-Yuan conjugate gradient algorithm and its hybrid variants, Hestenes-Stiefel, Polak-Ribière-Polyak, CONMIN conjugate gradient algorithms, limited quasi-Newton algorithm LBFGS and compare favorably with CG_DESCENT. In the frame of this numerical study the accelerated scaled memoryless BFGS preconditioned conjugate gradient ASCALCG algorithm proved to be more robust.     

一类特殊矩阵方程的并行预处理变形共轭梯度算法

研究了求解一类矩阵方程AXB=C,提出了一种并行预处理变形共轭梯度法．该方法给出一种迭代法的预处理模式．首先给出的预处理矩阵是严格对角占优矩阵,构造并行迭代求解预处理矩阵方程的迭代格式,进而使用变形共轭梯度法并行求解．通过数值试验,预处理变形共轭梯度法与直接使用变形共轭梯度法相比较,该算法不仅有效提高了收敛速度,而且具有很高的并行性．     

An improved inexact Newton method

For unconstrained optimization, an inexact Newton algorithm is proposed recently, in which the preconditioned conjugate gradient method is applied to solve the Newton equations. In this paper, we improve this algorithm by efficiently using automatic differentiation and establish a new inexact Newton algorithm. Based on the efficiency coefficient defined by Brent, a theoretical efficiency ratio of the new algorithm to the old algorithm is introduced. It has been shown that this ratio is greater than 1, which implies that the new algorithm is always more efficient than the old one. Furthermore, this improvement is significant at least for some cases. This theoretical conclusion is supported by numerical experiments.      

Interior dual proximal point algorithm using preconditioned conjugate gradient †

Serial and parallel implementations of the interior dual proximal point algorithm for the solution of large linear programs are described. A preconditioned conjugate gradient method is used to solve the linear system of equations that arises at each interior point interation. Numerical results for a set of multicommodity network flow problems are given. For larger problem preconditioned conjugate gradient method outperforms direct methods of solution. In fact it is impossible to handle very large problems by direct methods     

Analysis of a multigrid preconditioner for Crouzeix–Raviart discretization of elliptic partial differential equation with jump coefficients

In this paper, we present a multigrid V‐cycle preconditioner for the linear system arising from piecewise linear nonconforming Crouzeix–Raviart discretization of second‐order elliptic problems with jump coefficients. The preconditioner uses standard conforming subspaces as coarse spaces. We showed that the convergence rates of the (multiplicative) two‐grid and multigrid V‐cycle algorithms will deteriorate rapidly because of large jumps in coefficient. However, the preconditioned systems have only a fixed number of small eigenvalues depending on the large jump in coefficient, and the effective condition numbers are independent of the coefficient and bounded logarithmically with respect to the mesh size. As a result, the two‐grid or multigrid preconditioned conjugate gradient algorithm converges nearly uniformly. We also comment on some major differences of the convergence theory between the nonconforming case and the standard conforming case. Numerical experiments support the theoretical results. Copyright © 2012 John Wiley & Sons, Ltd.     

PRECONDITIONING HIGHER ORDER FINITE ELEMENT SYSTEMS BY ALGEBRAIC MULTIGRID METHOD OF LINEAR ELEMENTS

We present and analyze a robust preconditioned conjugate gradient method for the higher order Lagrangian finite element systems of a class of elliptic problems. An auxiliary linear element stiffness matrix is chosen to be the preconditioner for higher order finite elements. Then an algebraic multigrid method of linear finite element is applied for solving the preconditioner. The optimal condition number which is independent of the mesh size is obtained. Numerical experiments confirm the efficiency of the algorithm.     

Accelerated conjugate gradient algorithm with finite difference Hessian/vector product approximation for unconstrained optimization

In this paper we propose a fundamentally different conjugate gradient method, in which the well-known parameter β_k is computed by an approximation of the Hessian/vector product through finite differences. For search direction computation, the method uses a forward difference approximation to the Hessian/vector product in combination with a careful choice of the finite difference interval. For the step length computation we suggest an acceleration scheme able to improve the efficiency of the algorithm. Under common assumptions, the method is proved to be globally convergent. It is shown that for uniformly convex functions the convergence of the accelerated algorithm is still linear, but the reduction in function values is significantly improved. Numerical comparisons with conjugate gradient algorithms including CONMIN by Shanno and Phua [D.F. Shanno, K.H. Phua, Algorithm 500, minimization of unconstrained multivariate functions, ACM Trans. Math. Softw. 2 (1976) 87–94], SCALCG by Andrei [N. Andrei, Scaled conjugate gradient algorithms for unconstrained optimization, Comput. Optim. Appl. 38 (2007) 401–416; N. Andrei, Scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization, Optim. Methods Softw. 22 (2007) 561–571; N. Andrei, A scaled BFGS preconditioned conjugate gradient algorithm for unconstrained optimization, Appl. Math. Lett. 20 (2007) 645–650], and new conjugacy condition and related new conjugate gradient by Li, Tang and Wei [G. Li, C. Tang, Z. Wei, New conjugacy condition and related new conjugate gradient methods for unconstrained optimization, J. Comput. Appl. Math. 202 (2007) 523–539] or truncated Newton TN by Nash [S.G. Nash, Preconditioning of truncated-Newton methods, SIAM J. on Scientific and Statistical Computing 6 (1985) 599–616] using a set of 750 unconstrained optimization test problems show that the suggested algorithm outperforms these conjugate gradient algorithms as well as TN.     

Computational method for optimal control of switched systems with input and state constraints

In this paper, we consider an optimal control problem of switched systems with input and state constraints. Since the complexity of such constraint and switching laws, it is difficult to solve the problem using standard optimization techniques. In addition, although conjugate gradient algorithms are very useful for solving nonlinear optimization problem, in practical implementations, the existing Wolfe condition may never be satisfied due to the existence of numerical errors. And the mode insertion technique only leads to suboptimal solutions, due to only certain mode insertions being considered. Thus, based on an improved conjugate gradient algorithm and a discrete filled function method, an improved bi-level algorithm is proposed to solve this optimization problem. Convergence results indicate that the proposed algorithm is globally convergent. Three numerical examples are solved to illustrate the proposed algorithm converges faster and yields a better cost function value than existing bi-level algorithms.     

On a one-dimensional optimization problem derived from the efficiency analysis of Newton-PCG-like algorithms

The Newton-PCG (preconditioned conjugate gradient) like algorithms are usually very efficient. However, their efficiency is mainly supported by the numerical experiments. Recently, a new kind of Newton-PCG-like algorithms is derived in (J. Optim. Theory Appl. 105 (2000) 97; Superiority analysis on truncated Newton method with preconditioned conjugate gradient technique for optimization, in preparation) by the efficiency analysis. It is proved from the theoretical point of view that their efficiency is superior to that of Newton's method for the special cases where Newton's method converges with precise Q-order 2 and α(⩾2), respectively. In the process of extending such kind of algorithms to the more general case where Newton's method has no fixed convergence order, the first is to get the solutions to the one-dimensional optimization problems with many different parameter values of α. If these problems were solved by numerical method one by one, the computation cost would reduce the efficiency of the Newton-PCG algorithm, and therefore is unacceptable. In this paper, we overcome the difficulty by deriving an analytic expression of the solution to the one-dimensional optimization problem with respect to the parameter α.     

Nonnested multigrid methods for linear problems

This article presents an application of nonnested and unstructured multigrid methods to linear elastic problems. A variational formulation for transfer operators and some multigrid strategies, including adaptive algorithms, are presented. Expressions for the performance evaluation of multigrid strategies and its comparison with direct and preconditioned conjugate gradient algorithms are also presented. A C++ implementation of the multigrid algorithms and the quadtree and octree data structures for transfer operators are discussed. Some two‐ and three‐dimensional elasticity examples are analyzed. © 2001 John Wiley & Sons, Inc. Numer Methods Partial Differential Eq 17:313–331, 2001