Inexactly constrained discrete adjoint approach for steepest descent-based optimization algorithms

The problem of constrained optimization via the gradient-based discrete adjoint steepest descent method is studied under the assumption that the constraint equations are solved inexactly. Error propagation from the constraint equations to the gradient is studied analytically, as is the convergence rate of the inexactly constrained algorithm as it relates to the exact algorithm. A method is developed for adapting the residual tolerance to which the constraint equations are solved. The adaptive tolerance method is applied to two simple test cases to demonstrate the potential gains in computational efficiency.     

A derivative-free three-term projection algorithm involving spectral quotient for solving nonlinear monotone equations

ABSTRACT

In this paper, we develop a three-term conjugate gradient method involving spectral quotient, which always satisfies the famous Dai-Liao conjugacy condition and quasi-Newton secant equation, independently of any line search. This new three-term conjugate gradient method can be regarded as a variant of the memoryless Broyden-Fletcher-Goldfarb-Shanno quasi-Newton method with regard to spectral quotient. By combining this method with the projection technique proposed by Solodov and Svaiter in 1998, we establish a derivative-free three-term projection algorithm for dealing with large-scale nonlinear monotone system of equations. We prove the global convergence of the algorithm and obtain the R-linear convergence rate under some mild conditions. Numerical results show that our projection algorithm is effective and robust, and is more competitive with the TTDFP algorithm proposed Liu and Li [A three-term derivative-free projection method for nonlinear monotone system of equations. Calcolo. 2016;53:427–450].     

A segmented and weighted Adomian decomposition algorithm for boundary value problem of nonlinear groundwater equation

Based on Adomian decomposition method, a new algorithm for solving boundary value problem (BVP) of nonlinear partial differential equations on the rectangular area is proposed. The solutions obtained by the method precisely satisfy all boundary conditions, except the small pieces near the four corners of the rectangular area. A theorem on the boundary error is given. Hence, the Adomian decomposition method is more efficiently applied to BVPs for partial differential equations. Segmented and weighted analytical solutions with a high accuracy for the BVP of nonlinear groundwater equations on a rectangular area are obtained by the present algorithm. Copyright © 2013 John Wiley & Sons, Ltd.     

The method of determining all real nonmultiple roots of systems of nonlinear equations

A method for determining all nonmultiple roots of the system of nonlinear equations in an n-dimensional parallelepiped is proposed. The main idea of the method is that the original set, in which the roots are sought, is divided into subsets where either the system of equations does not have solutions or its Jacobian matrix is nonsingular. A partition algorithm is presented and its convergence is proved. The application of the method is demonstrated using several examples.     

An operator-splitting algorithm for the three-dimensional diffusion equation

A second-order-accurate and unconditionally stable operator-splitting algorithm for the three-dimensional diffusion equation is presented in this article. The governing equation is split into three one-dimensional equations, and the split equations are solved by a finite-element method. The simulation characteristics of the algorithm are demonstrated by numerical experiments. © 1995 John Wiley & Sons, Inc.     

非线性算子方程的泰勒展式算法

本文的目的是给出一种解Ｈｉｌｂｅｒｔ空间中非线性方程的ｋ阶泰勒展式算法（ｋ１）．标准Ｇａｌｅｒｋｉｎ方法可以看作１阶泰勒展式算法，而最优非线性Ｇａｌｅｒｋｉｎ方法可视为２阶泰勒展式算法．我们应用这种算法于定常的Ｎａｖｉｅｒ－Ｓｔｏｋｅｓ方程的数值逼近．在一定情景下，最优非线性Ｇａｌｅｒｋｉｎ方法提供比标准Ｇａｌｅｒｋｉｎ方法和非线性Ｇａｌｅｒｋｉｎ方法更高阶的收敛速度．     

求解摩擦接触问题的一个非内点光滑化算法

给出了一个求解三维弹性有摩擦接触问题的新算法,即基于NCP函数的非内点光滑化算法．首先通过参变量变分原理和参数二次规划法,将三维弹性有摩擦接触问题的分析归结为线性互补问题的求解;然后利用NCP函数,将互补问题的求解转换为非光滑方程组的求解;再用凝聚函数对其进行光滑化,最后用NEWTON法解所得到的光滑非线性方程组．方法具有易于理解及实现方便等特点．通过线性互补问题的数值算例及接触问题实例证实了该算法的可靠性与有效性．     

Inexact trust region method for large sparse systems of nonlinear equations

The main purpose of this paper is to prove the global convergence of the new trust region method based on the smoothed CGS algorithm. This method is surprisingly convenient for the numerical solution of large sparse systems of nonlinear equations, as is demonstrated by numerical experiments. A modification of the proposed trust region method does not use matrices, so it can be used for large dense systems of nonlinear equations.     

Discrete Wavelet Petrov–Galerkin Methods

In this paper, we develop a discrete wavelet Petrov–Galerkin method for integral equations of the second kind with weakly singular kernels suitable for solving boundary integral equations. A compression strategy for the design of a fast algorithm is suggested. Estimates for the rate of convergence and computational complexity of the method are provided.     

A step size control algorithm for the weak approximation of stochastic differential equations

A vriable step size control algorithm for the weak approximation of stochastic differential equations is introduced. The algorithm is based on embedded Runge–Kutta methods which yield two approximations of different orders with a negligible additional computational effort. The difference of these two approximations is used as an estimator for the local error of the less precise approximation. Some numerical results are presented to illustrate the effectiveness of the introduced step size control method.      

Numerical solution of the heat equation by infinite-order ordinary differential equations

A numerical algorithm is given for solving a class of infinite-order differential equations previously discussed by the authors. These equations yield solutions to certain time-dependent boundary-value problems for the heat equation. An extrapolation process is given for increasing the speed of convergence of the sequence generated by the method. © 1992 John Wiley & Sons, Inc.     

An iterative penalty method for the least squares solution of boundary value problems

This article is concerned with iterative techniques for linear systems of equations arising from a least squares formulation of boundary value problems. In its classical form, the solution of the least squares method is obtained by solving the traditional normal equation. However, for nonsmooth boundary conditions or in the case of refinement at a selected set of interior points, the matrix associated with the normal equation tends to be ill-conditioned. In this case, the least squares method may be formulated as a Powell multiplier method and the equations solved iteratively. Therein we use and compare two different iterative algorithms. The first algorithm is the preconditioned conjugate gradient method applied to the normal equation, while the second is a new algorithm based on the Powell method and formulated on the stabilized dual problem. The two algorithms are first compared on a one-dimensional problem with poorly conditioned matrices. Results show that, for such problems, the new algorithm gives more accurate results. The new algorithm is then applied to a two-dimensional steady state diffusion problem and a boundary layer problem. A comparison between the least squares method of Bramble and Schatz and the new algorithm demonstrates the ability of the new method to give highly accurate results on the boundary, or at a set of given interior collocation points without the deterioration of the condition number of the matrix. Conditions for convergence of the proposed algorithm are discussed. © 1997 John Wiley & Sons, Inc.     

Parallel collocation solution of index-1 BVP-DAEs arising from constrained optimal control problems

The indirect solution of constrained optimal control problems gives rise to two-point boundary value problems (BVPs) that involve index-1 differential-algebraic equations (DAEs) and inequality constraints. This paper presents a parallel collocation algorithm for the solution of these inequality constrained index-1 BVP-DAEs. The numerical algorithm is based on approximating the DAEs using piecewise polynomials on a nonuniform mesh. The collocation method is realized by requiring that the BVP-DAE be satisfied at Lobatto points within each interval of the mesh. A Newton interior-point method is used to solve the collocation equations, and maintain feasibility of the inequality constraints. The implementation of the algorithm involves: (i) parallel evaluation of the collocation equations; (ii) parallel evaluation of the system Jacobian; and (iii) parallel solution of a boarded almost block diagonal (BABD) system to obtain the Newton search direction. Numerical examples show that the parallel implementation provides significant speedup when compared to a sequential version of the algorithm.     

Nonlinear Deformational Properties of Dispersely Strengthened Materials

A method and an algorithm for determining the effective deformational properties of dispersely strengthened materials with a physically nonlinear matrix and quasi-spheroidal linearly elastic inclusions are elaborated based on the stochastic differential equations of the physically nonlinear theory of elasticity. Their transformation to integral equations and the application of the method of conditional moments reduce the problem to a system of nonlinear algebraic equations, whose solution is constructed by the iteration method. The deformation diagrams as functions of the volume content of inclusions are investigated.     

一类特征值反问题(IEP)的基于矩阵方程的Ulm型算法

应用求解算子方程的Ulm方法构造了求解一类矩阵特征值反问题（IEP）的新算法.所给算法避免了文献[Aishima K.,A quadratically convergent algorithm based on matrix equations for inverse eigenvalue problems,Linear Algebra and its Applications,2018,542：310-33]中算法在每次迭代中要求解一个线性方程组的不足,证明了在给定谱数据互不相同的条件下所给算法具有根收敛意义下的二次收敛性.数值实验表明本文所给算法在矩阵阶数较大时计算效果优于上文所给算法.     

Finite iterative algorithms for a common solution to a group of complex matrix equations

An iterative algorithm is constructed to give a common solution to a group of complex matrix equations. By using the proposed algorithm, the existence of a common solution can be determined automatically. When a common solution exists for this group of matrix equations, it is proven by using a real inner product in complex matrix spaces as a tool that a solution can be obtained within finite iteration steps for any initial values in the absence of round-off errors. The algorithm is also generalized to solve a more general case. A numerical example is given to illustrate the effectiveness of the proposed method.     

Numerical simulation of thermal problems coupled with magnetohydrodynamic effects in aluminium cell

A system of partial differential equations describing the thermal behavior of aluminium cell coupled with magnetohydrodynamic effects is numerically solved. The thermal model is considered as a two-phases Stefan problem which consists of a non-linear convection–diffusion heat equation with Joule effect as a source. The magnetohydrodynamic fields are governed by Navier–Stokes and by static Maxwell equations. A pseudo-evolutionary scheme (Chernoff) is used to obtain the stationary solution giving the temperature and the frozen layer profile for the simulation of the ledges in the cell. A numerical approximation using a finite element method is formulated to obtain the fluid velocity, electrical potential, magnetic induction and temperature. An iterative algorithm and 3-D numerical results are presented.     

An efficient algorithm for finding all solutions of separable systems of nonlinear equations

An efficient algorithm is proposed for finding all solutions of systems of nonlinear equations with separable mappings. This algorithm is based on interval analysis, the dual simplex method, the contraction method, and a special technique which makes the algorithm not require large memory space and not require copying tableaus. By numerical examples, it is shown that the proposed algorithm could find all solutions of a system of 2000 nonlinear equations in acceptable computation time. AMS subject classification (2000)  65H10, 65G10     

A relaxation method for reconstructing objects from noisy X-rays

An algorithm is presented for estimating the density distribution in a cross section of an object from X-ray data, which in practice is unavoidably noisy. The data give rise to a large sparse system of inconsistent equations, not untypically 10⁵ equations with 10⁴ unknowns, with only about 1% of the coefficients non-zero. Using the physical interpretation of the equations, each equality can in principle be replaced by a pair of inequalities, giving us the limits within which we believe the sum must lie. An algorithm is proposed for solving this set of inequalities. The algorithm is basically a relaxation method. A finite convergence result is proved. In spite of the large size of the system, in the application area of interest practical solution on a computer is possible because of the simple geometry of the problem and the redundancy of equations obtained from nearby X-rays. The algorithm has been implemented, and is demonstrated by actual reconstructions.     

A simple moving mesh method for one- and two-dimensional phase-field equations

A simple moving mesh method is proposed for solving phase-field equations. The numerical strategy is based on the approach proposed in Li et al. [J. Comput. Phys. 170 (2001) 562–588] to separate the mesh-moving and PDE evolution. The phase-field equations are discretized by a finite-volume method, and the mesh-moving part is realized by solving the conventional Euler–Lagrange equations with the standard gradient-based monitors. Numerical results demonstrate the accuracy and effectiveness of the proposed algorithm.