On a new iterative method for solving linear systems and comparison results

In Ujević [A new iterative method for solving linear systems, Appl. Math. Comput. 179 (2006) 725–730], the author obtained a new iterative method for solving linear systems, which can be considered as a modification of the Gauss–Seidel method. In this paper, we show that this is a special case from a point of view of projection techniques. And a different approach is established, which is both theoretically and numerically proven to be better than (at least the same as) Ujević's. As the presented numerical examples show, in most cases, the convergence rate is more than one and a half that of Ujević.     

Minimal residual methods for large scale Lyapunov equations

Projection methods have emerged as competitive techniques for solving large scale matrix Lyapunov equations. We explore the numerical solution of this class of linear matrix equations when a Minimal Residual (MR) condition is used during the projection step. We derive both a new direct method, and a preconditioned operator-oriented iterative solver based on CGLS, for solving the projected reduced least squares problem. Numerical experiments with benchmark problems show the effectiveness of an MR approach over a Galerkin procedure using the same approximation space.     

Convergence of a generalized MSSOR method for augmented systems

Recently, Wu et al. [S.-L. Wu, T.-Z. Huang, X.-L. Zhao, A modified SSOR iterative method for augmented systems, J. Comput. Appl. Math. 228 (1) (2009) 424-433] introduced a modified SSOR (MSSOR) method for augmented systems. In this paper, we establish a generalized MSSOR (GMSSOR) method for solving the large sparse augmented systems of linear equations, which is the extension of the MSSOR method. Furthermore, the convergence of the GMSSOR method for augmented systems is analyzed and numerical experiments are carried out, which show that the GMSSOR method with appropriate parameters has a faster convergence rate than the MSSOR method with optimal parameters.     

A Probe Method of Gradient Projection Type

§１．　ＩｎｔｒｏｄｕｃｔｉｏｎＷｅｃｏｎｓｉｄｅｒｔｈｅｆｏｌｌｏｗｉｎｇｏｐｔｉｍｉｚａｔｉｏｎｐｒｏｂｌｅｍ：（Ｐ）　　ｍｉｎｘ∈Ｘｆ（ｘ）（１）ｗｈｅｒｅＸ＝｛ｘ｜ｘ∈Ｅｎ,ｇｊ（ｘ）≤０,ｊ＝１,２,…,ｍ;ｇｊ（ｘ）＝０,ｊ＝ｍ＋１,…,ｍ＋ｌ｝,ｌｅｔＩ＝｛１,２,…,ｍ｝,Ｌ＝｛ｍ＋１,…,ｍ＋ｌ｝．Ｆｏｒｔｈｅｐｒｏｂｌｅｍ（Ｐ）ｗｉｔｈＬ＝,ｍａｎｙｅｆｆｉｃｉｅｎｔｐｒｏｊｅｃｔｉｏｎｔｙｐｅａｌｇｏｒｉｔｈｍｓ［１－１１］ｈａｖｅｂｅｅｎｐｒｏｐｏｓｅｄ．Ｉｎ［１２］,…     

Multilevel augmentation methods for solving the Burgers' equation

In this article, multilevel augmentation method (MAM) for solving the Burgers' equation is developed. The Crank–Nicolson–Galerkin scheme of the Burgers' equation results in nonlinear algebraic systems at each time step, the computational cost for solving these nonlinear systems is huge. The MAM allows us to solve the nonlinear system at a fixed initial lower level and then compensate the error by solving a linear system at the higher level. We prove that the method has the same optimal convergence order as the projection method, while reducing the computational complexity greatly. Finally, numerical experiments are presented to confirm the theoretical analysis and illustrate the efficiency of the proposed method. © 2015 Wiley Periodicals, Inc. Numer Methods Partial Differential Eq 31: 1665–1691, 2015     

Generalizations and modifications of the GMRES iterative method

For solving nonsymmetric linear systems, the well-known GMRES method is considered to be a stable method; however, the work per iteration increases as the number of iterations increases. We consider two new iterative methods GGMRES and MGMRES, which are a generalization and a modification of the GMRES method, respectively. Instead of using a minimization condition as in the derivation of GGMRES, we use a Galerkin condition to derive the MGMRES method. We also introduce another new iterative method, LAN/MGMRES, which is designed to combine the reliability of GMRES with the reduced work of a Lanczos-type method. A computer program has been written based on the use of the LAN/MGMRES algorithm for solving nonsymmetric linear systems arising from certain elliptic problems. Numerical tests are presented comparing this algorithm with some other commonly used iterative algorithms. These preliminary tests of the LAN/MGMRES algorithm show that it is comparable in terms of both the approximate number of iterations and the overall convergence behavior. This revised version was published online in June 2006 with corrections to the Cover Date.     

Acceleration procedures for matrix iterative methods

In this paper, several procedures for accelerating the convergence of an iterative method for solving a system of linear equations are proposed. They are based on projections and are closely related to the corresponding iterative projection methods for linear systems.     

A modified projection method with a new direction for solving variational inequalities

In this paper, we propose a new projection method for solving variational inequality problems, which can be viewed as an improvement of the method of Li et al. [M. Li, L.Z. Liao, X.M. Yuan, A modified projection method for co-coercive variational inequality, European Journal of Operational Research 189 (2008) 310-323], by adopting a new direction. Under the same assumptions as those in Li et al. (2008), we establish the global convergence of the proposed algorithm. Some preliminary computational results are reported, which illustrated that the new method is more efficient than the method of Li et al. (2008).     

A generalization of parameterized inexact Uzawa method for generalized saddle point problems

Recently, a class of parameterized inexact Uzawa methods has been proposed for generalized saddle point problems by Bai and Wang [Z.-Z. Bai, Z.-Q. Wang, On parameterized inexact Uzawa methods for generalized saddle point problems, Linear Algebra Appl. 428 (2008) 2900–2932], and a generalization of the inexact parameterized Uzawa method has been studied for augmented linear systems by Chen and Jiang [F. Chen, Y.-L. Jiang, A generalization of the inexact parameterized Uzawa methods for saddle point problems, Appl. Math. Comput. (2008)]. This paper is concerned about a generalization of the parameterized inexact Uzawa method for solving the generalized saddle point problems with nonzero (2, 2) blocks. Some new iterative methods are presented and their convergence are studied in depth. By choosing different parameter matrices, we derive a series of existing and new iterative methods, including the preconditioned Uzawa method, the inexact Uzawa method, the SOR-like method, the GSOR method, the GIAOR method, the PIU method, the APIU method and so on. Numerical experiments are used to demonstrate the feasibility and effectiveness of the generalized parameterized inexact Uzawa methods.     

A self-adaptive method for solving general mixed variational inequalities

The general mixed variational inequality containing a nonlinear term φ is a useful and an important generalization of variational inequalities. The projection method cannot be applied to solve this problem due to the presence of the nonlinear term. To overcome this disadvantage, Noor [M.A. Noor, Pseudomonotone general mixed variational inequalities, Appl. Math. Comput. 141 (2003) 529-540] used the resolvent equations technique to suggest and analyze an iterative method for solving general mixed variational inequalities. In this paper, we present a new self-adaptive iterative method which can be viewed as a refinement and improvement of the method of Noor. Global convergence of the new method is proved under the same assumptions as Noor's method. Some preliminary computational results are given.     

A New Step-Size Skill for Solving a Class of Nonlinear Projection Equations

1.IntroductionIn[11],aniterativeprojectionandcontraction(PC)methodforlinearcomplemen-taxityproblemswasproposed.Inpractice,thealgorithmbehaveseffectively,butintheorythesteP-sizecannotbeprovedtobeboundedawayfromzero.Sonostatementcanbemadeabouttherateofconvergence.AlthoughavariantoftheprimePCal-gorithmwithconstantstepsizeforlineaJrprogrammminghasalinearconvergence['1,itconvergesmuchslowerinparctice.In[1o],HeproposedanewsteVsizerulefortheprimePCalgorithmforthelinearprogrammingsuchthattheresul…     

An orthogonally accumulated projection method for symmetric linear system of equations

A direct as well as iterative method (called the orthogonally accumulated projection method, or the OAP for short) for solving linear system of equations with symmetric coefficient matrix is introduced in this paper. With the Lanczos process the OAP creates a sequence of mutually orthogonal vectors, on the basis of which the projections of the unknown vectors are easily obtained, and thus the approximations to the unknown vectors can be simply constructed by a combination of these projections. This method is an application of the accumulated projection technique proposed recently by the authors of this paper, and can be regarded as a match of conjugate gradient method (CG) in its nature since both the CG and the OAP can be regarded as iterative methods, too. Unlike the CG method which can be only used to solve linear systems with symmetric positive definite coefficient matrices, the OAP can be used to handle systems with indefinite symmetric matrices. Unlike classical Krylov subspace methods which usually ignore the issue of loss of orthogonality, OAP uses an effective approach to detect the loss of orthogonality and a restart strategy is used to handle the loss of orthogonality. Numerical experiments are presented to demonstrate the efficiency of the OAP.     

An Acceleration Scheme for Solving Convex Feasibility Problems Using Incomplete Projection Algorithms

The Projected Aggregation Methods (PAM) for solving linear systems of equalities and/or inequalities, generate a new iterate x ^k+1 by projecting the current point x ^k onto a separating hyperplane generated by a given linear combination of the original hyperplanes or halfspaces. In [12] we introduced acceleration schemes for solving systems of linear equations by applying optimization techniques to the problem of finding the optimal combination of the hyperplanes within a PAM like framework. In this paper we generalize those results, introducing a new accelerated iterative method for solving systems of linear inequalities, together with the corresponding theoretical convergence results. In order to test its efficiency, numerical results obtained applying the new acceleration scheme to two algorithms introduced by García-Palomares and González-Castaño [6] are given.     

Modified self-adaptive projection method for solving pseudomonotone variational inequalities

In this paper, a self-adaptive projection method with a new search direction for solving pseudomonotone variational inequality (VI) problems is proposed, which can be viewed as an extension of the methods in [B.S. He, X.M. Yuan, J.Z. Zhang, Comparison of two kinds of prediction-correction methods for monotone variational inequalities, Computational Optimization and Applications 27 (2004) 247-267] and [X.H. Yan, D.R. Han, W.Y. Sun, A self-adaptive projection method with improved step-size for solving variational inequalities, Computers & Mathematics with Applications 55 (2008) 819-832]. The descent property of the new search direction is proved, which is useful to guarantee the convergence. Under the relatively relaxed condition that F is continuous and pseudomonotone, the global convergence of the proposed method is proved. Numerical experiments are provided to illustrate the efficiency of the proposed method.     

A viscosity of extragradient approximation method for finding equilibrium problems, variational inequalities and fixed point problems for nonexpansive mappings

In this paper, we investigate the problem for finding the set of solutions for equilibrium problems, the set of solutions of the variational inequalities for k-Lipschitz continuous mappings and fixed point problems for nonexpansive mappings in a Hilbert space. We introduce a new viscosity extragradient approximation method which is based on the so-called viscosity approximation method and extragradient method. We show that the sequence converges strongly to a common element of the above three sets under some parameters controlling conditions. Finally, we utilize our results to study some convergence problems for finding the zeros of maximal monotone operators. Our results are generalization and extension of the results of Kumam [P. Kumam, Strong convergence theorems by an extragradient method for solving variational inequalities and equilibrium problems in a Hilbert space, Turk. J. Math. 33 (2009) 85–98], Wangkeeree [R. Wangkeeree, An extragradient approximation method for equilibrium problems and fixed point problems of a countable family of nonexpansive mappings, Fixed Point Theory and Applications, 2008, Article ID 134148, 17 pages, doi:10.1155/2008/134148], Yao et al. [Y. Yao, Y.C. Liou, R. Chen, A general iterative method for an finite family of nonexpansive mappings, Nonlinear Analysis 69 (5–6) (2008) 1644–1654], Qin et al. [X. Qin, M. Shang, Y. Su, A general iterative method for equilibrium problems and fixed point problems in Hilbert spaces, Nonlinear Analysis (69) (2008) 3897–3909], and many others.     

一类线性抛物型方程组的交替方向多步法及其理论分析

Efficient multistep procedure for time-stepping Galerkin method in which we use an alternating direction preconditioned iterative methods for approximately solving the linear equations arising at each timestep in a discrete Galerkin method for a class of linear parabolic systems is derived and analyzed. The optimal order error estimate is obtained. Numerical experiments show that the method has the characteristics of high efficiency and high accuracy.     

Further Developments in an Iterative Projection and Contraction Method for Linear Programming

A linear programming problem can be translated into an equivalent general linear complementarity problem, which can be solved by an iterative projection and contraction (PC) method [6]. The PC method requires only two matrix-vector multiplications at each iteration and the efficiency in practice usually depends on the sparsity of the constraint-matrix. The prime PC algorithm in [6] is globally convergent; however, no statement can be made about the rate of convergence. Although a variant of the PC algorithm with constant step-size for linear programming [7] has a linear speed of convergence, it converges much slower in practice than the prime method [6]. In this paper, we develop a new step-size rule for the PC algorithm for linear programming such that the resulting algorithm is globally linearly convergent. We present some numerical experiments to indicate that it also works better in practice than the prime algorithm.     

计算广义逆A_（T，S）~（1，2）和A_（T，S）~（2）的投影法及其应用

本文讨论投影法计算广义逆和，同时利用该方法解线性方程组得到了一些常用的迭代公式．     

On a type of matrix splitting preconditioners for a class of block two-by-two linear systems

Recently, Bai et al. (2013) proposed an effective and efficient matrix splitting iterative method, called preconditioned modified Hermitian/skew-Hermitian splitting (PMHSS) iteration method, for two-by-two block linear systems of equations. The eigenvalue distribution of the iterative matrix suggests that the splitting matrix could be advantageously used as a preconditioner. In this study, the CGNR method is utilized for solving the PMHSS preconditioned linear systems, and the performance of the method is considered by estimating the condition number of the normal equations. Furthermore, the proposed method is compared with other PMHSS preconditioned Krylov subspace methods by solving linear systems arising in complex partial differential equations and a distributed control problem. The numerical results demonstrate the difference in the performance of the methods under consideration.     

On a Chebyshev accelerated splitting iteration method with application to two‐by‐two block linear systems

The Chebyshev accelerated preconditioned modified Hermitian and skew‐Hermitian splitting (CAPMHSS) iteration method is presented for solving the linear systems of equations, which have two‐by‐two block coefficient matrices. We derive an iteration error bound to show that the new method is convergent as long as the eigenvalue bounds are not underestimated. Even when the spectral information is lacking, the CAPMHSS iteration method could be considered as an exponentially converging iterative scheme for certain choices of the method parameters. In this case, the convergence rate is independent of the parameters. Besides, the linear subsystems in each iteration can be solved inexactly, which leads to the inexact CAPMHSS iteration method. The iteration error bound of the inexact method is derived also. We discuss in detail the implementation of CAPMHSS for solving two models arising from the Galerkin finite‐element discretizations of distributed control problems and complex symmetric linear systems. The numerical results show the robustness and the efficiency of the new methods.