Generalizations of the nonstationary multisplitting iterative method for symmetric positive definite linear systems

In this paper, we generalize the nonstationary parallel multisplitting iterative method for solving the symmetric positive definite linear systems. With several choices of variable weighting matrices, the convergence properties of these generalized methods can be improved. Finally, the numerical comparison of several nonstationary parallel multisplitting methods are shown.     

EXPERIMENTAL STUDY OF THE ASYNCHRONOUS MULTISPLITTING RELAXATION METHODS FOR THE LINEAR COMPLEMENTARITY PROBLEMS

We study the numerical behaviours of the relaxed asynchronous multisplitting methods for the linear complementarity problems by solving some typical problems from practical applications on a real multiprocessor system. Numerical results show that the parallel multisplitting relaxation methods always perform much better than the corresponding sequential alternatives, and that the asynchronous multisplitting relaxation methods often outperform their corresponding synchronous counterparts. Moreover, the two-sweep relaxed multisplitting methods have better convergence properties than their corresponding one-sweep relaxed ones in the sense that they have larger convergence domains and faster convergence speeds. Hence, the asynchronous multisplitting unsymmetric relaxation iterations should be the methods of choice for solving the large sparse linear complementarity problems in the parallel computing environments.     

Convergence analysis of the parallel multisplitting TOR method

In this paper, we propose the parallel multisplitting TOR method, for solving a large nonsingular systems of linear equations Ax = b. These new methods are a generalization and an improvement of the relaxed parallel multisplitting method (Formmer and Mager, 1989) and parallel multisplitting AOR Algorithm (Wang Deren, 1991). The convergence theorem of this new algorithm is established under the condition that the coefficient matrix A of linear systems is an H-matrix. Some results also yield new convergence theorem for TOR method.     

Chaotic iterative methods for the linear complementarity problems

A class of parallel multisplitting chaotic relaxation methods is established for the large sparse linear complementarity problems, and the global and monotone convergence is proved for the H-matrix and the L-matrix classes, respectively. Moreover, comparison theorem is given, which describes the influences of the parameters and the multiple splittings upon the monotone convergence rates of the new methods.     

Parallel multisplitting two-stage iterative methods for large sparse systems of weakly nonlinear equations

The finite difference or the finite element discretizations of many differential or integral equations often result in a class of systems of weakly nonlinear equations. In this paper, by reasonably applying both the multisplitting and the two-stage iteration techniques, and in accordance with the special properties of this system of weakly nonlinear equations, we first propose a general multisplitting two-stage iteration method through the two-stage multiple splittings of the system matrix. Then, by applying the accelerated overrelaxation (AOR) technique of the linear iterative methods, we present a multisplitting two-stage AOR method, which particularly uses the AOR-like iteration as inner iteration and is substantially a relaxed variant of the afore-presented method. These two methods have a forceful parallel computing function and are much more suitable to the high-speed multiprocessor systems. For these two classes of methods, we establish their local convergence theories, and precisely estimate their asymptotic convergence factors under some suitable assumptions when the involved nonlinear mapping is only directionally differentiable. When the system matrix is either an H-matrix or a monotone matrix, and the nonlinear mapping is a P-bounded mapping, we thoroughly set up the global convergence theories of these new methods. Moreover, under the assumptions that the system matrix is monotone and the nonlinear mapping is isotone, we discuss the monotone convergence properties of the new multisplitting two-stage iteration methods, and investigate the influence of the multiple splittings as well as the relaxation parameters upon the convergence behaviours of these methods. Numerical computations show that our new methods are feasible and efficient for parallel solving of the system of weakly nonlinear equations. This revised version was published online in August 2006 with corrections to the Cover Date.     

Convergence of parallel multisplitting methods using ILU factorizations

In this paper, we study the convergence of both relaxed multisplitting method and nonstationary two-stage multisplitting method associated with a multisplitting which is obtained from the ILU factorizations for solving a linear system whose coefficient matrix is anH-matrix. Also, parallel performance results of nonstaionary two-stage multisplitting method using ILU factorizations as inner splittings on the IBM p690 supercomputer are provided to analyze theoretical results.     

A class of asynchronous parallel nonlinear accelerated overrelaxation methods for the nonlinear complementarity problems

In accordance with the principle of using sufficiently the delayed information, and by making use of the nonlinear multisplitting and the nonlinear relaxation techniques, we present in this paper a class of asynchronous parallel nonlinear multisplitting accelerated overrelaxation (AOR) methods for solving the large sparse nonlinear complementarity problems on the high-speed MIMD multiprocessor systems. These new methods, in particular, include the so-called asynchronous parallel nonlinear multisplitting AOR-Newton method, the asynchronous parallel nonlinear multisplitting AOR-chord method and the asynchronous parallel nonlinear multisplitting AOR-Steffensen method. Under suitable constraints on the nonlinear multisplitting and the relaxation parameters, we establish the local convergence theory of this class of new methods when the Jacobi matrix of the involved nonlinear mapping at the solution point of the nonlinear complementarity problem is an H-matrix.     

关于对称正定矩阵的两级多分裂方法

为了在并行和向量机上求解对称正定性方程且Ax=b，两组多分裂方法被考虑，中，把Galligain和Ruggiero的两级算术平均方法推广到两级多分裂方法并给出了一些合适的内分裂例子，同时讨论了所引起的两级多分裂方法的收敛性。     

On the convergence of parallel chaotic nonlinear multisplitting Newton-type methods

A class of parallel chaotic nonlinear multisplitting Newton-type methods for solving the nonlinear system of equations F(x) = 0(F : D Rⁿ → Rⁿ) is established and its local convergence theory is presented.     

Parallel multisplitting two-stage iterative methods with general weighting matrices for non-symmetric positive definite systems

In this work, we propose a new parallel multisplitting iterative method for non-symmetric positive definite linear systems. Based on optimization theory, the new method has two great improvements; one is that only one splitting needs to be convergent, and the other is that the weighting matrices are not scalar and nonnegative matrices. The convergence of the new parallel multisplitting iterative method is discussed. Finally, the numerical results show that the new method is effective.     

ON MONOTONE CONVERGENCE OF NONLINEARMULTISPLITTING RELAXATION METHODS

ＯＮＭＯＮＯＴＯＮＥＣＯＮＶＥＲＧＥＮＣＥＯＦＮＯＮＬＩＮＥＡＲＭＵＬＴＩＳＰＬＩＴＴＩＮＧＲＥＬＡＸＡＴＩＯＮＭＥＴＨＯＤＳ￥ＷＡＮＧＤＥＲＥＮ；ＢＡＩＺＨＯＮＧＺＨＩ（ＤｅｐａｚａｔｍｅｎｔｏｆＭａｔｈｅｍａｔｉｃｓ，ＳｈｓｌｌｇｈａｉＵｎｉｖｅ...     

Two-Stage Multisplitting Iteration Methods Using Modulus-Based Matrix Splitting as Inner Iteration for Linear Complementarity Problems

The matrix multisplitting iteration method is an effective tool for solving large sparse linear complementarity problems. However, at each iteration step we have to solve a sequence of linear complementarity sub-problems exactly. In this paper, we present a two-stage multisplitting iteration method, in which the modulus-based matrix splitting iteration and its relaxed variants are employed as inner iterations to solve the linear complementarity sub-problems approximately. The convergence theorems of these two-stage multisplitting iteration methods are established. Numerical experiments show that the two-stage multisplitting relaxation methods are superior to the matrix multisplitting iteration methods in computing time, and can achieve a satisfactory parallel efficiency.     

Asynchronous multisplitting iteration with different weighting schemes

The multisplitting iteration method was presented by O’Leary and White [5] for solving large sparse linear systems on parallel multiprocessor system. In this paper, we further set up an asynchronous variant for the multisplitting iteration method with different weighting schemes studied by White [8]. Moreover, we establish a general convergence criterion for asynchronous iteration framework, and then prove the convergence of the new asynchronous multisplitting iteration method with different weighting schemes by making use of this general criterion.     

解线性区间方程组的并行多分裂GAOR方法

本文引入区间三角多分裂来包含集合Ｓ＝｛Ａ－１ｂ｜Ａ∈Ｅ［Ａ］，ｂ∈［ｂ］｝，给出解区间线性方程组的并行多分裂ＧＡＯＲ方法，讨论方法的收敛性、收敛速度以及其极限包含集合Ｓ的性质．     

Modulus‐based synchronous multisplitting methods for solving horizontal linear complementarity problems on parallel computers

In this article, we generalize modulus‐based synchronous multisplitting methods to horizontal linear complementarity problems. In particular, first we define the methods of our concern and prove their convergence under suitable smoothness assumptions. Particular attention is devoted also to modulus‐based multisplitting accelerated overrelaxation methods. Then, as multisplitting methods are well‐suited for parallel computations, we analyze the parallel behavior of the proposed procedures. In particular, we do so by solving various test problems by a parallel implementation of our multisplitting methods. In this context, we carry out parallel computations on GPU with CUDA.     

A CLASS OF ASYNCHRONOUS PARALLEL MULTISPLITTING RELAXATION METHODS FOR LARGE SPARSE LINEAR COMPLEMENTARITY PROBLEMS

Asynchronous parallel multisplitting relaxation methods for solving large sparse linear complementarity problems are presented, and their convergence is proved when the system matrices are H-matrices having positive diagonal elements. Moreover, block and multi-parameter variants of the new methods, together with their convergence properties,are investigated in detail. Numerical results show that these new methods can achieve high parallel efficiency for solving the large sparse linear complementarity problems on multiprocessor systems.     

并行区间矩阵多分裂AOR算法及其收敛性

本文提出了一类求解大型区间线性方程组的并行区间矩阵多分裂松弛算法,并在系数矩阵是区间H-矩阵的条件下,建立了这类算法的收敛理论。     

Asynchronous multisplitting two-stage iterations for systems of weakly nonlinear equations

For the large sparse systems of weakly nonlinear equations arising in the discretizations of many classical differential and integral equations, this paper presents a class of asynchronous parallel multisplitting two-stage iteration methods for getting their solutions by the high-speed multiprocessor systems. Under suitable assumptions, we study the global convergence properties of these asynchronous multisplitting two-stage iteration methods. Moreover, for this class of new methods, we establish their local convergence theories, and precisely estimate their asymptotic convergence factors under some reasonable assumptions when the involved nonlinear mapping is only assumed to be directionally differentiable. Numerical computations show that our new methods are feasible and efficient for parallely solving the system of weakly nonlinear equations.     

对称正定线性方程组具有任意权矩阵的多分裂迭代求解

本文利用优化模型研究求解对称正定线性方程组Ax=6的多分裂并行算法的权矩阵.在我们的多分裂并行算法中,m个分裂仅要求其中之一为P-正则分裂而其余的则可以任意构造,这不仅大大降低了构造多分裂的难度,而且也放宽了对权矩阵的限制(不像标准的多分裂迭代方法中要求权矩阵为预先给定的非负数量矩阵).并且证明了新的多分裂迭代法是收敛的.最后,通过数值例子展示了新算法的有效性.     

Modified parallel multisplitting iterative methods for non-Hermitian positive definite systems

In this paper we present three modified parallel multisplitting iterative methods for solving non-Hermitian positive definite systems Ax?=?b. The first is a direct generalization of the standard parallel multisplitting iterative method for solving this class of systems. The other two are the iterative methods obtained by optimizing the weighting matrices based on the sparsity of the coefficient matrix A. In our multisplitting there is only one that is required to be convergent (in a standard method all the splittings must be convergent), which not only decreases the difficulty of constructing the multisplitting of the coefficient matrix A, but also releases the constraints to the weighting matrices (unlike the standard methods, they are not necessarily be known or given in advance). We then prove the convergence and derive the convergent rates of the algorithms by making use of the standard quadratic optimization technique. Finally, our numerical computations indicate that the methods derived are feasible and efficient.