Convergence theorems for block splitting iterative methods for linear systems

In this paper, we will present the block splitting iterative methods with general weighting matrices for solving linear systems of algebraic equations Ax=b$\mathit{Ax}=b$ when the coefficient matrix A is symmetric positive definite of block form, and establish the convergence theories with respect to the general weighting matrices but special splittings. Finally, a numerical example shows the advantage of this method.     

A class of Uzawa-SOR methods for saddle point problems

In this paper, we consider a class of Uzawa-SOR methods for saddle point problems, and prove the convergence of the proposed methods. We solve a lower triangular system per iteration in the proposed methods, instead of solving a linear equation Az=b. Actually, the new methods can be considered as an inexact iteration method with the Uzawa as the outer iteration and the SOR as the inner iteration. Although the proposed methods cannot achieve the same convergence rate as the GSOR methods proposed by Bai et al. [Z.-Z. Bai, B.N. Parlett, Z.-Q. Wang, On generalized successive overrelaxation methods for augmented linear systems, Numer. Math. 102 (2005) 1-38], but our proposed methods have less workloads per iteration step. Experimental results show that our proposed methods are feasible and effective.     

The generalized Dirichlet–Neumann map for linear elliptic PDEs and its numerical implementation

A new approach for analyzing boundary value problems for linear and for integrable nonlinear PDEs was introduced in Fokas [A unified transform method for solving linear and certain nonlinear PDEs, Proc. Roy. Soc. London Ser. A 53 (1997) 1411–1443]. For linear elliptic PDEs, an important aspect of this approach is the characterization of a generalized Dirichlet to Neumann map: given the derivative of the solution along a direction of an arbitrary angle to the boundary, the derivative of the solution perpendicularly to this direction is computed without solving on the interior of the domain. This is based on the analysis of the so-called global relation, an equation which couples known and unknown components of the derivative on the boundary and which is valid for all values of a complex parameter k. A collocation-type numerical method for solving the global relation for the Laplace equation in an arbitrary bounded convex polygon was introduced in Fulton et al. [An analytical method for linear elliptic PDEs and its numerical implementation, J. Comput. Appl. Math. 167 (2004) 465–483]. Here, by choosing a different set of the “collocation points” (values for k), we present a significant improvement of the results in Fulton et al. [An analytical method for linear elliptic PDEs and its numerical implementation, J. Comput. Appl. Math. 167 (2004) 465–483]. The new collocation points lead to well-conditioned collocation methods. Their combination with sine basis functions leads to a collocation matrix whose diagonal blocks are point diagonal matrices yielding efficient implementation of iterative methods; numerical experimentation suggests quadratic convergence. The choice of Chebyshev basis functions leads to higher order convergence, which for regular polygons appear to be exponential.     

Comparison results on preconditioned SOR-type iterative method for Z-matrices linear systems

In this paper, we present some comparison theorems on preconditioned iterative method for solving Z-matrices linear systems, Comparison results show that the rate of convergence of the Gauss–Seidel-type method is faster than the rate of convergence of the SOR-type iterative method.     

Approximation theorems for total quasi-?-asymptotically nonexpansive mappings with applications

The purpose of this article is to prove some approximation theorems of common fixed points for countable families of total quasi-?-asymptotically nonexpansive mappings which contain several kinds of mappings as its special cases in Banach spaces. In order to get the approximation theorems, the hybrid algorithms are presented and are used to approximate the common fixed points. Using this result, we also discuss the problem of strong convergence concerning the maximal monotone operators in a Banach space. The results of this article extend and improve the results of Matsushita and Takahashi [S. Matsushita, W. Takahashi, A strong convergence theorem for relatively nonexpansive mappings in Banach spaces, J. Approx. Theor. 134 (2005) 257-266], Plubtieng and Ungchittrakool [S. Plubtieng, K. Ungchittrakool, Hybrid iterative methods for convex feasibility problems and fixed point problems of relatively nonexpansive mappings in Banach spaces, J. Approx. Theor. 149 (2007) 103-115], Li, Su [H. Y. Li, Y. F. Su, Strong convergence theorems by a new hybrid for equilibrium problems and variational inequality problems, Nonlinear Anal. 72(2) (2010) 847-855], Su, Xu and Zhang [Y.F. Su, H.K. Xu, X. Zhang, Strong convergence theorems for two countable families of weak relatively nonexpansive mappings and applications, Nonlinear Anal. 73 (2010) 3890-3960], Wang et al. [Z.M. Wang, Y.F. Su, D.X. Wang, Y.C. Dong, A modified Halpern-type iteration algorithm for a family of hemi-relative nonexpansive mappings and systems of equilibrium problems in Banach spaces, J. Comput. Appl. Math. 235 (2011) 2364-2371], Chang et al. [S.S. Chang, H.W. Joseph Lee, Chi Kin Chan, A new hybrid method for solving a generalized equilibrium problem solving a variational inequality problem and obtaining common fixed points in Banach spaces with applications, Nonlinear Anal. 73 (2010) 2260-2270], Chang et al. [S.S. Chang, C.K. Chan, H.W. Joseph Lee, Modified block iterative algorithm for quasi-?-asymptotically nonexpansive mappings and equilibrium problem in Banach spaces, Appl. Math. Comput. 217 (2011) 7520-7530], Ofoedu and Malonza [E.U. Ofoedu, D.M. Malonza, Hybrid approximation of solutions of nonlinear operator equations and application to equation of Hammerstein-type, Appl. Math. Comput. 217 (2011) 6019-6030] and Yao et al. [Y.H. Yao, Y.C. Liou, S.M. Kang, Strong convergence of an iterative algorithm on an infinite countable family of nonexpansive mappings, Appl. Math. Comput. 208 (2009) 211-218].     

Using constraint preconditioners with regularized saddle-point problems

The problem of finding good preconditioners for the numerical solution of a certain important class of indefinite linear systems is considered. These systems are of a 2 by 2 block (KKT) structure in which the (2,2) block (denoted by -C) is assumed to be nonzero. In Constraint preconditioning for indefinite linear systems, SIAM J. Matrix Anal. Appl. 21 (2000), Keller, Gould and Wathen introduced the idea of using constraint preconditioners that have a specific 2 by 2 block structure for the case of C being zero. We shall give results concerning the spectrum and form of the eigenvectors when a preconditioner of the form considered by Keller, Gould and Wathen is used but the system we wish to solve may have C ≠0. In particular, the results presented here indicate clustering of eigenvalues and, hence, faster convergence of Krylov subspace iterative methods when the entries of C are small; such a situations arise naturally in interior point methods for optimization and we present results for such problems which validate our conclusions.     

A fast implicit QR eigenvalue algorithm for companion matrices

An implicit version of the shifted QR eigenvalue algorithm given in Bini et al. [D.A. Bini, Y. Eidelman, I. Gohberg, L. Gemignani, SIAM J. Matrix Anal. Appl. 29(2) (2007) 566-585] is presented for computing the eigenvalues of an n×n companion matrix using O(n²) flops and O(n) memory storage. Numerical experiments and comparisons confirm the effectiveness and the stability of the proposed method.     

Convergence of a generalized MSSOR method for augmented systems

Recently, Wu et al. [S.-L. Wu, T.-Z. Huang, X.-L. Zhao, A modified SSOR iterative method for augmented systems, J. Comput. Appl. Math. 228 (1) (2009) 424-433] introduced a modified SSOR (MSSOR) method for augmented systems. In this paper, we establish a generalized MSSOR (GMSSOR) method for solving the large sparse augmented systems of linear equations, which is the extension of the MSSOR method. Furthermore, the convergence of the GMSSOR method for augmented systems is analyzed and numerical experiments are carried out, which show that the GMSSOR method with appropriate parameters has a faster convergence rate than the MSSOR method with optimal parameters.     

Algebraic multigrid methods for Laplacians of graphs

Classical algebraic multigrid theory relies on the fact that the system matrix is positive definite. We extend this theory to cover the positive semidefinite case as well, by formulating semiconvergence results for these singular systems. For the class of irreducible diagonal dominant singular M-matrices we show that the requirements of the developed theory hold and that the coarse level systems are still of the same class, if the C/F-splitting is good enough. An important example for matrices that are irreducible diagonal dominant M-matrices are Laplacians of graphs. Recent shape optimizing methods for graph partitioning require to solve singular linear systems involving these Laplacians. We present convergence results as well as experimental results for numerous graphs arising from finite element discretizations with up to 10⁶ vertices.     

Error estimates for a mixed finite element discretization of some degenerate parabolic equations

We consider a numerical scheme for a class of degenerate parabolic equations, including both slow and fast diffusion cases. A particular example in this sense is the Richards equation modeling the flow in porous media. The numerical scheme is based on the mixed finite element method (MFEM) in space, and is of one step implicit in time. The lowest order Raviart–Thomas elements are used. Here we extend the results in Radu et al. (SIAM J Numer Anal 42:1452–1478, 2004), Schneid et al. (Numer Math 98:353–370, 2004) to a more general framework, by allowing for both types of degeneracies. We derive error estimates in terms of the discretization parameters and show the convergence of the scheme. The features of the MFEM, especially of the lowest order Raviart–Thomas elements, are now fully exploited in the proof of the convergence. The paper is concluded by numerical examples.     

A preconditioning approach to the pagerank computation problem

Some spectral properties of the transition matrix of an oriented graph indicate the preconditioning of Euler-Richardson (ER) iterative scheme as a good way to compute efficiently the vertexrank vector associated with such graph. We choose the preconditioner from an algebra U of matrices, thereby obtaining an ER_U method, and we observe that ER_U can outperform ER in terms of rate of convergence. The proposed preconditioner can be updated at a very low cost whenever the graph changes, as is the case when it represents a generic set of information. The particular U utilized requires a surplus of operations per step and memory allocations, which make ER_U superior to ER for not too wide graphs. However, the observed high improvement in convergence rate obtained by preconditioning and the general theory developed, are a reason for investigating different choices of U, more efficient for huge graphs.     

Strong convergence theorems for countable families of asymptotically relatively nonexpansive mappings with applications

The purpose of this paper is by using the hybrid iterative method to prove some strong convergence theorems for approximating a common element of the set of solutions to a system of generalized mixed equilibrium problems and the set of common fixed points for two countable families of closed and asymptotically relatively nonexpansive mappings in Banach space. The results presented in the paper improve and extend the corresponding results of Su et al. [Y.F. Su, H.K. Xu, X. Zhang, Strong convergence theorems for two countable families of weak relatively nonexpansive mappings and applications, Nonlinear Anal. 73 (2010) 3890-3906], Li and Su [H.Y. Li, Y.F. Su, Strong convergence theorems by a new hybrid for equilibrium problems and variational inequality problems, Nonlinear Anal. 72 (2) (2010) 847-855], Chang et al. [S.S. Chang, H.W. Joseph Lee, Chi Kin Chan, A new hybrid method for solving a generalized equilibrium problem solving a variational inequality problem and obtaining common fixed points in Banach spaces with applications, Nonlinear Anal. TMA 73 (2010) 2260-2270], Kang et al. [J. Kang, Y. Su, X. Zhang, Hybrid algorithm for fixed points of weak relatively nonexpansive mappings and applications, Nonlinear Anal. HS 4 (4) (2010) 755-765], Matsushita and Takahashi [S. Matsushita, W. Takahashi, A strong convergence theorem for relatively nonexpansive mappings in Banach spaces, J. Approx. Theory 134 (2005) 257-266], Tan et al. [J.F. Tan, S.S. Chang, M. Liu, J.I. Liu, Strong convergence theorems of a hybrid projection algorithm for a family of quasi-?-asymptotically nonexpansive mappings, Opuscula Math. 30 (3) (2010) 341-348], Takahashia and Zembayashi [W. Takahashi, K. Zembayashi, Strong and weak convergence theorems for equilibrium problems and relatively nonexpansive mappings in Banach spaces, Nonlinear Anal. 70 (2009) 45-57] and Wattanawitoon and Kumam [K. Wattanawitoon, P. Kumam, Strong convergence theorems by a new hybrid projection algorithm for fixed point problem and equilibrium problems of two relatively quasi-nonexpansive mappings, Nonlinear Anal. Hybrid Systems 3 (2009) 11-20] and others.     

A tearing-based hybrid parallel banded linear system solver

A new parallel algorithm for the solution of banded linear systems is proposed. The scheme tears the coefficient matrix into several overlapped independent blocks in which the size of the overlap is equal to the system’s bandwidth. A corresponding splitting of the right-hand side is also provided. The resulting independent, and smaller size, linear systems are solved under the constraint that the solutions corresponding to the overlap regions are identical. This results in a linear system whose size is proportional to the sum of the overlap regions which we refer to as the “balance” system. We propose a solution strategy that does not require obtaining this “balance” system explicitly. Once the balance system is solved, retrieving the rest of the solution can be realized with almost perfect parallelism. Our proposed algorithm is a hybrid scheme that combines direct and iterative methods for solving a single banded system of linear equations on parallel architectures. It has broad applications in finite-element analysis, particularly as a parallel solver of banded preconditioners that can be used in conjunction with outer Krylov iterative schemes.     

Third-order iterative methods with applications to Hammerstein equations: A unified approach

The geometrical interpretation of a family of higher order iterative methods for solving nonlinear scalar equations was presented in [S. Amat, S. Busquier, J.M. Gutiérrez, Geometric constructions of iterative functions to solve nonlinear equations. J. Comput. Appl. Math. 157(1) (2003) 197-205]. This family includes, as particular cases, some of the most famous third-order iterative methods: Chebyshev methods, Halley methods, super-Halley methods, C-methods and Newton-type two-step methods. The aim of the present paper is to analyze the convergence of this family for equations defined between two Banach spaces by using a technique developed in [J.A. Ezquerro, M.A. Hernández, Halley’s method for operators with unbounded second derivative. Appl. Numer. Math. 57(3) (2007) 354-360]. This technique allows us to obtain a general semilocal convergence result for these methods, where the usual conditions on the second derivative are relaxed. On the other hand, the main practical difficulty related to the classical third-order iterative methods is the evaluation of bilinear operators, typically second-order Fréchet derivatives. However, in some cases, the second derivative is easy to evaluate. A clear example is provided by the approximation of Hammerstein equations, where it is diagonal by blocks. We finish the paper by applying our methods to some nonlinear integral equations of this type.     

Convergence of generalized AOR iterative method for linear systems with strictly diagonally dominant matrices

In this paper, some improvements on Darvishi and Hessari [On convergence of the generalized AOR method for linear systems with diagonally dominant coefficient matrices, Appl. Math. Comput. 176 (2006) 128–133] are presented for bounds of the spectral radius of _lω,r$l_{\omega ,r}$, which is the iterative matrix of the generalized AOR (GAOR) method. Subsequently, some new sufficient conditions for convergence of GAOR method will be given, which improve some results of Darvishi and Hessari [On convergence of the generalized AOR method for linear systems with diagonally dominant coefficient matrices, Appl. Math. Comput. 176 (2006) 128–133].     

Strong convergence theorems for strictly asymptotically pseudocontractive mappings in Hilbert spaces

The purpose of this paper is by using CSQ method to study the strong convergence problem of iterative sequences for a pair of strictly asymptotically pseudocontractive mappings to approximate a common fixed point in a Hilbert space. Under suitable conditions some strong convergence theorems are proved. The results presented in the paper are new which extend and improve some recent results of Acedo and Xu [Iterative methods for strict pseudo-contractions in Hilbert spaces. Nonlinear Anal., 67(7), 2258??271 (2007)], Kim and Xu [Strong convergence of modified Mann iterations for asymptotically nonexpansive mappings and semigroups. Nonlinear Anal., 64, 1140??152 (2006)], Martinez-Yanes and Xu [Strong convergence of the CQ method for fixed point iteration processes. Nonlinear Anal., 64, 2400??411 (2006)], Nakajo and Takahashi [Strong convergence theorems for nonexpansive mappings and nonexpansive semigroups. J. Math. Anal. Appl., 279, 372??79 (2003)], Marino and Xu [Weak and strong convergence theorems for strict pseudocontractions in Hilbert spaces. J. Math. Anal. Appl., 329(1), 336??46 (2007)], Osilike et al. [Demiclosedness principle and convergence theorems for k-strictly asymptotically pseudocontractive maps. J. Math. Anal. Appl., 326, 1334??345 (2007)], Liu [Convergence theorems of the sequence of iterates for asymptotically demicontractive and hemicontractive mappings. Nonlinear Anal., 26(11), 1835??842 (1996)], Osilike et al. [Fixed points of demi-contractive mappings in arbitrary Banach spaces. Panamer Math. J., 12 (2), 77??8 (2002)], Gu [The new composite implicit iteration process with errors for common fixed points of a finite family of strictly pseudocontractive mappings. J. Math. Anal. Appl., 329, 766??76 (2007)].     

Convergence of block iterative methods for linear systems arising in the numerical solution of Euler equations

Summary We discuss block matrices of the formA=[A _ij ], whereA _ij is ak×k symmetric matrix,A _ij is positive definite andA _ij is negative semidefinite. These matrices are natural block-generalizations of Z-matrices and M-matrices. Matrices of this type arise in the numerical solution of Euler equations in fluid flow computations. We discuss properties of these matrices, in particular we prove convergence of block iterative methods for linear systems with such system matrices.     

On nonsingularity of block two-by-two matrices

We derive necessary and sufficient conditions for guaranteeing the nonsingularity of a block two-by-two matrix by making use of the singular value decompositions and the Moore–Penrose pseudoinverses of the matrix blocks. These conditions are complete, and much weaker and simpler than those given by Decker and Keller [D.W. Decker, H.B. Keller, Multiple limit point bifurcation, J. Math. Anal. Appl. 75 (1980) 417–430], and may be more easily examined than those given by Bai [Z.-Z. Bai, Eigenvalue estimates for saddle point matrices of Hermitian and indefinite leading blocks, J. Comput. Appl. Math. 237 (2013) 295–306] from the computational viewpoint. We also derive general formulas for the rank of the block two-by-two matrix by utilizing either the unitarily compressed or the orthogonally projected sub-matrices.     

Operator-splitting methods in respect of eigenvalue problems for nonlinear equations and applications for Burgers equations

In this article we consider iterative operator-splitting methods for nonlinear differential equations with respect to their eigenvalues. The main focus of the proposed idea is the fixed-point iterative scheme that linearizes our underlying equations. On the basis of the approximated eigenvalues of such linearized systems we choose the order of the operators for our iterative splitting scheme. The convergence properties of such a mixed method are studied and demonstrated. We confirm with numerical applications the effectiveness of the proposed scheme in comparison with the standard operator-splitting methods by providing improved results and convergence rates. We apply our results to deposition processes.     

Convergence and optimization of the parallel method of simultaneous directions for the solution of elliptic problems

For the solution of elliptic problems, fractional step methods and in particular alternating directions (ADI) methods are iterative methods where fractional steps are sequential. Therefore, they only accept parallelization at low level. In [T. Lu, P. Neittaanmäki, X.C. Tai, A parallel splitting-up method for partial differential equations and its applications to Navier–Stokes equations, RAIRO Modél. Math. Anal. Numér. 26 (6) (1992) 673–708], Lu et al. proposed a method where the fractional steps can be performed in parallel. We can thus speak of parallel fractional step (PFS) methods and, in particular, simultaneous directions (SDI) methods. In this paper, we perform a detailed analysis of the convergence and optimization of PFS and SDI methods, complementing what was done in [T. Lu, P. Neittaanmäki, X.C. Tai, A parallel splitting-up method for partial differential equations and its applications to Navier–Stokes equations, RAIRO Modél. Math. Anal. Numér. 26 (6) (1992) 673–708]. We describe the behavior of the method and we specify the good choice of the parameters. We also study the efficiency of the parallelization. Some 2D, 3D and high-dimensional tests confirm our results.