Iterative algorithms with variable anchors for non-expansive mappings

In this paper, we suggest and analyze some new iterative algorithms with variable anchors for non-expansive mapping in Banach spaces. We prove that the proposed iterative algorithms converge strongly to a fixed point of some non-expansive mapping. We also obtain some corollaries which include some results as special cases. Furthermore, we conclude the strong convergence of the so-called viscosity iterative algorithms.     

Strong convergence theorems for strict pseudo-contractions in Hilbert spaces

In this paper, we suggest and analyze some iterative algorithms for strict pseudo-contractions in the sense of Browder-Petryshyn in a real Hilbert space. We prove that the proposed iterative algorithms converge strongly to some fixed point of a strict pseudo-contraction.     

New algorithms for the split variational inclusion problems and application to split feasibility problems

ABSTRACT

In this paper, we suggest two new iterative methods for finding an element of the solution set of split variational inclusion problem in real Hilbert spaces. Under suitable conditions, we present weak and strong convergence theorems for these methods. We also apply the proposed algorithms to study the split feasibility problem. Finally, we give some numerical results which show that our proposed algorithms are efficient and implementable from the numerical point of view.     

A new iterative method for solving split feasibility problem

In this paper, we construct a new iterative algorithm and show that the newly introduced iterative algorithm converges faster than a number of existing iterative algorithms for contractive-like mappings. We present a numerical example followed by graphs to validate our claim. We prove strong and weak convergence results for approximating fixed points of generalized $\alpha$-nonexpansive mappings. Again we reconfirm our results by an example and table. Further, we utilize our proposed algorithm to solve split feasibility problem.     

Several iterative algorithms for solving the split common fixed point problem of directed operators with applications

In this paper, we propose a new simultaneous iterative algorithm for solving the split common fixed point problem of directed operators. Inspired by the idea of cyclic iterative algorithm, we also introduce two iterative algorithms which combine the process of cyclic and simultaneous together. Under mild assumptions, we prove convergence of the proposed iterative sequences. As applications, we obtain several iteration schemes to solve the inverse problem of multiple-sets split feasibility problem. Numerical experiments are presented to confirm the efficiency of the proposed iterative algorithms.     

New extragradient methods for solving variational inequality problems and fixed point problems

In this paper, we introduce two new iterative algorithms for finding a common element of the set of fixed points of a quasi-nonexpansive mapping and the set of solutions of the variational inequality problem with a monotone and Lipschitz continuous mapping in real Hilbert spaces, by combining a modified Tseng’s extragradient scheme with the Mann approximation method. We prove weak and strong convergence theorems for the sequences generated by these iterative algorithms. The main advantages of our algorithms are that the construction of solution approximations and the proof of convergence of the algorithms are performed without the prior knowledge of the Lipschitz constant of cost operators. Finally, we provide numerical experiments to show the efficiency and advantage of the proposed algorithms.     

Weighted least squares solutions to general coupled Sylvester matrix equations

This paper is concerned with weighted least squares solutions to general coupled Sylvester matrix equations. Gradient based iterative algorithms are proposed to solve this problem. This type of iterative algorithm includes a wide class of iterative algorithms, and two special cases of them are studied in detail in this paper. Necessary and sufficient conditions guaranteeing the convergence of the proposed algorithms are presented. Sufficient conditions that are easy to compute are also given. The optimal step sizes such that the convergence rates of the algorithms, which are properly defined in this paper, are maximized and established. Several special cases of the weighted least squares problem, such as a least squares solution to the coupled Sylvester matrix equations problem, solutions to the general coupled Sylvester matrix equations problem, and a weighted least squares solution to the linear matrix equation problem are simultaneously solved. Several numerical examples are given to illustrate the effectiveness of the proposed algorithms.     

求解单调变分不等式的两类迭代算法

给出了求解单调变分不等式的两类迭代算法．通过解强单调变分不等式子问题,产生两个迭代点列,都弱收敛到变分不等式的解．最后,给出了这两类新算法的收敛性分析．     

On a new family of high‐order iterative methods for the matrix pth root

The main goal of this paper is to approximate the principal pth root of a matrix by using a family of high‐order iterative methods. We analyse the semi‐local convergence and the speed of convergence of these methods. Concerning stability, it is well known that even the simplified Newton method is unstable. Despite it, we present stable versions of our family of algorithms. We test numerically the methods: we check the numerical robustness and stability by considering matrices that are close to be singular and badly conditioned. We find algorithms of the family with better numerical behavior than the Newton and the Halley methods. These two algorithms are basically the iterative methods proposed in the literature to solve this problem. Copyright © 2015 John Wiley & Sons, Ltd.     

Algorithms for nonlinear mixed variational inequalities

In this paper, we establish the equivalence between the generalized nonlinear mixed variational inequalities and the generalized resolvent equations. This equivalence is used to suggest and analyze a number of iterative algorithms for solving generalized variational inequalities. We also discuss the convergence analysis of the proposed algorithms. As special cases, we obtain various known results from our results.     

Algorithms for Unconstrained Optimization Problems via Control Theory

Existing algorithms for solving unconstrained optimization problems are generally only optimal in the short term. It is desirable to have algorithms which are long-term optimal. To achieve this, the problem of computing the minimum point of an unconstrained function is formulated as a sequence of optimal control problems. Some qualitative results are obtained from the optimal control analysis. These qualitative results are then used to construct a theoretical iterative method and a new continuous-time method for computing the minimum point of a nonlinear unconstrained function. New iterative algorithms which approximate the theoretical iterative method and the proposed continuous-time method are then established. For convergence analysis, it is useful to note that the numerical solution of an unconstrained optimization problem is none other than an inverse Lyapunov function problem. Convergence conditions for the proposed continuous-time method and iterative algorithms are established by using the Lyapunov function theorem.     

Practical Quasi-Newton algorithms for singular nonlinear systems

Quasi-Newton methods for solving singular systems of nonlinear equations are considered in this paper. Singular roots cause a number of problems in implementation of iterative methods and in general deteriorate the rate of convergence. We propose two modifications of QN methods based on Newton’s and Shamanski’s method for singular problems. The proposed algorithms belong to the class of two-step iterations. Influence of iterative rule for matrix updates and the choice of parameters that keep iterative sequence within convergence region are empirically analyzed and some conclusions are obtained.     

A Stochastic Approximation Frame Algorithm with Adaptive Directions

Stochastic approximation problem is to find some root or extremum of a non- linear function for which only noisy measurements of the function are available.The classical algorithm for stochastic approximation problem is the Robbins-Monro (RM) algorithm,which uses the noisy evaluation of the negative gradient direction as the iterative direction.In order to accelerate the RM algorithm,this paper gives a flame algorithm using adaptive iterative directions.At each iteration,the new algorithm goes towards either the noisy evaluation of the negative gradient direction or some other directions under some switch criterions.Two feasible choices of the criterions are pro- posed and two corresponding flame algorithms are formed.Different choices of the directions under the same given switch criterion in the flame can also form different algorithms.We also proposed the simultanous perturbation difference forms for the two flame algorithms.The almost surely convergence of the new algorithms are all established.The numerical experiments show that the new algorithms are promising.     

可数族弱Bregman相对非扩展映像的收敛性分析

在自反Banach空间中,引入可数族弱Bregman相对非扩张映像概念,构造了两种迭代算法求解可数族弱Bregman相对非扩张映像的公共不动点.在适当条件下,证明了两种迭代算法产生的序列的强收敛性.     

Non-monotone projection gradient method for non-negative matrix factorization

Since Non-negative Matrix Factorization (NMF) was first proposed over a decade ago, it has attracted much attention, particularly when applied to numerous data analysis problems. Most of the existing algorithms for NMF are based on multiplicative iterative and alternating least squares algorithms. However, algorithms based on the optimization method are few, especially in the case where two variables are derived at the same time. In this paper, we propose a non-monotone projection gradient method for NMF and establish the convergence results of our algorithm. Experimental results show that our algorithm converges to better solutions than popular multiplicative update-based algorithms.     

Implicit iterative algorithms for asymptotically nonexpansive mappings in the intermediate sense and Lipschitz-continuous monotone mappings

In this paper, we introduce some implicit iterative algorithms for finding a common element of the set of fixed points of an asymptotically nonexpansive mapping in the intermediate sense and the set of solutions of the variational inequality problem for a monotone, Lipschitz-continuous mapping. These implicit iterative algorithms are based on two well-known methods: extragradient and approximate proximal methods. We obtain some weak convergence theorems for these implicit iterative algorithms. Based on these theorems, we also construct some implicit iterative processes for finding a common fixed point of two mappings, such that one of these two mappings is taken from the more general class of Lipschitz pseudocontractive mappings and the other mapping is asymptotically nonexpansive.     

Resolvent equations technique for variational inequalities

In this paper, we establish the equivalence between the general resolvent equations and variational inequalities. This equivalence is used to suggest and analyze a number of iterative algorithms for solving variational inclusions. We also study the convergence criteria of the iterative algorithms. Our results include several previously known results as special cases.     

Mann-Type Steepest-Descent and Modified Hybrid Steepest-Descent Methods for Variational Inequalities in Banach Spaces

In this paper, we propose three different kinds of iteration schemes to compute the approximate solutions of variational inequalities in the setting of Banach spaces. First, we suggest Mann-type steepest-descent iterative algorithm, which is based on two well-known methods: Mann iterative method and steepest-descent method. Second, we introduce modified hybrid steepest-descent iterative algorithm. Third, we propose modified hybrid steepest-descent iterative algorithm by using the resolvent operator. For the first two cases, we prove the convergence of sequences generated by the proposed algorithms to a solution of a variational inequality in the setting of Banach spaces. For the third case, we prove the convergence of the iterative sequence generated by the proposed algorithm to a zero of an operator, which is also a solution of a variational inequality.     

Iterative learning control for discrete-time switched singular systems

This paper deals with the problem of iterative learning control for a class of discrete-time switched singular systems with arbitrary switching rules. According to the characteristics of the systems, two types of iterative learning algorithms are proposed and the corresponding convergence conditions of the algorithms are established. Under some given assumptions, the algorithms can ensure the system state converges to the desired state trajectory on a finite time interval. Finally, two numerical examples are constructed to support the theoretical analysis.     

一类Riccati方程组对称自反解的两种迭代算法

针对源于Markov跳变线性二次控制问题中的一类对偶代数Riccati方程组,分别采用修正共轭梯度算法和正交投影算法作为非精确Newton算法的内迭代方法,建立求其对称自反解的非精确Newton-MCG算法和非精确Newton-OGP算法.两种迭代算法仅要求Riccati方程组存在对称自反解,对系数矩阵等没有附加限定.数值算例表明,两种迭代算法是有效的.