Self-adaptive operator splitting methods for monotone variational inequalities

Summary. Solving a variational inequality problem VI(Ω,F) is equivalent to finding a solution of a system of nonsmooth equations (a hard problem). The Peaceman-Rachford and /or Douglas-Rachford operator splitting methods are advantageous when they are applied to solve variational inequality problems, because they solve the original problem via solving a series of systems of nonlinear smooth equations (a series of easy problems). Although the solution of VI(Ω,F) is invariant under multiplying F by some positive scalar β, yet the numerical experiment has shown that the number of iterations depends significantly on the positive parameter β which is a constant in the original operator splitting methods. In general, it is difficult to choose a proper parameter β for individual problems. In this paper, we present a modified operator splitting method which adjusts the scalar parameter automatically per iteration based on the message of the iterates. Exact and inexact forms of the modified method with self-adaptive variable parameter are suggested and proved to be convergent under mild assumptions. Finally, preliminary numerical tests show that the self-adaptive adjustment rule is proper and necessary in practice.     

A Modified Alternating Direction Method for Variational Inequality Problems

The alternating direction method is an attractive method for solving large-scale variational inequality problems whenever the subproblems can be solved efficiently. However, the subproblems are still variational inequality problems, which are as structurally difficult to solve as the original one. To overcome this disadvantage, in this paper we propose a new alternating direction method for solving a class of nonlinear monotone variational inequality problems. In each iteration the method just makes an orthogonal projection to a simple set and some function evaluations. We report some preliminary computational results to illustrate the efficiency of the method. Accepted 4 May 2001. Online publication 19 October, 2001.     

Splitting Algorithms for General Pseudomonotone Mixed Variational Inequalities

In this paper, we suggest and analyze a number of resolvent-splitting algorithms for solving general mixed variational inequalities by using the updating technique of the solution. The convergence of these new methods requires either monotonicity or pseudomonotonicity of the operator. Proof of convergence is very simple. Our new methods differ from the existing splitting methods for solving variational inequalities and complementarity problems. The new results are versatile and are easy to implement.     

An inexact parallel splitting augmented Lagrangian method for large system of linear equations

Parallel iterative methods are powerful in solving large systems of linear equations (LEs). The existing parallel computing research results focus mainly on sparse systems or others with particular structure. Most are based on parallel implementation of the classical relaxation methods such as Gauss-Seidel, SOR, and AOR methods which can be efficiently carried out on multiprocessor system. In this paper, we propose a novel parallel splitting operator method in which we divide the coefficient matrix into two or three parts. Then we convert the original problem (LEs) into a monotone (linear) variational inequality problem (VI) with separable structure. Finally, an inexact parallel splitting augmented Lagrangian method is proposed to solve the variational inequality problem (VI). To avoid dealing with the matrix inverse operator, we introduce proper inexact terms in subproblems such that the complexity of each iteration of the proposed method is O(n²). In addition, the proposed method does not require any special structure of system of LEs under consideration. Convergence of the proposed methods in dealing with two and three separable operators respectively, is proved. Numerical computations are provided to show the applicability and robustness of the proposed methods.     

An operator splitting method for monotone variational inequalities with a new perturbation strategy

In variational inequalities arising from applications such as engineering, economics and transportation, partial mappings are usually unknown, e.g., the demand function in traffic assignment problem. As a consequence, classical methods can not deal with this class of problems. On the other hand, the recently developed methods require restrictive conditions such as strong monotonicity of some mappings, which excludes many interesting applications. In this paper, we propose an operator splitting method with a new perturbation strategy for solving variational inequality problems with partially unknown mappings. Under the mild condition that the underlying mapping is monotone, we prove the global convergence of the method. We also report some preliminary numerical results which show that the new algorithm is also interesting from the numerical point of view.     

New Alternating Direction Method for a Class of Nonlinear Variational Inequality Problems

The alternating direction method is an attractive method for a class of variational inequality problems if the subproblems can be solved efficiently. However, solving the subproblems exactly is expensive even when the subproblem is strongly monotone or linear. To overcome this disadvantage, this paper develops a new alternating direction method for cocoercive nonlinear variational inequality problems. To illustrate the performance of this approach, we implement it for traffic assignment problems with fixed demand and for large-scale spatial price equilibrium problems.     

Modified resolvent splitting algorithms for general mixed variational inequalities

In this paper, we suggest and analyze a number of four-step resolvent splitting algorithms for solving general mixed variational inequalities by using the updating technique of the solution. The convergence of these new methods requires either monotonicity or pseudomonotonicity of the operator. Proof of convergence is very simple. Our new methods differ from the existing splitting methods for solving variational inequalities and complementarity problems. The new results are versatile and are easy to implement.     

Inexact Newton methods for the nonlinear complementarity problem

An exact Newton method for solving a nonlinear complementarity problem consists of solving a sequence of linear complementarity subproblems. For problems of large size, solving the subproblems exactly can be very expensive. In this paper we study inexact Newton methods for solving the nonlinear, complementarity problem. In such an inexact method, the subproblems are solved only up to a certain degree of accuracy. The necessary accuracies that are needed to preserve the nice features of the exact Newton method are established and analyzed. We also discuss some extensions as well as an application. This research was based on work supported by the National Science Foundation under grant ECS-8407240.     

Extended Projection Methods for Monotone Variational Inequalities

In this paper, we prove that each monotone variational inequality is equivalent to a two-mapping variational inequality problem. On the basis of this fact, a new class of iterative methods for the solution of nonlinear monotone variational inequality problems is presented. The global convergence of the proposed methods is established under the monotonicity assumption. The conditions concerning the implementability of the algorithms are also discussed. The proposed methods have a close relationship to the Douglas–Rachford operator splitting method for monotone variational inequalities.     

An inexact parallel splitting augmented Lagrangian method for monotone variational inequalities with separable structures

Splitting methods have been extensively studied in the context of convex programming and variational inequalities with separable structures. Recently, a parallel splitting method based on the augmented Lagrangian method (abbreviated as PSALM) was proposed in He (Comput. Optim. Appl. 42:195?C212, 2009) for solving variational inequalities with separable structures. In this paper, we propose the inexact version of the PSALM approach, which solves the resulting subproblems of PSALM approximately by an inexact proximal point method. For the inexact PSALM, the resulting proximal subproblems have closed-form solutions when the proximal parameters and inexact terms are chosen appropriately. We show the efficiency of the inexact PSALM numerically by some preliminary numerical experiments.     

Proximal Methods for Mixed Variational Inequalities

A proximal point method for solving mixed variational inequalities is suggested and analyzed by using the auxiliary principle technique. It is shown that the convergence of the proposed method requires only the pseudomonotonicity of the operator, which is a weaker condition than monotonicity. As special cases, we obtain various known and new results for solving variational inequalities and related problems. Our proof of convergence is very simple as compared with other methods.     

解可分离结构变分不等式的一种新的交替方向法

交替方向法是求解可分离结构变分不等式问题的经典方法之一, 它将一个大型的变分不等式问题分解成若干个小规模的变分不等式问题进行迭代求解. 但每步迭代过程中求解的子问题仍然摆脱不了求解变分不等式子问题的瓶颈. 从数值计算上来说, 求解一个变分不等式并不是一件容易的事情.因此, 本文提出一种新的交替方向法, 每步迭代只需要求解一个变分不等式子问题和一个强单调的非线性方程组子问题. 相对变分不等式问题而言, 我们更容易、且有更多的有效算法求解一个非线性方程组问题. 在与经典的交替方向法相同的假设条件下, 我们证明了新算法的全局收敛性. 进一步的数值试验也验证了新算法的有效性.     

A matrix-splitting method for symmetric affine second-order cone complementarity problems

The affine second-order cone complementarity problem (SOCCP) is a wide class of problems that contains the linear complementarity problem (LCP) as a special case. The purpose of this paper is to propose an iterative method for the symmetric affine SOCCP that is based on the idea of matrix splitting. Matrix-splitting methods have originally been developed for the solution of the system of linear equations and have subsequently been extended to the LCP and the affine variational inequality problem. In this paper, we first give conditions under which the matrix-splitting method converges to a solution of the affine SOCCP. We then present, as a particular realization of the matrix-splitting method, the block successive overrelaxation (SOR) method for the affine SOCCP involving a positive definite matrix, and propose an efficient method for solving subproblems. Finally, we report some numerical results with the proposed algorithm, where promising results are obtained especially for problems with sparse matrices.     

A generalized proximal-point-based prediction–correction method for variational inequality problems

In a class of variational inequality problems arising frequently from applications, the underlying mappings have no explicit expression, which make the subproblems involved in most numerical methods for solving them difficult to implement. In this paper, we propose a generalized proximal-point-based prediction–correction method for solving such problems. At each iteration, we first find a prediction point, which only needs several function evaluations; then using the information from the prediction, we update the iteration. Under mild conditions, we prove the global convergence of the method. The preliminary numerical results illustrate the simplicity and effectiveness of the method.     

Iterative methods for variational and complementarity problems

In this paper, we study both the local and global convergence of various iterative methods for solving the variational inequality and the nonlinear complementarity problems. Included among such methods are the Newton and several successive overrelaxation algorithms. For the most part, the study is concerned with the family of linear approximation methods. These are iterative methods in which a sequence of vectors is generated by solving certain linearized subproblems. Convergence to a solution of the given variational or complementarity problem is established by using three different yet related approaches. The paper also studies a special class of variational inequality problems arising from such applications as computing traffic and economic spatial equilibria. Finally, several convergence results are obtained for some nonlinear approximation methods.This research was based on work supported by the National Science Foundation under grant ECS-7926320.     

A class of new iterative methods for general mixed variational inequalities

In this paper, we use the auxiliary principle technique to suggest a class of predictor-corrector methods for solving general mixed variational inequalities. The convergence of the proposed methods only requires the partially relaxed strongly monotonicity of the operator, which is weaker than co-coercivity. As special cases, we obtain a number of known and new results for solving various classes of variational inequalities and related problems.     

一类求解单调变分不等式的隐式方法

1．引言变分不等式是一个非常有趣。非常困难的数学问题［"］．它具有广泛的应用（例如，数学规划中的许多基本问题都可以归结为一个变分不等式问题），因而得到深入的研究并有了不少算法［1，2，5－8，17－21］．对线性单调变分不等式，我们最近提出了一系列投影收缩算法Ig－13］．本文考虑求解单调变分不等式其中0CW是一闭凸集，F是从正p到自身的一个单调算子，一即有我们用比（·）表示到0上的投影．求解单调变分不等式的一个简单方法是基本投影法［1，6］，它的迭代式为然而，如果F不是仿射函数，只有当F一致强单调且LIPSChitZ连续…     

Solving policy design problems: Alternating direction method of multipliers-based methods for structured inverse variational inequalities

Inverse variational inequalities have broad applications in various disciplines, and some of them have very appealing structures. There are several algorithms (e.g., proximal point algorithms and projection-type algorithms) for solving the inverse variational inequalities in general settings, while few of them have fully exploited the special structures. In this paper, we consider a class of inverse variational inequalities that has a separable structure and linear constraints, which has its root in spatial economic equilibrium problems. To design an efficient algorithm, we develop an alternating direction method of multipliers (ADMM) based method by utilizing the separable structure. Under some mild assumptions, we prove its global convergence. We propose an improved variant that makes the subproblems much easier and derive the convergence result under the same conditions. Finally, we present the preliminary numerical results to show the capability and efficiency of the proposed methods.     

A fast numerical method for solving coupled Burgers' equations

A new fast numerical scheme is proposed for solving time‐dependent coupled Burgers' equations. The idea of operator splitting is used to decompose the original problem into nonlinear pure convection subproblems and diffusion subproblems at each time step. Using Taylor's expansion, the nonlinearity in convection subproblems is explicitly treated by resolving a linear convection system with artificial inflow boundary conditions that can be independently solved. A multistep technique is proposed to rescue the possible instability caused by the explicit treatment of the convection system. Meanwhile, the diffusion subproblems are always self‐adjoint and coercive at each time step, and they can be efficiently solved by some existing preconditioned iterative solvers like the preconditioned conjugate galerkin method, and so forth. With the help of finite element discretization, all the major stiffness matrices remain invariant during the time marching process, which makes the present approach extremely fast for the time‐dependent nonlinear problems. Finally, several numerical examples are performed to verify the stability, convergence and performance of the new method.© 2017 Wiley Periodicals, Inc. Numer Methods Partial Differential Eq 33: 1823–1838, 2017     

求解单调变分不等式问题的一类迭代方法

１．引言 变分不等式问题在数学规划中起着重要作用,它最初作为研究偏微分方程的工具,首先由 Ｆｉｓｈｅｒａ和 Ｓｔａｍｐａｃｃｈｉａ等于六十年代初提出,可参看［１］及其参考文献,之后也被广泛用于研究经济学和运筹学等领域中的均衡模型,互补问题和凸规划问题都是变分不等式问题的特殊情形,文献［２］对有限维变分不等式问题和非线性互补问题的理论、算法及应用作了十分全面的综述．设 Ｃ是实有限维空间 Ｒｎ,的非空闲凸子集, Ｆ是 Ｒｎ → Ｒｎ的映射,本文讨论的变分不等式问题ＶＩ（Ｃ,Ｆ）是： 求向量ｒ＊∈Ｃ．使得：Ｆ（…