Equivalent Optimization Formulations and Error Bounds for Variational Inequality Problems

We investigate whether some merit functions for variational inequality problems (VIP) provide error bounds for the underlying VIP. Under the condition that the involved mapping F is strongly monotone, but not necessarily Lipschitz continuous, we prove that the so-called regularized gap function provides an error bound for the underlying VIP. We give also an example showing that the so-called D-gap function might not provide error bounds for a strongly monotone VIP.This research was supported by United College and by a direct grant of the Chinese University of Hong Kong. The authors thank the referees for helpful comments and suggestions.     

Global Method for Monotone Variational Inequality Problems with Inequality Constraints

We consider optimization methods for monotone variational inequality problems with nonlinear inequality constraints. First, we study the mixed complementarity problem based on the original problem. Then, a merit function for the mixed complementarity problem is proposed, and some desirable properties of the merit function are obtained. Through the merit function, the original variational inequality problem is reformulated as simple bounded minimization. Under certain assumptions, we show that any stationary point of the optimization problem is a solution of the problem considered. Finally, we propose a descent method for the variational inequality problem and prove its global convergence.     

Derivative-Free Methods for Monotone Variational Inequality and Complementarity Problems

Monotone variational inequality problems with box constraints and complementarity problems are reformulated as simple-bound optimization problems. Some derivative-free methods for these problems are proposed. It is shown that, for these new methods, the updated point sequence remains feasible with respect to its simple constraints if the initial point is feasible. Under certain conditions, these methods are globally convergent.     

Convergence and Error Bound of a Method for Solving Variational Inequality Problems via the Generalized D-Gap Function

The variational inequality problem (VIP) can be reformulated as an unconstrained minimization problem through the generalized D-gap function. Recently, a hybrid Newton-type method was proposed by Peng and Fukushima for minimizing a special form of the generalized D-gap function. In this paper, the hybrid Newton-type algorithm is extended to minimize the general form g of the generalized D-gap function. It is shown that the algorithm has nice convergence properties. Under some reasonable conditions, it is proved that the algorithm is locally and globally convergent. Moreover, it is proved that the function g has bounded level sets for strongly monotone VIP. An error bound of the algorithm is obtained.     

Tikhonov Regularization Methods for Variational Inequality Problems

Motivated by the work of Facchinei and Kanzow (Ref. 1) on regularization methods for the nonlinear complementarity problem and the work of Ravindran and Gowda (Ref. 2) for the box variational inequality problem, we study regularization methods for the general variational inequality problem. A sufficient condition is given which guarantees that the union of the solution sets of the regularized problems is nonempty and bounded. It is shown that solutions of the regularized problems form a minimizing sequence of the D-gap function under a mild condition.     

一般无约束优化问题的广义拟牛顿法

对一般目标函数极小化问题的拟牛顿法及其全局收敛性的研究,已经成为拟牛顿法理论中最基本的开问题之一．本文对这个问题做了进一步的研究,对无约束优化问题提出一类新的广义拟牛顿算法,并结合Goldstein线搜索证明了算法对一般非凸目标函数极小化问题的全局收敛性．     

类Broyden族非拟牛顿算法对一般目标函数的全局收敛性

应用双参数的类Broyden族校正公式,为研究求解无约束最优化问题的拟牛顿类算法对一般目标函数的收敛性这个开问题提供了一种新的方法．     

Some Optimization Reformulations of the Extended Linear Complementarity Problem

We consider the extended linear complementarity problem (XLCP) introduced by Mangasarian and Pang [22], of which the horizontal and vertical linear complementarity problems are two special cases. We give some new sufficient conditions for every stationary point of the natural bilinear program associated with XLCP to be a solution of XLCP. We further propose some unconstrained and bound constrained reformulations for XLCP, and study the properties of their stationary points under assumptions similar to those for the bilinear program.     

Inexact Operator Splitting Methods with Selfadaptive Strategy for Variational Inequality Problems

The Peaceman-Rachford and Douglas-Rachford operator splitting methods are advantageous for solving variational inequality problems, since they attack the original problems via solving a sequence of systems of smooth equations, which are much easier to solve than the variational inequalities. However, solving the subproblems exactly may be prohibitively difficult or even impossible. In this paper, we propose an inexact operator splitting method, where the subproblems are solved approximately with some relative error tolerance. Another contribution is that we adjust the scalar parameter automatically at each iteration and the adjustment parameter can be a positive constant, which makes the methods more practical and efficient. We prove the convergence of the method and present some preliminary computational results, showing that the proposed method is promising. This work was supported by the NSFC grant 10501024.     

Smoothing Functions and Smoothing Newton Method for Complementarity and Variational Inequality Problems

This paper provides for the first time some computable smoothing functions for variational inequality problems with general constraints. This paper proposes also a new version of the smoothing Newton method and establishes its global and superlinear (quadratic) convergence under conditions weaker than those previously used in the literature. These are achieved by introducing a general definition for smoothing functions, which include almost all the existing smoothing functions as special cases.     

无约束最优化中的一阶曲线法

本文对无约束最优化问题提出一阶曲线法，给出其全局收敛结果．对由微分方程定义的一阶曲线，提出渐近收敛指数概念，并计算出几个常用曲线模型的渐近收敛指数．     

D-Gap Functions for Nonsmooth Variational Inequality Problems

We study the Clarke generalized gradient of the D-gap functions for the variational inequality problem (VIP) defined by a locally Lipschitz, but not necessarily differentiable, function in an Euclidean space. Using these results, we study the relationship between minimizing sequences and stationary sequences of the D-gap function, regardless of the existence of solutions of (VIP).     

求无约束连续全局优化问题的单参数填充函数法

填充函数法是求解全局优化问题的一个重要的确定性算法,这种方法的关键是构造具有良好性质的填充函数.构造了一个新的求解无约束全局优化问题的填充函数.函数连续可微且只包含一个参数.通过分析该函数的相关性质,设计了相应的算法.数值实验表明该算法简单有效.     

一类带线搜索的非单调信赖域新算法

结合非单调信赖域方法,和非单调线搜索技术,提出了一种新的无约束优化算法.信赖域方法的每一步采用线搜索,使得迭代每一步都充分下降加快了迭代速度.在一定条件下,证明了算法具有全局收敛性和局部超线性.收敛速度.数值试验表明算法是十分有效的.     

求解无约束优化问题的新谱共轭梯度法及其收敛性

强Wolfe条件不能保证标准CD共轭梯度法全局收敛．本文通过建立新的共轭参数,提出无约束优化问题的一个新谱共轭梯度法,该方法在精确线搜索下与标准CD共轭梯度法等价,在标准wolfe线搜索下具有下降性和全局收敛性．初步的数值实验结果表明新方法是有效的,适合于求解非线性无约束优化问题．     

Globally Convergent Algorithms for Unconstrained Optimization

A new globalization strategy for solving an unconstrained minimization problem is proposed based on the idea of combining Newton's direction and the steepest descent direction WITHIN each iteration. Global convergence is guaranteed with an arbitrary initial point. The search direction in each iteration is chosen to be as close to the Newton's direction as possible and could be the Newton's direction itself. Asymptotically the Newton step will be taken in each iteration and thus the local convergence is quadratic. Numerical experiments are also reported. Possible combination of a Quasi-Newton direction with the steepest descent direction is also considered in our numerical experiments. The differences between the proposed strategy and a few other strategies are also discussed.     

An Efficient Hybrid Conjugate Gradient Method for Unconstrained Optimization

Recently, we propose a nonlinear conjugate gradient method, which produces a descent search direction at every iteration and converges globally provided that the line search satisfies the weak Wolfe conditions. In this paper, we will study methods related to the new nonlinear conjugate gradient method. Specifically, if the size of the scalar _k with respect to the one in the new method belongs to some interval, then the corresponding methods are proved to be globally convergent; otherwise, we are able to construct a convex quadratic example showing that the methods need not converge. Numerical experiments are made for two combinations of the new method and the Hestenes–Stiefel conjugate gradient method. The initial results show that, one of the hybrid methods is especially efficient for the given test problems.     

Metric-Based Parameterizations for Multi-Step Unconstrained Optimization

We consider multi-step quasi-Newton methods for unconstrained optimization. These methods were introduced by Ford and Moghrabi (Appl. Math., vol. 50, pp. 305–323, 1994; Optimization Methods and Software, vol. 2, pp. 357–370, 1993), who showed how interpolating curves could be used to derive a generalization of the Secant Equation (the relation normally employed in the construction of quasi-Newton methods). One of the most successful of these multi-step methods makes use of the current approximation to the Hessian to determine the parameterization of the interpolating curve in the variable-space and, hence, the generalized updating formula. In this paper, we investigate new parameterization techniques to the approximate Hessian, in an attempt to determine a better Hessian approximation at each iteration and, thus, improve the numerical performance of such algorithms.     

Solvability of Variational Inequality Problems

This paper presents the new concept of exceptional family of elements for the variational inequality problem with a continuous function over a general unbounded closed convex set. We establish a characterization theorem that can be used to derive several new existence and compactness conditions on the solution set. Our findings generalize well-known results for various types of variational inequality problems. For a pseudomonotone variational inequality problem, our new existence conditions are both sufficient and necessary.     

A Modified Alternating Direction Method for Variational Inequality Problems

The alternating direction method is an attractive method for solving large-scale variational inequality problems whenever the subproblems can be solved efficiently. However, the subproblems are still variational inequality problems, which are as structurally difficult to solve as the original one. To overcome this disadvantage, in this paper we propose a new alternating direction method for solving a class of nonlinear monotone variational inequality problems. In each iteration the method just makes an orthogonal projection to a simple set and some function evaluations. We report some preliminary computational results to illustrate the efficiency of the method. Accepted 4 May 2001. Online publication 19 October, 2001.