Generalized equations and the generalized Newton method

We give some convergence results on the generalized Newton method (referred to by some authors as Newton's method) and the chord method when applied to generalized equations. The main results of the paper extend the classical Kantorovich results on Newton's method to (nonsmooth) generalized equations. Our results also extend earlier results on nonsmooth equations due to Eaves, Robinson, Josephy, Pang and Chan. We also propose inner-iterative schemes for the computation of the generalized Newton iterates. These schemes generalize popular iterative methods (Richardson's method, Jacobi's method and the Gauss-Seidel method) for the solution of linear equations and linear complementarity problems and are shown to be convergent under natural generalizations of classical convergence criteria. Our results are applicable to equations involving single-valued functions and also to a class of generalized equations which includes variational inequalities, nonlinear complementarity problems and some nonsmooth convex minimization problems.     

Composite Nonsmooth Optimization Using Approximate Generalized Gradient Vectors

A new approximation method is presented for directly minimizing a composite nonsmooth function that is locally Lipschitzian. This method approximates only the generalized gradient vector, enabling us to use directly well-developed smooth optimization algorithms for solving composite nonsmooth optimization problems. This generalized gradient vector is approximated on each design variable coordinate by using only the active components of the subgradient vectors; then, its usability is validated numerically by the Pareto optimum concept. In order to show the performance of the proposed method, we solve four academic composite nonsmooth optimization problems and two dynamic response optimization problems with multicriteria. Specifically, the optimization results of the two dynamic response optimization problems are compared with those obtained by three typical multicriteria optimization strategies such as the weighting method, distance method, and min–max method, which introduces an artificial design variable in order to replace the max-value cost function with additional inequality constraints. The comparisons show that the proposed approximation method gives more accurate and efficient results than the other methods.     

A verified inexact implicit Runge–Kutta method for nonsmooth ODEs

Structural pounding and oscillations have been extensively investigated by using ordinary differential equations (ODEs). In many applications, force functions are defined by piecewise continuously differentiable functions and the ODEs are nonsmooth. Implicit Runge–Kutta (IRK) methods for solving the nonsmooth ODEs are numerically stable, but involve systems of nonsmooth equations that cannot be solved exactly in practice. In this paper, we propose a verified inexact IRK method for nonsmooth ODEs which gives a global error bound for the inexact solution. We use the slanting Newton method to solve the systems of nonsmooth equations, and interval method to compute the set of matrices of slopes for the enclosure of solution of the systems. Numerical experiments show that the algorithm is efficient for verification of solution of systems of nonsmooth equations in the inexact IRK method. We report numerical results of nonsmooth ODEs arising from simulation of the collapse of the Tacoma Narrows suspension bridge, steel to steel impact experiment, and pounding between two adjacent structures in 27 ground motion records for 12 different earthquakes. This work is partly supported by a Grant-in-Aid from Japan Society for the Promotion of Science and a scholarship from Egyptian Government.     

Smoothing Newton method for nonsmooth second-order cone complementarity problems with application to electric power markets

This paper is dedicated to solving a nonsmooth second-order cone complementarity problem, in which the mapping is assumed to be locally Lipschitz continuous, but not necessarily to be continuously differentiable everywhere. With the help of the vector-valued Fischer-Burmeister function associated with second-order cones, the nonsmooth second-order cone complementarity problem can be equivalently transformed into a system of nonsmooth equations. To deal with this reformulated nonsmooth system, we present an approximation function by smoothing the inner mapping and the outer Fischer-Burmeister function simultaneously. Different from traditional smoothing methods, the smoothing parameter introduced is treated as an independent variable. We give some conditions under which the Jacobian of the smoothing approximation function is guaranteed to be nonsingular. Based on these results, we propose a smoothing Newton method for solving the nonsmooth second-order cone complementarity problem and show that the proposed method achieves globally superlinear or quadratic convergence under suitable assumptions. Finally, we apply the smoothing Newton method to a network Nash-Cournot game in oligopolistic electric power markets and report some numerical results to demonstrate its effectiveness.

     

Metrically regular mappings and its application to convergence analysis of a confined Newton-type method for nonsmooth generalized equations

Notion of metrically regular property and certain types of point-based approximations are used for solving the nonsmooth generalized equation f(x)+F(x)?0,where X and Y are Banach spaces,and U is an open subset of X,f:U→Y is a nonsmooth function and F:X■Y is a set-valued mapping with closed graph.We introduce a confined Newton-type method for solving the above nonsmooth generalized equation and analyze the semilocal and local convergence of this method.Specifically,under the point-based approximation of f on U and metrically regular property of f+F,we present quadratic rate of convergence of this method.Furthermore,superlinear rate of convergence of this method is provided under the conditions that f admits p-point-based approximation on U and f+F is metrically regular.An example of nonsmooth functions that have p-point-based approximation is given.Moreover,a numerical experiment is given which illustrates the theoretical result.     

Generalized Newton’s method based on graphical derivatives

This paper concerns developing a numerical method of the Newton type to solve systems of nonlinear equations described by nonsmooth continuous functions. We propose and justify a new generalized Newton algorithm based on graphical derivatives, which have never been used to derive a Newton-type method for solving nonsmooth equations. Based on advanced techniques of variational analysis and generalized differentiation, we establish the well-posedness of the algorithm, its local superlinear convergence, and its global convergence of the Kantorovich type. Our convergence results hold with no semismoothness and Lipschitzian assumptions, which is illustrated by examples. The algorithm and main results obtained in the paper are compared with well-recognized semismooth and B-differentiable versions of Newton’s method for nonsmooth Lipschitzian equations.     

An algorithm for composite nonsmooth optimization problems

Nonsmooth optimization problems are divided into two categories. The first is composite nonsmooth problems where the generalized gradient can be approximated by information available at the current point. The second is basic nonsmooth problems where the generalized gradient must be approximated using information calculated at previous iterates.Methods for minimizing composite nonsmooth problems where the nonsmooth function is made up from a finite number of smooth functions, and in particular max functions, are considered. A descent method which uses an active set strategy, a nonsmooth line search, and a quasi-Newton approximation to the reduced Hessian of a Lagrangian function is presented. The Theoretical properties of the method are discussed and favorable numerical experience on a wide range of test problems is reported.This work was carried out at the University of Dundee from 1976–1979 and at the University of Kentucky at Lexington from 1979–1980. The provision of facilities in both universities is gratefully acknowledged, as well as the support of NSF Grant No. ECS-79-23272 for the latter period. The first author also wishes to acknowledge financial support from a George Murray Scholarship from the University of Adelaide and a University of Dundee Research Scholarship for the former period.     

求解摩擦接触问题的一个非内点光滑化算法

给出了一个求解三维弹性有摩擦接触问题的新算法,即基于NCP函数的非内点光滑化算法．首先通过参变量变分原理和参数二次规划法,将三维弹性有摩擦接触问题的分析归结为线性互补问题的求解;然后利用NCP函数,将互补问题的求解转换为非光滑方程组的求解;再用凝聚函数对其进行光滑化,最后用NEWTON法解所得到的光滑非线性方程组．方法具有易于理解及实现方便等特点．通过线性互补问题的数值算例及接触问题实例证实了该算法的可靠性与有效性．     

A trust region method for solving linearly constrained locally Lipschitz optimization problems

In this paper, we present a nonsmooth trust region method for solving linearly constrained optimization problems with a locally Lipschitz objective function. Using the approximation of the steepest descent direction, a quadratic approximation of the objective function is constructed. The null space technique is applied to handle the constraints of the quadratic subproblem. Next, the CG-Steihaug method is applied to solve the new approximation quadratic model with only the trust region constraint. Finally, the convergence of presented algorithm is proved. This algorithm is implemented in the MATLAB environment and the numerical results are reported.     

Implicit Smoothing and Its Application to Optimization with Piecewise Smooth Equality Constraints<Superscript>1</Superscript>

In this paper, we discuss the smoothing of an implicit function defined by a nonsmooth underdetermined system of equations F(y,z) = 0. We apply a class of parametrized smoothing methods to smooth F and investigate the limiting behavior of the implicit function solving the smoothed equations. In particular, we discuss the approximation of the Clarke generalized Jacobian of the implicit function when F is piecewise smooth. As an application, we present an analysis of the generalized Karush-Kuhn-Tucker conditions of different forms for a piecewise-smooth equality-constrained minimization problem. This work was supported by the Australian Research Council. It was carried out mainly while the authors were working at the Department of Mathematics and Statistics, University of Melbourne, Melbourne, Australia. The authors appreciate the helpful comments of two anonymous referees.Communicated by Z. Q. Luo     

求解无限维非线性互补问题的光滑化牛顿法

研究一类无限维非线性互补问题的光滑化牛顿法.借助于非线性互补函数,将无限维非线性互补问题转化为一个非光滑算子方程.构造光滑算子逼近非光滑算子,在光滑逼近算子满足方向可微相容性的条件下,证明了光滑化牛顿法具有超线性收敛性.     

CALCULATING AN ELEMENT OF B-DIFFERENTIAL FOR A VECTOR-VALUED MAXIMUM FUNCTION*

In this paper, we propose a method of calculating an element of B-differential, also an element of Clarke generalized Jacobian, for a vector-valued maximum function. This calculation is required in many existing numerical methods for the solution of nonsmooth equations and for the nonsmooth optimization. The generalization of our method to a vector-valued smooth composition of maximum functions is also discussed. Particularly, we propose a method of obtaining the set of B-differential for a vector-valued maximum of affine functions.

     

An approximate bundle method for solving nonsmooth equilibrium problems

We present an approximate bundle method for solving nonsmooth equilibrium problems. An inexact cutting-plane linearization of the objective function is established at each iteration, which is actually an approximation produced by an oracle that gives inaccurate values for the functions and subgradients. The errors in function and subgradient evaluations are bounded and they need not vanish in the limit. A descent criterion adapting the setting of inexact oracles is put forward to measure the current descent behavior. The sequence generated by the algorithm converges to the approximately critical points of the equilibrium problem under proper assumptions. As a special illustration, the proposed algorithm is utilized to solve generalized variational inequality problems. The numerical experiments show that the algorithm is effective in solving nonsmooth equilibrium problems.     

解奇异非光滑方程组的牛顿法和不精确牛顿法

本文主要解决奇异非光滑方程组的解法。应用一种新的次微分的外逆，我们提出了牛顿法和不精确牛顿法，它们的收敛性同时也得到了证明。这种方法能更容易在一引起实际应用中实现。这种方法可以看作是已存在的解非光滑方程组的方法的延伸。     

Banach空间中非光滑算子方程的光滑化拟牛顿法

研究Banach空间中非光滑算子方程的光滑化拟牛顿法.构造光滑算子逼近非光滑算子,在光滑逼近算子满足方向可微相容性的条件下,证明了光滑化拟牛顿法具有局部超线性收敛性质.应用说明了算法的有效性.     

Newton Methods for Solving Two Classes of Nonsmooth Equations

The paper is devoted to two systems of nonsmooth equations. One is the system of equations of max-type functions and the other is the system of equations of smooth compositions of max-type functions. The Newton and approximate Newton methods for these two systems are proposed. The Q-superlinear convergence of the Newton methods and the Q-linear convergence of the approximate Newton methods are established. The present methods can be more easily implemented than the previous ones, since they do not require an element of Clarke generalized Jacobian, of B-differential, or of b-differential, at each iteration point.     

Set-valued approximations and Newton’s methods

n to R^m. Under the assumption of semi-smoothness of the mapping, we prove that the approximation can be obtained through the Clarke generalized Jacobian, Ioffe-Ralph generalized Jacobian, B-subdifferential and their approximations. As an application, we propose a generalized Newton’s method based on the point-based set-valued approximation for solving nonsmooth equations. We show that the proposed method converges locally superlinearly without the assumption of semi-smoothness. Finally we include some well-known generalized Newton’s methods in our method and consolidate the convergence results of these methods. Received October 2, 1995 / Revised version received May 5, 1998 Published online October 9, 1998     

A nonlinear descent method for a variational inequality on a nonconvex set

In this paper, we consider a generalized variational inequality problem which involves the integrable cost mapping and a nonsmooth mapping with convex components. We propose a new gradient-type method which determines a stepsize by using the smooth part of the cost function. Thus, the method does not utilize analogs of derivatives of nonsmooth functions. We show that its convergence does not require additional assumptions.     

On numerical solution of hemivariational inequalities by nonsmooth optimization methods

In this paper we consider numerical solution of hemivariational inequalities (HVI) by using nonsmooth, nonconvex optimization methods. First we introduce a finite element approximation of (HVI) and show that it can be transformed to a problem of finding a substationary point of the corresponding potential function. Then we introduce a proximal budle method for nonsmooth nonconvex and constrained optimization. Numerical results of a nonmonotone contact problem obtained by the developed methods are also presented.     

非光滑方程组牛顿法的全局收敛性分析

通过定义一种新的*-微分,本文给出了局部Lipschitz非光滑方程组的牛顿法,并对其全局收敛性进行了研究.该牛顿法结合了非光滑方程组的局部收敛性和全局收敛性.最后,我们把这种牛顿法应用到非光滑函数的光滑复合方程组问题上,得到了较好的收敛性.