混合互补问题的光滑算法及收敛性

利用Fischer-Burmeister函数将混合互补问题转化为非线性方程组,由光滑函数逼近FB函数来求解非线性方程组．文中将信赖域方法和梯度法相结合,提出了Jacobian光滑化方法．算法在一定条件下的全局收敛性得到了证明,数值试验表明算法切实有效,有一定的优越性．     

一类新的Lagrangian乘子法

本文提出了求解光滑不等式约束最优化问题新的乘子法,在增广Lagrangian函数中,使用了新的NCP函数的乘子法．该方法在增广Lagrangian函数和原问题之间存在很好的等价性;同时该方法具有全局收敛性,且在适当假设下,具有超线性收敛率．本文给出了一个有效选择参数C的方法．     

Convergence Properties of Generalized Fourier Series on a Parallel Hexagon Domain

A new Rogosinski-type kernel function is constructed using kernel function of partial sums Sn（f; t） of generalized Fourier series on a parallel hexagon domain Ω associating with threedirection partition. We prove that an operator Wn（f; t） with the new kernel function converges uniformly to any continuous function f（t） ∈ Cn（Ω） （the space of all continuous functions with period Ω） on Ω. Moreover, the convergence order of the operator is presented for the smooth approached function.     

A QP Free Feasible Method

In [12], a QP free feasible method was proposed for the minimization of a smooth function subject to smooth inequality constraints. This method is based on the solutions of linear systems of equations, the reformulation of the KKT optimality conditions by using the Fischer-Burmeister NCP function. This method ensures the feasibility of all iterations. In this paper, we modify the method in [12] slightly to obtain the local convergence under some weaker conditions. In particular, this method is implementable and globally convergent without assuming the linear independence of the gradients of active constrained functions and the uniformly positive definiteness of the submatrix obtained by the Newton or Quasi Newton methods. We also prove that the method has superlinear convergence rate under some mild conditions. Some preliminary numerical results indicate that this new QP free feasible method is quite promising.     

A Coordinate Gradient Descent Method for Nonsmooth Nonseparable Minimization

This paper presents a coordinate gradient descent approach for minimizing the sum of a smooth function and a nonseparable convex function. We find a search direction by solving a subproblem obtained by a second-order approximation of the smooth function and adding a separable convex function. Under a local Lipschitzian error bound assumption, we show that the algorithm possesses global and local linear convergence properties. We also give some numerical tests (including image recovery examples) to illustrate the efficiency of the proposed method.     

Approximate approximations from scattered data

The aim of this paper is to extend the approximate quasi-interpolation on a uniform grid by dilated shifts of a smooth and rapidly decaying function to scattered data quasi-interpolation. It is shown that high order approximation of smooth functions up to some prescribed accuracy is possible, if the basis functions, which are centered at the scattered nodes, are multiplied by suitable polynomials such that their sum is an approximate partition of unity. For Gaussian functions we propose a method to construct the approximate partition of unity and describe an application of the new quasi-interpolation approach to the cubature of multi-dimensional integral operators.     

Homotopy method for solving mathematical programs with bounded box-constrained variational inequalities

ABSTRACT

On the basis of Robinson's normal equation and smoothing projection operator, a homotopy method for solving mathematical programs with box-constrained variational inequalities (MPBVI) is presented. In which, the Chen–Harker–Kanzow–Smale smooth function is used to transform MPBVI into a smooth optimization problem. Under some mild assumptions, the existence and global convergence of a smooth path from almost any initial point to the GKKT point of the approximate problems is proven. And, the convergence of the GKKT point to a strong C-stationary point of the original problems is proved. Finally, some numerical results are given to show the effectiveness and feasibility of the homotopy method.     

A Fast Space-decomposition Scheme for Nonconvex Eigenvalue Optimization

In this paper, a nonsmooth bundle algorithm to minimize the maximum eigenvalue function of a nonconvex smooth function is presented. The bundle method uses an oracle to compute separately the function and subgradient information for a convex function, and the function and derivative values for the smooth mapping. Using this information, in each iteration, we replace the smooth inner mapping by its Taylor-series linearization around the current serious step. To solve the convex approximate eigenvalue problem with affine mapping faster, we adopt the second-order bundle method based on ????-decomposition theory. Through the backtracking test, we can make a better approximation for the objective function. Quadratic convergence of our special bundle method is given, under some additional assumptions. Then we apply our method to some particular instance of nonconvex eigenvalue optimization, specifically: bilinear matrix inequality problems.     

A truncated aggregate smoothing Newton method for minimax problems

Aggregate function is a useful smoothing function to the max-function of some smooth functions and has been used to solve minimax problems, linear and nonlinear programming, generalized complementarity problems, etc. The aggregate function is a single smooth but complex function, its gradient and Hessian calculations are time-consuming. In this paper, a truncated aggregate smoothing stabilized Newton method for solving minimax problems is presented. At each iteration, only a small subset of the components in the max-function are aggregated, hence the number of gradient and Hessian calculations is reduced dramatically. The subset is adaptively updated with some truncating criterions, concerning only with computation of function values and not their gradients or Hessians, to guarantee the global convergence and, for the inner iteration, locally quadratic convergence with as few computational cost as possible. Numerical results show the efficiency of the proposed algorithm.     

箱约束变分不等式的一个简单光滑价值函数和阻尼牛顿法

通过引入中间值函数的一类光滑价值函数,构造了箱约束变分不等式的一种新的光滑价值函数,该函数形式简单且具有良好的微分性质．基于此给出了求解箱约束变分不等式的一种阻尼牛顿算法,在较弱的条件下,证明了算法的全局收敛性和局部超线性收敛率,以及对线性箱约束变分不等式的有限步收敛性．数值实验结果表明了算法可靠有效的实用性能．     

Adaptive Restart of the Optimized Gradient Method for Convex Optimization

First-order methods with momentum, such as Nesterov’s fast gradient method, are very useful for convex optimization problems, but can exhibit undesirable oscillations yielding slow convergence rates for some applications. An adaptive restarting scheme can improve the convergence rate of the fast gradient method, when the parameter of a strongly convex cost function is unknown or when the iterates of the algorithm enter a locally strongly convex region. Recently, we introduced the optimized gradient method, a first-order algorithm that has an inexpensive per-iteration computational cost similar to that of the fast gradient method, yet has a worst-case cost function rate that is twice faster than that of the fast gradient method and that is optimal for large-dimensional smooth convex problems. Building upon the success of accelerating the fast gradient method using adaptive restart, this paper investigates similar heuristic acceleration of the optimized gradient method. We first derive a new first-order method that resembles the optimized gradient method for strongly convex quadratic problems with known function parameters, yielding a linear convergence rate that is faster than that of the analogous version of the fast gradient method. We then provide a heuristic analysis and numerical experiments that illustrate that adaptive restart can accelerate the convergence of the optimized gradient method. Numerical results also illustrate that adaptive restart is helpful for a proximal version of the optimized gradient method for nonsmooth composite convex functions.     

A mixed-step algorithm for the approximation of the stationary regime of a diffusion

In some recent papers, some procedures based on some weighted empirical measures related to decreasing-step Euler schemes have been investigated to approximate the stationary regime of a diffusion (possibly with jumps) for a class of functionals of the process. This method is efficient but needs the computation of the function at each step. To reduce the complexity of the procedure (especially for functionals), we propose in this paper to study a new scheme, called the mixed-step scheme, where we only keep some regularly time-spaced values of the Euler scheme. Our main result is that, when the coefficients of the diffusion are smooth enough, this alternative does not change the order of the rate of convergence of the procedure. We also investigate a Richardson–Romberg method to speed up the convergence and show that the variance of the original algorithm can be preserved under a uniqueness assumption for the invariant distribution of the “duplicated” diffusion, condition which is extensively discussed in the paper. Finally, we conclude by giving sufficient “asymptotic confluence” conditions for the existence of a smooth solution to a discrete version of the associated Poisson equation, condition which is required to ensure the rate of convergence results.     

A coordinate gradient descent method for nonsmooth separable minimization

We consider the problem of minimizing the sum of a smooth function and a separable convex function. This problem includes as special cases bound-constrained optimization and smooth optimization with ?₁-regularization. We propose a (block) coordinate gradient descent method for solving this class of nonsmooth separable problems. We establish global convergence and, under a local Lipschitzian error bound assumption, linear convergence for this method. The local Lipschitzian error bound holds under assumptions analogous to those for constrained smooth optimization, e.g., the convex function is polyhedral and the smooth function is (nonconvex) quadratic or is the composition of a strongly convex function with a linear mapping. We report numerical experience with solving the ?₁-regularization of unconstrained optimization problems from Moré et al. in ACM Trans. Math. Softw. 7, 17–41, 1981 and from the CUTEr set (Gould and Orban in ACM Trans. Math. Softw. 29, 373–394, 2003). Comparison with L-BFGS-B and MINOS, applied to a reformulation of the ?₁-regularized problem as a bound-constrained optimization problem, is also reported.     

一种保凸的Spline插值方法

本文构造笛氏坐标系中一条光滑曲线,使它通过两个有特定切向的给定点,给出了此种插值函数保凸的一个充要条件.文中考虑逐段三次多项式的保凸插值函数,其收敛性的阶与三次样条多项式一样.最后叙述插值函数形状控制的方法.     

Convergence rate of multiple fractional Stratonovich type integral for Hurst parameter less than 1/2

In this paper, we have investigated the problem of the convergence rate of the multiple integralwhere f ∈ Cn+1([0, T ]n) is a given function, π is a partition of the interval [0, T ] and {BtHi ,π} is a family of interpolation approximation of fractional Brownian motion BtH with Hurst parameter H < 1/2. The limit process is the multiple Stratonovich integral of the function f . In view of known results, the convergence rate is different for different multiplicity n. Under some mild conditions, we obtain that the uniform convergence rate is 2H in the mean square sense, where is the norm of the partition generating the approximations.     

Gradient-type penalty method with inertial effects for solving constrained convex optimization problems with smooth data

We consider the problem of minimizing a smooth convex objective function subject to the set of minima of another differentiable convex function. In order to solve this problem, we propose an algorithm which combines the gradient method with a penalization technique. Moreover, we insert in our algorithm an inertial term, which is able to take advantage of the history of the iterates. We show weak convergence of the generated sequence of iterates to an optimal solution of the optimization problem, provided a condition expressed via the Fenchel conjugate of the constraint function is fulfilled. We also prove convergence for the objective function values to the optimal objective value. The convergence analysis carried out in this paper relies on the celebrated Opial Lemma and generalized Fejér monotonicity techniques. We illustrate the functionality of the method via a numerical experiment addressing image classification via support vector machines.     

A smoothing Levenberg–Marquardt method for the extended linear complementarity problem

We consider the extended linear complementarity problem (XLCP), of which the linear and horizontal linear complementarity problems are two special cases. We reformulate the XLCP to a smooth equation by using some smoothing functions and propose a Levenberg–Marquardt method to solve the system of smooth equation. The global convergence and local superlinear convergence rate are established under certain conditions. Numerical tests show the effectiveness of the proposed algorithm.     

A Partial First-Order Affine-Scaling Method

We present a partial first-order affine-scaling method for solving smooth optimization with linear inequality constraints. At each iteration, the algorithm considers a subset of the constraints to reduce the complexity. We prove the global convergence of the algorithm for general smooth objective functions, and show it converges at sublinear rate when the objective function is quadratic. Numerical experiments indicate that our algorithm is efficient.     

One-step smoothing Newton method for solving the mixed complementarity problem with a function

The mixed complementarity problem (denote by MCP(F)) can be reformulated as the solution of a smooth system of equations. In the paper, based on a perturbed mid function, we propose a new smoothing function, which has an important property, not satisfied by many other smoothing function. The existence and continuity of a smooth path for solving the mixed complementarity problem with a P₀ function are discussed. Then we presented a one-step smoothing Newton algorithm to solve the MCP with a P₀ function. The global convergence of the proposed algorithm is verified under mild conditions. And by using the smooth and semismooth technique, the rate of convergence of the method is proved under some suitable assumptions.     

The convergence of a direct BEM for the plane mixed boundary value problem of the Laplacian

Summary In this paper the convergence analysis of a direct boundary elecment method for the mixed boundary value problem for Laplace equation in a smooth plane domain is given. The method under consideration is based on the collocation solution by constant elements of the corresponding system of boundary integral equations. We prove the convergence of this method, provide asymptotic error estimates for the BEM-solution and give some numerical examples.