On the acceleration of the double smoothing technique for unconstrained convex optimization problems

In this article, we investigate the possibilities of accelerating the double smoothing (DS) technique when solving unconstrained nondifferentiable convex optimization problems. This approach relies on the regularization in two steps of the Fenchel dual problem associated with the problem to be solved into an optimization problem having a differentiable strongly convex objective function with Lipschitz continuous gradient. The doubly regularized dual problem is then solved via a fast gradient method. The aim of this article is to show how the properties of the functions in the objective of the primal problem influence the implementation of the DS approach and its rate of convergence. The theoretical results are applied to linear inverse problems by making use of different regularization functionals.     

A reduced gradient method for quadratic programs with quadratic constraints and lp-constrained lp-approximation problems

A dual algorithm is developed for solving a general class of nonlinear programs that properly contains all convex quadratic programs with quadratic constraints and l_p-constrained l_p-approximation problems. The general dual program to be solved has essentially linear constraints but the objective function is nondifferentiable when certain variables equal zero. Modifications to the reduced gradient method for linearly constrained problems are presented that overcome the numerical difficulties associated with the nondifferentiable objective function. These modifications permit ‘blocks’ of variables to move to and away from zero on certain iterations even though the objective function is nondifferentiable at points having a block of variables equal to zero.     

A double smoothing technique for solving unconstrained nondifferentiable convex optimization problems

The aim of this paper is to develop an efficient algorithm for solving a class of unconstrained nondifferentiable convex optimization problems in finite dimensional spaces. To this end we formulate first its Fenchel dual problem and regularize it in two steps into a differentiable strongly convex one with Lipschitz continuous gradient. The doubly regularized dual problem is then solved via a fast gradient method with the aim of accelerating the resulting convergence scheme. The theoretical results are finally applied to an l ₁ regularization problem arising in image processing.     

Optimality and duality in nondifferentiable multiobjective mathematical programming involving higher order (F,α,ρ,d)-type I functions

In this paper, a nondifferentiable multiobjective programming problem is considered where every component of objective and constraint functions contain a term involving the support function of a compact convex set. A new class of higher order (F,α,ρ,d)-type I function is introduced. Necessary optimality conditions and the duality theorems for Wolfe and unified higher order dual problems are established. Several known results can be deduced as special cases.     

ε-Optimal solutions in nondifferentiable convex programming and some related questions

In this paper we present ε-optimality conditions of the Kuhn-Tucker type for points which are within ε of being optimal to the problem of minimizing a nondifferentiable convex objective function subject to nondifferentiable convex inequality constraints, linear equality constraints and abstract constraints. Such ε-optimality conditions are of interest for theoretical consideration as well as from the computational point of view. Some illustrative applications are made. Thus we derive an expression for the ε-subdifferential of a general convex ‘max function’. We also show how the ε-optimality conditions given in this paper can be mechanized into a bundle algorithm for solving nondifferentiable convex programming problems with linear inequality constraints.     

关于对偶问题及对偶性质

本文考虑非可微凸规划的一个对偶问题，它使用目标函数的扰动函数的次微分及外法向量锥，它不同于已知结果．我们给出相应的对偶性质．     

The Euclidean Steiner tree problem in Rn: A mathematical programming formulation

A nonconvex mixed-integer programming formulation for the Euclidean Steiner Tree Problem (ESTP) in Rⁿ is presented. After obtaining separability between integer and continuous variables in the objective function, a Lagrange dual program is proposed. To solve this dual problem (and obtaining a lower bound for ESTP) we use subgradient techniques. In order to evaluate a subgradient at each iteration we have to solve three optimization problems, two in polynomial time, and one is a special convex nondifferentiable programming problem. This revised version was published online in June 2006 with corrections to the Cover Date.     

Optimality Conditions and Duality for?Nondifferentiable Multiobjective Fractional Programming Problems with?(C,α,ρ,d)-convexity

The purpose of this paper is to consider a class of nondifferentiable multiobjective fractional programming problems in which every component of the objective function contains a term involving the support function of a compact convex set. Based on the (C,α,ρ,d)-convexity, sufficient optimality conditions and duality results for weakly efficient solutions of the nondifferentiable multiobjective fractional programming problem are established. The results extend and improve the corresponding results in the literature.     

Optimality and Duality for a Class of Nondifferentiable Multiobjective Fractional Programming Problems

In this paper, we consider a class of nondifferentiable multiobjective fractional programs in which each component of the objective function contains a term involving the support function of a compact convex set. We establish necessary and sufficient optimality conditions and duality results for weakly efficient solutions of nondifferentiable multiobjective fractional programming problems. This work was supported by Grant R01-2003-000-10825-0 from the Basic Research Program of KOSEF.     

Necessary and Sufficient Conditions for Minimax Fractional Programming

We establish the necessary and sufficient optimality conditions for a class of nondifferentiable minimax fractional programming problems solving generalized convex functions. Subsequently, we apply the optimality conditions to formulate one parametric dual problem and we prove weak duality, strong duality, and strict converse duality theorems.     

A parallel descent algorithm for convex programming

In this paper, we propose a parallel decomposition algorithm for solving a class of convex optimization problems, which is broad enough to contain ordinary convex programming problems with a strongly convex objective function. The algorithm is a variant of the trust region method applied to the Fenchel dual of the given problem. We prove global convergence of the algorithm and report some computational experience with the proposed algorithm on the Connection Machine Model CM-5.     

A subgradient duality theorem

A duality theorem of P. Wolfe for nonlinear differentiable programming is extended to the nondifferentiable case by replacing gradients by subgradients. The dual pair is further simplified in the case that nondifferentiability enters only in the objective functions and then only through a positively homogeneous convex function. A number of previously studied problems appear as special cases.     

Higher-order generalized convexity and duality in nondifferentiable multiobjective mathematical programming

In this paper, a class of generalized convexity is introduced and a unified higher-order dual model for nondifferentiable multiobjective programs is described, where every component of the objective function contains a term involving the support function of a compact convex set. Weak duality theorems are established under generalized convexity conditions. The well-known case of the support function in the form of square root of a positive semidefinite quadratic form and other special cases can be readily derived from our results.     

非光滑(F,ρ,)θ-d一致不变凸广义分式规划的对偶性

结合F-凸,η-不变凸及d一致不变凸的概念给出了非光滑广义(F,ρ,θ)-d一致不变凸函数;就一类在凸集C上目标函数为Lipschitz连续的带有可微不等式约束的广义分式规划,提出一个对偶,并利用在广义Kuhn-Tucker约束品性或广义Arrow-Hurwicz-Uzawa约束品性的条件下得到的最优性必要条件,证明相应的弱对偶定理、强对偶定理及严格逆对偶定理.     

Exactness Property of the Exact Absolute Value Penalty Function Method for Solving Convex Nondifferentiable Interval-Valued Optimization Problems

In the paper, the classical exact absolute value function method is used for solving a nondifferentiable constrained interval-valued optimization problem with both inequality and equality constraints. The property of exactness of the penalization for the exact absolute value penalty function method is analyzed under assumption that the functions constituting the considered nondifferentiable constrained optimization problem with the interval-valued objective function are convex. The conditions guaranteeing the equivalence of the sets of LU-optimal solutions for the original constrained interval-valued extremum problem and for its associated penalized optimization problem with the interval-valued exact absolute value penalty function are given.     

A continuation approach for the capacitated multi-facility weber problem based on nonlinear SOCP reformulation

We propose a primal-dual continuation approach for the capacitated multi-facility Weber problem (CMFWP) based on its nonlinear second-order cone program (SOCP) reformulation. The main idea of the approach is to reformulate the CMFWP as a nonlinear SOCP with a nonconvex objective function, and then introduce a logarithmic barrier term and a quadratic proximal term into the objective to construct a sequence of convexified subproblems. By this, this class of nondifferentiable and nonconvex optimization problems is converted into the solution of a sequence of nonlinear convex SOCPs. In this paper, we employ the semismooth Newton method proposed in Kanzow et al. (SIAM Journal of Optimization 20:297–320, 2009) to solve the KKT system of the resulting convex SOCPs. Preliminary numerical results are reported for eighteen test instances, which indicate that the continuation approach is promising to find a satisfying suboptimal solution, even a global optimal solution for some test problems.     

非可微凸规划的对偶问题

文章建立关于非可微凸规划的一个新的对偶问题,它不同于已知的对偶问题,文中证明了弱对偶性及强对偶性。并用Ｌａｇｒａｎｇｅ正则性证明了强对偶性的充要条件。最后,讨论了等式约束的情况。     

求解一类二阶段有补偿问题的对偶梯度法

利用对偶理论，本文给出了求解一类具有简单补偿的非线性二阶段问题的新对偶梯度法．在假设目标函数为可分连续可微凸函数的条件下，在每一选代步可将原二阶段有补偿问题转化为几个一维凸规划问题，大大简化了问题的求解．所给算法简单易行，文中还证明了该算法的全局收敛性．