Exact penalty property for a class of inequality-constrained minimization problems

We use the penalty approach in order to study constrained minimization problems. A penalty function is said to have the exact penalty property if there is a penalty coefficient for which a solution of an unconstrained penalized problem is a solution of the corresponding constrained problem. In this paper we establish the exact penalty property for a large class of inequality-constrained minimization problems.     

带惩罚μ-相似Bregman散度k-均值问题的初始化算法

$k$-均值问题是聚类中的经典问题,亦是NP-难问题。如果允许数据点不聚类,而是支付惩罚费用,则引出带惩罚的$k$-均值问题。本文将带惩罚的$k$-均值问题从欧氏距离推广到更一般的$\mu$-相似Bregman散度,研究了带惩罚$\mu$-相似Bregman散度$k$-均值问题的初始化算法。本文给出的初始化算法,近似比与$\mu$和数据点惩罚最大值与最小值的比例$r$相关。     

Penalty method for solving a class of stochastic differential variational inequalities with an application

The aim of this paper is to study the penalty method for solving a class of stochastic differential variational inequalities (SDVIs). The penalty problem for solving SDVIs is first constructed and the convergence of the sequences generated by the penalty problem is proved under some mild conditions. As an application, the convergence of the sequences generated by the penalty problem is obtained for solving a stochastic migration equilibrium problem with movement cost.     

A sufficient condition for exact penalty functions

In this paper, we use the penalty approach for constrained minimization problems in infinite dimensional Banach spaces. A penalty function is said to have the exact penalty property if there is a penalty coefficient for which a solution of an unconstrained penalized problem is a solution of the corresponding constrained problem. We establish a simple sufficient condition for exact penalty property for two large classes of constrained minimization problems.     

Sufficient conditions for exact penalty in constrained optimization

In this paper we use the penalty approach in order to study constrained minimization problems. A penalty function is said to have the exact penalty property if there is a penalty coefficient for which a solution of an unconstrained penalized problem is a solution of the corresponding constrained problem. We discuss very simple sufficient conditions for the exact penalty property. (© 2008 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim)     

带惩罚μ-相似Bregman散度k-均值问题的初始化算法

$k$-均值问题是聚类中的经典问题,亦是NP-难问题。如果允许数据点不聚类,而是支付惩罚费用,则引出带惩罚的$k$-均值问题。本文将带惩罚的$k$-均值问题从欧氏距离推广到更一般的$\mu$-相似Bregman散度,研究了带惩罚$\mu$-相似Bregman散度$k$-均值问题的初始化算法。本文给出的初始化算法,近似比与$\mu$和数据点惩罚最大值与最小值的比例$r$相关。     

Existence of Exact Penalty for Constrained Optimization Problems in Metric Spaces

In this paper we use the penalty approach in order to study constrained minimization problems in a complete metric space with locally Lipschitzian mixed constraints. A penalty function is said to have the exact penalty property if there is a penalty coefficient for which a solution of an unconstrained penalized problem is a solution of the corresponding constrained problem. In this paper we establish sufficient conditions for the exact penalty property.      

An Estimation of Exact Penalty for Infinite-Dimensional Inequality-Constrained Minimization Problems

We use the penalty approach in order to study inequality-constrained minimization problems in infinite dimensional spaces. A penalty function is said to have the exact penalty property if there is a penalty coefficient for which a solution of an unconstrained penalized problem is a solution of the corresponding constrained problem. In this paper we consider a large class of inequality-constrained minimization problems for which a constraint is a mapping with values in a normed ordered space. For this class of problems we introduce a new type of penalty functions, establish the exact penalty property and obtain an estimation of the exact penalty. Using this exact penalty property we obtain necessary and sufficient optimality conditions for the constrained minimization problems.     

On the application of the residual method for the correction of inconsistent problems of convex programming

For the correction of a convex programming problem with potentially inconsistent constraint system (an improper problem), we apply the residual method, which is a standard regularization procedure for ill-posed optimization models. A problem statement typical for the residual method is reduced to a minimization problem for an appropriate penalty function. We apply two classical penalty functions: the quadratic penalty function and the exact Eremin-Zangwill penalty function. For each of the approaches, we establish convergence conditions and bounds for the approximation error.     

"准"精确惩罚函数法的渐近性分析

1引言众所周知,罚函数法在最优化理论与数值计算中占据着极其重要的位置,作为求解约束优化问题的一类重要方法,在上世纪五、六十年代曾经历一次发展高潮．近十几年来,伴随着对数障碍函数法在内点法中取得的成功,罚函数法的研究又呈现出一个小高潮[2,3,4]．在罚函数方法里,精确惩罚函数法有着非常吸引人的性质,即,当罚参数大于某个有限门槛值时,仅通过求解单个无约束罚问题便可得到原问题的最优解,从而省去了一般罚函数法解系列无约束优化问题的工作量．     

An Approximate Exact Penalty in Constrained Vector Optimization on Metric Spaces

In this paper, we use the penalty approach in order to study a class of constrained vector minimization problems on complete metric spaces. A penalty function is said to have the generalized exact penalty property iff there is a penalty coefficient for which approximate solutions of the unconstrained penalized problem are close enough to approximate solutions of the corresponding constrained problem. For our class of problems, we establish the generalized exact penalty property and obtain an estimation of the exact penalty.     

On the Smoothing of the Square-Root Exact Penalty Function for Inequality Constrained Optimization

In this paper we propose two methods for smoothing a nonsmooth square-root exact penalty function for inequality constrained optimization. Error estimations are obtained among the optimal objective function values of the smoothed penalty problem, of the nonsmooth penalty problem and of the original optimization problem. We develop an algorithm for solving the optimization problem based on the smoothed penalty function and prove the convergence of the algorithm. The efficiency of the smoothed penalty function is illustrated with some numerical examples, which show that the algorithm seems efficient.     

A power penalty approach to a mixed quasilinear elliptic complementarity problem

In this paper, a power penalty approximation method is proposed for solving a mixed quasilinear elliptic complementarity problem. The mixed complementarity problem is first reformulated as a double obstacle quasilinear elliptic variational inequality problem. A nonlinear elliptic partial differential equation is then defined to approximate the resulting variational inequality by using a power penalty approach. The existence and uniqueness of the solution to the partial differential penalty equation are proved. It is shown that, under some mild assumptions, the sequence of solutions to the penalty equations converges to the unique solution of the variational inequality problem as the penalty parameter tends to infinity. The error estimates of the convergence of this penalty approach are also derived. At last, numerical experimental results are presented to show that the power penalty approximation method is efficient and robust.

     

Existence of exact penalty for optimization problems with mixed constraints in Banach spaces

In this paper we use the penalty approach in order to study constrained minimization problems in a Banach space with nonsmooth nonconvex mixed constraints. A penalty function is said to have the exact penalty property [J.-B. Hiriart-Urruty, C. Lemarechal, Convex Analysis and Minimization Algorithms, Springer, Berlin, 1993] if there is a penalty coefficient for which a solution of an unconstrained penalized problem is a solution of the corresponding constrained problem. In this paper we establish sufficient conditions for the exact penalty property.     

不等式约束优化问题的低阶精确罚函数的光滑化算法

对不等式约束优化问题提出了一个低阶精确罚函数的光滑化算法. 首先给出了光滑罚问题、非光滑罚问题及原问题的目标函数值之间的误差估计,进而在弱的假
设之下证明了光滑罚问题的全局最优解是原问题的近似全局最优解. 最后给出了一个基于光滑罚函数的求解原问题的算法,证明了算法的收敛性,并给出数值算例说明算法的可行性.     

Existence of Exact Penalty and Its Stability for Nonconvex Constrained Optimization Problems in Banach Spaces

In this paper we use the penalty approach in order to study two constrained minimization problems. A penalty function is said to have the generalized exact penalty property if there is a penalty coefficient for which approximate solutions of the unconstrained penalized problem are close enough to approximate solutions of the corresponding constrained problem. In this paper we show that the generalized exact penalty property is stable under perturbations of cost functions, constraint functions and the right-hand side of constraints.     

An exact penalty approach to constrained minimization problems on metric spaces

In this paper we use the penalty approach in order to study a class of constrained minimization problems on complete metric spaces. A penalty function is said to have the generalized exact penalty property if there is a penalty coefficient for which approximate solutions of the unconstrained penalized problem are close enough to approximate solutions of the corresponding constrained problem. For our class of problems we establish the generalized exact penalty property and obtain an estimation of the exact penalty.     

A Lower Bound for the Penalty Parameter in the Exact Minimax Penalty Function Method for Solving Nondifferentiable Extremum Problems

In the paper, we consider the exact minimax penalty function method used for solving a general nondifferentiable extremum problem with both inequality and equality constraints. We analyze the relationship between an optimal solution in the given constrained extremum problem and a minimizer in its associated penalized optimization problem with the exact minimax penalty function under the assumption of convexity of the functions constituting the considered optimization problem (with the exception of those equality constraint functions for which the associated Lagrange multipliers are negative—these functions should be assumed to be concave). The lower bound of the penalty parameter is given such that, for every value of the penalty parameter above the threshold, the equivalence holds between the set of optimal solutions in the given extremum problem and the set of minimizers in its associated penalized optimization problem with the exact minimax penalty function.     

非线性约束优化的光滑化平方根罚函数

介绍一种非线性约束优化的不可微平方根罚函数,为这种非光滑罚函数提出了一个新的光滑化函数和对应的罚优化问题,获得了原问题与光滑化罚优化问题目标之间的误差估计. 基于这种罚函数,提出了一个算法和收敛性证明,数值例子表明算法对解决非线性约束优化具有有效性.     

Firefly penalty-based algorithm for bound constrained mixed-integer nonlinear programming

In this article, we aim to extend the firefly algorithm (FA) to solve bound constrained mixed-integer nonlinear programming (MINLP) problems. An exact penalty continuous formulation of the MINLP problem is used. The continuous penalty problem comes out by relaxing the integrality constraints and by adding a penalty term to the objective function that aims to penalize integrality constraint violation. Two penalty terms are proposed, one is based on the hyperbolic tangent function and the other on the inverse hyperbolic sine function. We prove that both penalties can be used to define the continuous penalty problem, in the sense that it is equivalent to the MINLP problem. The solutions of the penalty problem are obtained using a variant of the metaheuristic FA for global optimization. Numerical experiments are given on a set of benchmark problems aiming to analyze the quality of the obtained solutions and the convergence speed. We show that the firefly penalty-based algorithm compares favourably with the penalty algorithm when the deterministic DIRECT or the simulated annealing solvers are invoked, in terms of convergence speed.