Synchronous approach in interactive multiobjective optimization

We introduce a new approach in the methodology development for interactive multiobjective optimization. The presentation is given in the context of the interactive NIMBUS method, where the solution process is based on the classification of objective functions. The idea is to formulate several scalarizing functions, all using the same preference information of the decision maker. Thus, opposed to fixing one scalarizing function (as is done in most methods), we utilize several scalarizing functions in a synchronous way. This means that we as method developers do not make the choice between different scalarizing functions but calculate the results of different scalarizing functions and leave the final decision to the expert, the decision maker. Simultaneously, (s)he obtains a better view of the solutions corresponding to her/his preferences expressed once during each iteration.In this paper, we describe a synchronous variant of the NIMBUS method. In addition, we introduce a new version of its implementation WWW-NIMBUS operating on the Internet. WWW-NIMBUS is a software system capable of solving even computationally demanding nonlinear problems. The new version of WWW-NIMBUS can handle versatile types of multiobjective optimization problems and includes new desirable features increasing its user-friendliness.     

Finding the Minimal Root of an Equation with the Multiextremal and Nondifferentiable Left-Hand Part

A problem very often arising in applications is presented: finding the minimal root of an equation with the objective function being multiextremal and nondifferentiable. Applications from the field of electronic measurements are given. Three methods based on global optimization ideas are introduced for solving this problem. The first one uses an a priori estimate of the global Lipschitz constant. The second method adaptively estimates the global Lipschitz constant. The third algorithm adaptively estimates local Lipschitz constants during the search. All the methods either find the minimal root or determine the global minimizers (in the case when the equation under consideration has no roots). Sufficient convergence conditions of the new methods to the desired solution are established. Numerical results including wide experiments with test functions, stability study, and a real-life applied problem are also presented.     

A modified reduced gradient method for a class of nondifferentiable problems

The class of nondifferentiable problems treated in this paper constitutes the dual of a class of convex differentiable problems. The primal problem involves faithfully convex functions of linear mappings of the independent variables in the objective function and in the constraints. The points of the dual problem where the objective function is nondifferentiable are known: the method presented here takes advantage of this fact to propose modifications necessary in the reduced gradient method to guarantee convergence.     

Comparative evaluation of some interactive reference point-based methods for multi-objective optimisation

Many real-world optimisation applications include several conflicting objectives of possibly nondifferentiable character. However, the lack of computationally efficient, interactive methods for nondifferentiable multi-objective optimisation problems is apparent. To satisfy this demand, a method called NIMBUS has been developed. Two versions of the basic method are presented and compared both theoretically and computationally. In order to give variety to the comparison, a related approach, called reference direction method is included. Theoretically, the methods differ in handling the information requested from the user. Numerical experiments indicate differences in computational efficiency and controllability of the solution processes.     

A direct method of linearization for continuous minimax problems

We consider the problem of minimizing a nondifferentiable function that is the pointwise maximum over a compact family of continuously differentiable functions. We suppose that a certain convex approximation to the objective function can be evaluated. An iterative method is given which uses as successive search directions approximate solutions of semi-infinite quadratic programming problems calculated via a new generalized proximity algorithm. Inexact line searches ensure global convergence of the method to stationary points.This work was supported by Project No. CPBP-02.15/2.1.1.     

On the acceleration of the double smoothing technique for unconstrained convex optimization problems

In this article, we investigate the possibilities of accelerating the double smoothing (DS) technique when solving unconstrained nondifferentiable convex optimization problems. This approach relies on the regularization in two steps of the Fenchel dual problem associated with the problem to be solved into an optimization problem having a differentiable strongly convex objective function with Lipschitz continuous gradient. The doubly regularized dual problem is then solved via a fast gradient method. The aim of this article is to show how the properties of the functions in the objective of the primal problem influence the implementation of the DS approach and its rate of convergence. The theoretical results are applied to linear inverse problems by making use of different regularization functionals.     

A class of nondifferentiable control problems

Optimality conditions and duality results are obtained for a class of control problems having a nondifferentiable term in the integrand of the objective functional. These results generalize many well-known results in optimal control theory involving differentiable functions, and also provide a relationship with certain nondifferentiable mathematical programming problems. Some extensions concerning the unified treatment of optimal control theory and continuous programming are also mentioned. Finally, a control problem containing an arbitrary norm, along with its appropriate norm, is given.     

First order optimality conditions in vector optimization involving stable functions

We study a nonsmooth vector optimization problem with an arbitrary feasible set or a feasible set defined by a generalized inequality constraint and an equality constraint. We assume that the involved functions are nondifferentiable. First, we provide some calculus rules for the contingent derivative in which the stability (a local Lipschitz property at a point) of the functions plays a crucial role. Second, another calculus rules are established for steady functions. Third, necessary optimality conditions are stated using tangent cones to the feasible set and the contingent derivative of the objective function. Finally, some necessary and sufficient conditions are presented through Lagrange multiplier rules.     

Interactive Solution Approach to a Multiobjective Optimization Problem in a Paper Machine Headbox Design

A successful application of the interactive multiobjective optimization method NIMBUS to a design problem in papermaking technology is described. Namely, an optimal shape design problem related to the paper machine headbox is studied. First, the NIMBUS method, the numerical headbox model, and the associated multiobjective optimization problem are described. Then, the results of numerical experiments are presented.     

On the need for special purpose algorithms for minimax eigenvalue problems

It has been recently reported that minimax eigenvalue problems can be formulated as nonlinear optimization problems involving smooth objective and constraint functions. This result seems very appealing since minimax eigenvalue problems are known to be typically nondifferentiable. In this paper, we show, however, that general purpose nonlinear optimization algorithms usually fail to find a solution to these smooth problems even in the simple case of minimization of the maximum eigenvalue of an affine family of symmetric matrices, a convex problem for which efficient algorithms are available.This work was supported in part by NSF Engineering Research Centers Program No. NSFD-CDR-88-03012 and NSF Grant DMC-84-20740. The author wishes to thank Drs. M. K. H. Fan and A. L. Tits for their many useful suggestions.     

A globally convergent Newton method for convex SC1 minimization problems

This paper presents a globally convergent and locally superlinearly convergent method for solving a convex minimization problem whose objective function has a semismooth but nondifferentiable gradient. Applications to nonlinear minimax problems, stochastic programs with recourse, and their extensions are discussed.The research of the first author is based on work supported by the National Science Foundation under Grants DDM-9104078 and CCR-9213739. This research was carried out while he was visiting the University of New South Wales. The research of the second author is based on work supported by the Australian Research Council.     

Convergence proof of minimization algorithms for nonconvex functions

In this paper, we prove a theorem of convergence to a point for descent minimization methods. When the objective function is differentiable, the convergence point is a stationary point. The theorem, however, is applicable also to nondifferentiable functions. This theorem is then applied to prove convergence of some nongradient algorithms.     

Exactness Property of the Exact Absolute Value Penalty Function Method for Solving Convex Nondifferentiable Interval-Valued Optimization Problems

In the paper, the classical exact absolute value function method is used for solving a nondifferentiable constrained interval-valued optimization problem with both inequality and equality constraints. The property of exactness of the penalization for the exact absolute value penalty function method is analyzed under assumption that the functions constituting the considered nondifferentiable constrained optimization problem with the interval-valued objective function are convex. The conditions guaranteeing the equivalence of the sets of LU-optimal solutions for the original constrained interval-valued extremum problem and for its associated penalized optimization problem with the interval-valued exact absolute value penalty function are given.     

A new algorithm for generating all nondominated solutions of multiobjective discrete optimization problems

Most real-life decision-making activities require more than one objective to be considered. Therefore, several studies have been presented in the literature that use multiple objectives in decision models. In a mathematical programming context, the majority of these studies deal with two objective functions known as bicriteria optimization, while few of them consider more than two objective functions. In this study, a new algorithm is proposed to generate all nondominated solutions for multiobjective discrete optimization problems with any number of objective functions. In this algorithm, the search is managed over (p − 1)-dimensional rectangles where p represents the number of objectives in the problem and for each rectangle two-stage optimization problems are solved. The algorithm is motivated by the well-known ε-constraint scalarization and its contribution lies in the way rectangles are defined and tracked. The algorithm is compared with former studies on multiobjective knapsack and multiobjective assignment problem instances. The method is highly competitive in terms of solution time and the number of optimization models solved.     

Optimization of upper semidifferentiable functions

In this paper, we present an implementable algorithm to minimize a nonconvex, nondifferentiable function in ^m . The method generalizes Wolfe's algorithm for convex functions and Mifflin's algorithm for semismooth functions to a broader class of functions, so-called upper semidifferentiable. With this objective, we define a new enlargement of Clarke's generalized gradient that recovers, in special cases, the enlargement proposed by Goldstein. We analyze the convergence of the method and discuss some numerical experiments.The author would like to thank J. B. Hiriart-Urruty (Toulouse) for having provided him with Definition 2.1 and the referees for their constructive remarks about a first version of the paper.     

Solving Euclidean Distance Multifacility Location Problems Using Conjugate Subgradient and Line-Search Methods

Subgradient methods are popular for solving nondifferentiable optimization problems because of their relative ease in implementation, but are not always robust and require a careful design of strategies in order to yield an effective procedure for any given class of problems. In this paper, we present an approach for solving the Euclidean distance multifacility location problem (EMFLP) using conjugate or deflected subgradient based algorithms along with suitable line-search strategies. The subgradient deflection method considered is the Average Direction Strategy (ADS) imbedded within the Variable Target Value Method (VTVM). We also investigate the generation of two types of subgradients to be employed in conjunction with ADS. The first type is a simple valid subgradient that assigns zero values to contributions corresponding to the nondifferentiable terms in the objective function, and so, the subgradient is composed by summing the contributions corresponding to the differentiable terms alone. The second type expends more effort to derive a low-norm member of the subdifferential in order to enhance the prospect of obtaining a descent direction. Furthermore, a special Newton-based line-search that exploits the nondifferentiability of the problem is also designed to be implemented in the developed algorithm in order to study its impact on the convergence behavior. Various combinations of the above strategies are composed and evaluated on a set of test problems. The results show that a modification of the VTVM method along with the first or a certain combination of the two subgradient generation strategies, and the use of a suitable line-search technique, provides promising results. An alternative block-halving step-size strategy used within VTVM in conjunction with the proposed line-search method yields a competitive second choice performance.     

Nonlinear coordinate transformations for unconstrained optimization I. Basic transformations

In this two-part article, nonlinear coordinate transformations are discussed to simplify unconstrained global optimization problems and to test their unimodality on the basis of the analytical structure of the objective functions. If the transformed problems are quadratic in some or all the variables, then the optimum can be calculated directly, without an iterative procedure, or the number of variables to be optimized can be reduced. Otherwise the analysis of the structure can serve as a first phase for solving unconstrained global optimization problems.The first part treats real-life problems where the presented technique is applied and the transformation steps are constructed. The second part of the article deals with the differential geometrical background and the conditions of the existence of such transformations.The paper was presented at the II. IIASA Workshop on Global Optimization, Sopron (Hungary), December 9–14, 1990.     

On smoothing exact penalty functions for nonlinear constrained optimization problems

In the paper, we give a smoothing approximation to the nondifferentiable exact penalty function for nonlinear constrained optimization problems. Error estimations are obtained among the optimal objective function values of the smoothed penalty problems, of the nonsmooth penalty problem and of the original problem. An algorithm based on our smoothing function is given, which is showed to be globally convergent under some mild conditions.     

Inexact subgradient methods for quasi-convex optimization problems

In this paper, we consider a generic inexact subgradient algorithm to solve a nondifferentiable quasi-convex constrained optimization problem. The inexactness stems from computation errors and noise, which come from practical considerations and applications. Assuming that the computational errors and noise are deterministic and bounded, we study the effect of the inexactness on the subgradient method when the constraint set is compact or the objective function has a set of generalized weak sharp minima. In both cases, using the constant and diminishing stepsize rules, we describe convergence results in both objective values and iterates, and finite convergence to approximate optimality. We also investigate efficiency estimates of iterates and apply the inexact subgradient algorithm to solve the Cobb–Douglas production efficiency problem. The numerical results verify our theoretical analysis and show the high efficiency of our proposed algorithm, especially for the large-scale problems.     

A class of nondifferentiable continuous programming problems

Optimality conditions, duality and converse duality results are obtained for a class of continuous programming problems with a nondifferentiable term in the integrand of the objective function. The proofs are based on a Fritz John theorem for constrained optimization in abstract spaces. The results generalize various well-known results in variational problems with differentiable functions, and also give a dynamic analogue of certain nondifferentiable programming problems.