Convergence Criteria for Hierarchical Overlapping Coordination of Linearly Constrained Convex Design Problems

Decomposition of multidisciplinary engineering system design problems into smaller subproblems is desirable because it enhances robustness and understanding of the numerical results. Moreover, subproblems can be solved in parallel using the optimization technique most suitable for the underlying mathematical form of the subproblem. Hierarchical overlapping coordination (HOC) is an interesting strategy for solving decomposed problems. It simultaneously uses two or more design problem decompositions, each of them associated with different partitions of the design variables and constraints. Coordination is achieved by the exchange of information between decompositions. This article presents the HOC algorithm and several new sufficient conditions for convergence of the algorithm to the optimum in the case of convex problems with linear constraints. One of these equivalent conditions involves the rank of the constraint matrix that is computationally efficient to verify. Computational results obtained by applying the HOC algorithm to quadratic programming problems of various sizes are included for illustration.     

Reliability of repairable redundant systems in nuclear generating stations

Markov models are presented to assess the reliability performance of redundant standby systems in nuclear generating stations. These systems are inactive during the normal station operation. However, they are required to operate for a specified period after the loss of normal power supply during emergency. The estimated probabilities of system failure are useful in deciding on the best combination of standby units and repair facilities. The proposed models are applicable to such systems as combustion turbine units in emergency service (Class III power system, emergency power supply system), and pumps in emergency coolant injection system.     

Control design for large-scale Lur’e systems with arbitrary information structure constraints

In this paper, an LMI-based approach is proposed for the design of static output feedback for multi-nonlinear Lur’e-Postnikov systems. The resulting control laws ensure absolute stability and, at the same time, maximize the size of the nonlinear sectors. The proposed method is computationally efficient, and can accommodate feedback laws with arbitrary information structure constraints. The effectiveness of this approach is demonstrated on a large-scale example with 100 state variables.     

Scaled memoryless symmetric rank one method for large-scale optimization

This paper concerns the memoryless quasi-Newton method, that is precisely the quasi-Newton method for which the approximation to the inverse of Hessian, at each step, is updated from the identity matrix. Hence its search direction can be computed without the storage of matrices. In this paper, a scaled memoryless symmetric rank one (SR1) method for solving large-scale unconstrained optimization problems is developed. The basic idea is to incorporate the SR1 update within the framework of the memoryless quasi-Newton method. However, it is well-known that the SR1 update may not preserve positive definiteness even when updated from a positive definite matrix. Therefore we propose the memoryless SR1 method, which is updated from a positive scaled of the identity, where the scaling factor is derived in such a way that positive definiteness of the updating matrices are preserved and at the same time improves the condition of the scaled memoryless SR1 update. Under very mild conditions it is shown that, for strictly convex objective functions, the method is globally convergent with a linear rate of convergence. Numerical results show that the optimally scaled memoryless SR1 method is very encouraging.     

Spectral residual method without gradient information for solving large-scale nonlinear systems of equations

A fully derivative-free spectral residual method for solving large-scale nonlinear systems of equations is presented. It uses in a systematic way the residual vector as a search direction, a spectral steplength that produces a nonmonotone process and a globalization strategy that allows for this nonmonotone behavior. The global convergence analysis of the combined scheme is presented. An extensive set of numerical experiments that indicate that the new combination is competitive and frequently better than well-known Newton-Krylov methods for large-scale problems is also presented.

     

Inexact non-interior continuation method for solving large-scale monotone SDCP

For exact Newton method for solving monotone semidefinite complementarity problems (SDCP), one needs to exactly solve a linear system of equations at each iteration. For problems of large size, solving the linear system of equations exactly can be very expensive. In this paper, we propose a new inexact smoothing/continuation algorithm for solution of large-scale monotone SDCP. At each iteration the corresponding linear system of equations is solved only approximately. Under mild assumptions, the algorithm is shown to be both globally and superlinearly convergent.     

Decentralized robust control for a class of uncertain large-scale interconnected nonlinear dynamical systems

The problem of the decentralized robust control for a class of large-scale interconnected nonlinear dynamical systems with input interconnection and external interconnection perturbations is considered. Based on the stabilizability of each nominal isolated subsystem (i.e., the isolated subsystem in the absence of interconnection perturbations), a class of decentralized local state feedback controllers is proposed, and some sufficient conditions are derived by making use of the Lyapunov stability criterion such that uncertain large-scale interconnected systems can be stabilized asymptotically by these decentralized state feedback controllers. For large-scale systems with only input interconnection perturbations, such decentralized controllers become a class of decentralized stabilizing state feedback controllers. That is, the decentralized stability of such large-scale systems can be guaranteed always by using the decentralized state feedback controllers proposed in the paper. Finally, a numerical example is given to demonstrate the validity of the results.     

Discrete Newton's method with local variations for solving large-scale nonlinear systems

A globally convergent discrete Newton method is proposed for solving large-scale nonlinear systems of equations. Advantage is taken from discretization steps so that the residual norm can be reduced while the Jacobian is approximated, besides the reduction at Newtonian iterations. The Curtis–Powell–Reid (CPR) scheme for discretization is used for dealing with sparse Jacobians. Global convergence is proved and numerical experiments are presented.     

A gradient method for neutral systems

This paper derives a gradient method for the iterative solution of control problems described by neutral equations. Three numerical examples are considered, including one with terminal constraints.     

A method for generating a well-distributed Pareto set in nonlinear multiobjective optimization

A method is presented for generating a well-distributed Pareto set in nonlinear multiobjective optimization. The approach shares conceptual similarity with the Physical Programming-based method, the Normal-Boundary Intersection and the Normal Constraint methods, in its systematic approach investigating the objective space in order to obtain a well-distributed Pareto set. The proposed approach is based on the generalization of the class functions which allows the orientation of the search domain to be conducted in the objective space. It is shown that the proposed modification allows the method to generate an even representation of the entire Pareto surface. The generation is performed for both convex and nonconvex Pareto frontiers. A simple algorithm has been proposed to remove local Pareto solutions. The suggested approach has been verified by several test cases, including the generation of both convex and concave Pareto frontiers.     

Hierarchical controls in stochastic manufacturing systems with machines in tandem

This paper presents an asymptotic analysis of hierarchical production planning in a manufacturing system with serial machines that are subject to breakdown and repair, and with convex costs. The machines capacities are modeled as Markov chains. Since the number of parts in the internal buffers between any two machines needs to be non-negative, the problem is inherently a state constrained problem. As the rate of change in machines states approaches infinity, the analysis results in a limiting problem in which the stochastic machines capacity is replaced by the equilibrium mean capacity. A method of “lifting” and “modification” is introduced in order to construct near optimal controls for the original problem by using near optimal controls of the limiting problem. The value function of the original problem is shown to converge to the value function of the limiting problem, and the convergence rate is obtained based on some a priori estimates of the asymptotic behavior of the Markov chains. As a result, an error estimate can be obtained on the near optimality of the controls constructed for the original problem.     

Hierarchical controls in stochastic manufacturing systems with convex costs

This paper presents an extension of earlier research on heirarchical control of stochastic manufacturing systems with linear production costs. A new method is introduced to construct asymptotically optimal open-loop and feedback controls for manufacturing systems in which the rates of machine breakdown and repair are much larger than the rate of fluctuation in demand and rate of discounting of cost. This new approach allows us to carry out an asymptotic analysis on manufacturing systems with convex inventory/backlog and production costs as well as obtain error bound estimates for constructed open loop controls. Under appropriate conditions, an asymptotically optimal Lipschitz feedback control law is obtained.This work was partly supported by the NSERC Grant A4619, URIF, General Motors of Canada, and Manufacturing Research Corporation of Ontario.     

A compromised large-scale neighborhood search heuristic for capacitated air cargo loading planning

Cost effectiveness is central to the air freight forwarders. In this work, we study how an air freight forwarder should plan its cargo loading in order to minimize the total freight cost given a limited number of rented containers. To solve the problem efficiently for practical implementation, we propose a new large-scale neighborhood search heuristic. The proposed large-scale neighborhood relaxes the subset-disjoint restriction made in the existing literature; the relaxation risks a possibility of infeasible exchanges while at the same time it avoids the potentially large amount of checking effort required to enforce the subset-disjoint restriction. An efficient procedure is then used to search for improvement in the neighborhood. We have also proposed a subproblem to address the difficulties caused by the fixed charges. The compromised large-scale neighborhood (CLSN) search heuristic has shown stably superior performance when compared with the traditional large-scale neighborhood search and the mixed integer programming model.     

Sufficient conditions for robust stability of large-scale dynamical systems including delayed states and parameter perturbations in interconnections

The problem of the robust stability of large-scale dynamical systems including delayed states and parameter perturbations in interconnections is considered. By using algebraic Riccati equations and some analytical methods, some sufficient conditions on linear decentralized state feedback controllers are derived so that the systems remain stable in the presence of delayed states and parameter perturbations. Such conditions give some bounds on the perturbations of interconnections with delayed states and uncertain parameters, and result in a quantitative measures of robustness for large-scale dynamical systems including delayed states and uncertain parameters in interconnections. The results obtained in this paper are applicable not only to large-scale systems with multiple time-varying delays, but also to large-scale systems without exact knowledge of the delays, i.e., large-scale systems with uncertain delays.     

Interior point method for long-term generation scheduling of large-scale hydrothermal systems

This paper presents an interior point method for the long-term generation scheduling of large-scale hydrothermal systems. The problem is formulated as a nonlinear programming one due to the nonlinear representation of hydropower production and thermal fuel cost functions. Sparsity exploitation techniques and an heuristic procedure for computing the interior point method search directions have been developed. Numerical tests in case studies with systems of different dimensions and inflow scenarios have been carried out in order to evaluate the proposed method. Three systems were tested, with the largest being the Brazilian hydropower system with 74 hydro plants distributed in several cascades. Results show that the proposed method is an efficient and robust tool for solving the long-term generation scheduling problem.     

Hierarchical multi-objective decision systems for general resource allocation problems

We consider optimization methods for hierarchical power-decentralized systems composed of a coordinating central system and plural semi-autonomous local systems in the lower level, each of which possesses a decision making unit. Such a decentralized system where both central and local systems possess their own objective function and decision variables is a multi-objective system. The central system allocates resources so as to optimize its own objective, while the local systems optimize their own objectives using the given resources. The lower level composes a multi-objective programming problem, where local decision makers minimize a vector objective function in cooperation. Thus, the lower level generates a set of noninferior solutions, parametric with respect to the given resources. The central decision maker, then, parametric with respect to the given resources. The central decision maker, then, chooses an optimal resource allocation and the best corresponding noninferior solution from among a set of resource-parametric noninferior solutions. A computational method is obtained based on parametric nonlinear mathematical programming using directional derivatives. This paper is concerned with a combined theory for the multi-objective decision problem and the general resource allocation problem.The authors are indebted to Professor G. Leitmann for his valuable comments and suggestions.     

Spline collocation method for linear singular hyperbolic systems

Some classes of singular systems of partial differential equations with variable matrix coefficients and internal hyperbolic structure are considered. The spline collocation method is used to numerically solve such systems. Sufficient conditions for the convergence of the numerical procedure are obtained. Numerical results are presented.     

Hierarchical matrix techniques for low- and high-frequency Helmholtz problems

Wolfgang Hackbusch ^{In this paper, we discuss the application of hierarchical matrixtechniques to the solution of Helmholtz problems with largewave number in 2D. We consider the Brakhage–Werner integralformulation of the problem discretized by the Galerkin boundary-elementmethod. The dense n x n Galerkin matrix arising from this approachis represented by a sum of an -matrix and an 2-matrix, two different hierarchical matrix formats.A well-known multipole expansion is used to construct the 2-matrix. We present a new approach to dealingwith the numerical instability problems of this expansion: theparts of the matrix that can cause problems are approximatedin a stable way by an -matrix. Algebraic recompression methods are used to reducethe storage and the complexity of arithmetical operations ofthe -matrix.Further, an approximate LU decomposition of such a recompressed-matrix is aneffective preconditioner. We prove that the construction ofthe matrices as well as the matrix-vector product can be performedin almost linear time in the number of unknowns. Numerical experimentsfor scattering problems in 2D are presented, where the linearsystems are solved by a preconditioned iterative method.}     

Hierarchical Stochastic Production Planning with Delay Interaction

This paper explores the problem of hierarchical stochastic production planning (HSPP) for flexible automated workshops (FAWs), each consisting of a number of flexible manufacturing systems (FMSs). The objective is to devise a production plan which tells each FMS how many parts to produce and when to produce them so as to simultaneously minimize the amount of work in progress, maximize the machine utilization, and satisfy demands for finished products over a finite horizon of N time periods. Here, the problem formulation includes not only uncertainty in demand, capacities, and material supply (which is standard in the literature), but also uncertainties in processing times, rework, and waste products. It considers also multiple products and multiple time periods. This is in contrast to most work which looks at either a single periods or at an infinite horizon. The delay interaction aspect arises from taking into account the transportation of parts between FMSs. Apparently, any job which requires processing on more than one FMS cannot be transported directly from one FMS to the next. Instead, a semifinished product completed in one period must be put into shop storage until some future time period at which it can be transported to the next FMS for further processing. Herein, a stochastic interaction/prediction algorithm is developed by using standard calculus of variations techniques. By means of the software package developed, many HSPP examples have been studied, showing that the algorithm is very effective.