Progressive hedging and tabu search applied to mixed integer (0,1) multistage stochastic programming

Many problems faced by decision makers are characterized by a multistage decision process with uncertainty about the future and some decisions constrained to take on values of either zero or one (for example, either open a facility at a location or do not open it). Although some mathematical theory exists concerning such problems, no general-purpose algorithms have been available to address them. In this article, we introduce the first implementation of general purpose methods for finding good solutions to multistage, stochastic mixed-integer (0, 1) programming problems. The solution method makes use of Rockafellar and Wets' progressive hedging algorithm that averages solutions rather than data. Solutions to the induced quadratic (0,1) mixed-integer subproblems are obtained using a tabu search algorithm. We introduce the notion of integer convergence for progressive hedging. Computational experiments verify that the method is effective. The software that we have developed reads standard (SMPS) data files.     

Progressive hedging for stochastic programs with cross-scenario inequality constraints

Computational Management Science - In this paper, we show how progressive hedging may be used to solve stochastic programming problems that involve cross-scenario inequality constraints. In...     

Progressive hedging innovations for a class of stochastic mixed-integer resource allocation problems

Numerous planning problems can be formulated as multi-stage stochastic programs and many possess key discrete (integer) decision variables in one or more of the stages. Progressive hedging (PH) is a scenario-based decomposition technique that can be leveraged to solve such problems. Originally devised for problems possessing only continuous variables, PH has been successfully applied as a heuristic to solve multi-stage stochastic programs with integer variables. However, a variety of critical issues arise in practice when implementing PH for the discrete case, especially in the context of very difficult or large-scale mixed-integer problems. Failure to address these issues properly results in either non-convergence of the heuristic or unacceptably long run-times. We investigate these issues and describe algorithmic innovations in the context of a broad class of scenario-based resource allocation problem in which decision variables represent resources available at a cost and constraints enforce the need for sufficient combinations of resources. The necessity and efficacy of our techniques is empirically assessed on a two-stage stochastic network flow problem with integer variables in both stages.     

Extended formulations for stochastic lot-sizing problems

In this paper, extended formulations for stochastic uncapacitated lot-sizing problems with and without backlogging are developed in higher dimensional spaces that provide integral solutions. Moreover, physical meanings of the decision variables in the extended formulations are explored and special cases with more efficient formulations are studied.     

Heuristic procedures for a stochastic lot-sizing problem in make-to-order manufacturing

We consider a single item, uncapacitated stochastic lot-sizing problem motivated by a Dutch make-to-order company producing steel pipes. Since no finished goods inventory is kept, a delivery date is fixed upon arrival of each order. The objective is to determine the optimal size of production lots so that delivery dates are met as closely as possible with a limited number of set-ups. Orders that are not satisfied on time are backordered and a penalty cost is incurred in those cases. We formulate the problem as a Markov Decision Process and determine the optimal production policy by dynamic programming. Since this approach can only be applied to very small examples, attention is given to the development of three simple lot-sizing rules. The first strategy consists of producing the orders for a fixed numberT of periods whenever the demand for the current period reaches a pre-specified limitx. A simple set of tests is proposed leading to cost improvements in situations where the best combination for the decision variablesx andT deviates from the optimal policy. The second lot-sizing rule is based on the well-known Silver-Meal heuristic for the case of deterministic time-varying demand. A fixed cycle production strategy is also derived. Numerical examples taking into account different demand patterns are provided. The analysis of the results suggests that the first heuristic is particularly suitable for the problem under consideration. Finally, the model is incorporated in the operations control level of the hierarchical production planning system of the Dutch company and assists the management in the evaluation of the quality of the aggregate decisions. A consequence of this feedback mechanism is the modification of the aggregate plans.On leave from D.E.I.O. (Universidade de Lisboa, Portugal). This research was supported by J.N.I.C.T. (Portugal) under contract BD/2264/92.IA.     

Production strategies for a stochastic lot-sizing problem with constant capacity

This paper presents a single item capacitated stochastic lot-sizing problem motibated by a Dutch company operating in a Make-To-Order environment. Due to a highly fluctuating and unpredictable demand, it is not possible to keep any finished goods inventory. In response to a customer's order, a fixed delivery date is quoted by the company. The objective is to determine in each period of the planning horizon the optimal size of production lots so that delivery dates are met as closely as possible at the expense of minimal average costs. These include set-up costs, holding costs for orders that are finished before their promised delivery date and penalty costs for orders that are not satisfied on time and are therefore backordered. Given that the optimal production policy is likely to be too complex in this situation, attention is focused on the development of heuristic procedures. In this paper two heuristics are proposed. The first one is an extension of a simple production strategy derived by Dellaert [5] for the uncapacitated version of the problem. The second heuristic is based on the well-known Silver-Meal algorithm for the case of deterministic time-varying demand. Experimental results suggest that the first heuristic gives low average costs especially when the demand variability is low and there are large differences in the cost parameters. The Silver-Meal approach is usually outperformed by the first heuristic in situations where the available production capacity is tight and the demand variability is low.     

Two-stage stochastic lot-sizing problem under cost uncertainty

For production planning problems, cost parameters can be uncertain due to marketing activities and interest rate fluctuation. In this paper, we consider a single-item two-stage stochastic lot-sizing problem under cost parameter uncertainty. Assuming cost parameters will increase or decrease after time period p each with certain probability, we minimize the total expected cost for a finite horizon problem. We develop an extended linear programming formulation in a higher dimensional space that can provide integral solutions by showing that its constraint matrix is totally unimodular. We also project this extended formulation to a lower dimensional space and obtain a corresponding extended formulation in the lower dimensional space. Final computational experiments demonstrate that the extended formulation is more efficient and performs more stable than the two-stage stochastic mixed-integer programming formulation.     

Applying the progressive hedging algorithm to stochastic generalized networks

The introduction of uncertainty to mathematical programs greatly increases the size of the resulting optimization problems. Specialized methods that exploit program structures and advances in computer technology promise to overcome the computational complexity of certain classes of stochastic programs. In this paper we examine the progressive hedging algorithm for solving multi-scenario generalized networks. We present computational results demonstrating the effect of various internal tactics on the algorithm's performance. Comparisons with alternative solution methods are provided.Research supported in part by grants from the National Science Foundation (DCR-861-4057) and the Mathematical and Analytics Computation Center of IBM Corporation, New York.     

Linear programming with stochastic processes as parameters as applied to production planning

In formulating stochastic programming with recourse models, the parameters of the linear programs are usually assumed to be random variables with known distributions. In this paper, the requirement vector parameter is assumed to be a stochastic process { _i (t),tT,i=1,...,m}. The properties of the deterministic equivalents for the cases of the discrete and continuous index setT are derived. The results of the paper are applied to a multi-item production planning model with continuous (periodic) review of the stock on hand of various items.     

On formulations of the stochastic uncapacitated lot-sizing problem

We consider two formulations of a stochastic uncapacitated lot-sizing problem. We show that by adding (?,S) inequalities to the one with the smaller number of variables, both formulations give the same LP bound. Then we show that for two-period problems, adding another class of inequalities gives the convex hull of integral solutions.     

On stochastic lot-sizing problems with random lead times

We give multi-stage stochastic programming formulations for lot-sizing problems where costs, demands and order lead times follow a general discrete-time stochastic process with finite support. We characterize the properties of an optimal solution and give a dynamic programming algorithm, polynomial in the scenario tree size, when orders do not cross in time.     

Backward stochastic partial differential equations related to utility maximization and hedging

We study the utility maximization problem, the problem of minimization of the hedging error and the corresponding dual problems using dynamic programming approach. We consider an incomplete financial market model, where the dynamics of asset prices are described by an ℝ^d-valued continuous semimartingale. Under some regularity assumptions, we derive the backward stochastic PDEs for the value functions related to these problems, and for the primal problem, we show that the strategy is optimal if and only if the corresponding wealth process satisfies a certain forward SDE. As examples we consider the mean-variance hedging problem and the cases of power, exponential, logarithmic utilities, and corresponding dual problems. __________ Translated from Sovremennaya Matematika i Ee Prilozheniya (Contemporary Mathematics and Its Applications), Vol. 45, Martingale Theory and Its Application, 2007.     

A branch-and-cut algorithm for the stochastic uncapacitated lot-sizing problem

This paper addresses a multi-stage stochastic integer programming formulation of the uncapacitated lot-sizing problem under uncertainty. We show that the classical (ℓ,S) inequalities for the deterministic lot-sizing polytope are also valid for the stochastic lot-sizing polytope. We then extend the (ℓ,S) inequalities to a general class of valid inequalities, called the inequalities, and we establish necessary and sufficient conditions which guarantee that the inequalities are facet-defining. A separation heuristic for inequalities is developed and incorporated into a branch-and-cut algorithm. A computational study verifies the usefulness of the inequalities as cuts. This research has been supported in part by the National Science Foundation under Award number DMII-0121495.     

An efficient computational method for a stochastic dynamic lot-sizing problem under service-level constraints

We provide an efficient computational approach to solve the mixed integer programming (MIP) model developed by Tarim and Kingsman [8] for solving a stochastic lot-sizing problem with service level constraints under the static-dynamic uncertainty strategy. The effectiveness of the proposed method hinges on three novelties: (i) the proposed relaxation is computationally efficient and provides an optimal solution most of the time, (ii) if the relaxation produces an infeasible solution, then this solution yields a tight lower bound for the optimal cost, and (iii) it can be modified easily to obtain a feasible solution, which yields an upper bound. In case of infeasibility, the relaxation approach is implemented at each node of the search tree in a branch-and-bound procedure to efficiently search for an optimal solution. Extensive numerical tests show that our method dominates the MIP solution approach and can handle real-life size problems in trivial time.     

随机支付型未定权益的风险最小套期保值

讨论了具有随机支付型未定权益的风险最小套期问题.假定市场中存在两类具有不同市场信息的投资者,对于一个预先给定的随机支付流未定权益,利用Galtchouk-Kunita-Watanabe分解和L2空间投影定理证明了风险最小策略的存在性和唯一性,并给出了风险最小策略的构造方法.     

Multi-stage stochastic optimization applied to energy planning

This paper presents a methodology for the solution of multistage stochastic optimization problems, based on the approximation of the expected-cost-to-go functions of stochastic dynamic programming by piecewise linear functions. No state discretization is necessary, and the combinatorial explosion with the number of states (the well known curse of dimensionality of dynamic programming) is avoided. The piecewise functions are obtained from the dual solutions of the optimization problem at each stage and correspond to Benders cuts in a stochastic, multistage decomposition framework. A case study of optimal stochastic scheduling for a 39-reservoir system is presented and discussed.     

Optimal lot-sizing under strict carbon cap policy considering stochastic demand

Due to stringent laws and increasing awareness of customers, organizations are becoming environmental conscious and looking beyond conventional cost minimization/profit maximization approach and striving to curb carbon emission. In this article, we have considered strict carbon cap policy to determine the optimal order quantity, reorder point and number of shipments in a two-echelon supply chain under stochastic demand considering partial backorders. All the major sources of emission such as production, inventory, and transportation have been considered. The objective is to minimize the total expected supply chain cost while satisfying the carbon emission constraint. A numerical example is given to illustrate the solution procedure. Further, sensitivity analyses have been carried out to get insight that how with operational adjustments both cost and emission can be controlled.     

Cross decomposition applied to the stochastic transportation problem

In this paper we give a solution method for the stochastic transportation problem based on Cross Decomposition developed by Van Roy (1980). Solution methods to the derived sub and master problems are discussed and computational results are given for a number of large scale test problems. We also compare the efficiency of the method with other methods suggested for the stochastic transportation problem: The Frank-Wolfe algorithm and separable programming.     

On the implementation of a log-barrier progressive hedging method for multistage stochastic programs

A progressive hedging method incorporated with self-concordant barrier for solving multistage stochastic programs is proposed recently by Zhao [G. Zhao, A Lagrangian dual method with self-concordant barrier for multistage stochastic convex nonlinear programming, Math. Program. 102 (2005) 1-24]. The method relaxes the nonanticipativity constraints by the Lagrangian dual approach and smoothes the Lagrangian dual function by self-concordant barrier functions. The convergence and polynomial-time complexity of the method have been established. Although the analysis is done on stochastic convex programming, the method can be applied to the nonconvex situation. We discuss some details on the implementation of this method in this paper, including when to terminate the solution of unconstrained subproblems with special structure and how to perform a line search procedure for a new dual estimate effectively. In particular, the method is used to solve some multistage stochastic nonlinear test problems. The collection of test problems also contains two practical examples from the literature. We report the results of our preliminary numerical experiments. As a comparison, we also solve all test problems by the well-known progressive hedging method.