A stochastic programming approach for planning horizons of infinite horizon capacity planning problems

Planning horizon is a key issue in production planning. Different from previous approaches based on Markov Decision Processes, we study the planning horizon of capacity planning problems within the framework of stochastic programming. We first consider an infinite horizon stochastic capacity planning model involving a single resource, linear cost structure, and discrete distributions for general stochastic cost and demand data (non-Markovian and non-stationary). We give sufficient conditions for the existence of an optimal solution. Furthermore, we study the monotonicity property of the finite horizon approximation of the original problem. We show that, the optimal objective value and solution of the finite horizon approximation problem will converge to the optimal objective value and solution of the infinite horizon problem, when the time horizon goes to infinity. These convergence results, together with the integrality of decision variables, imply the existence of a planning horizon. We also develop a useful formula to calculate an upper bound on the planning horizon. Then by decomposition, we show the existence of a planning horizon for a class of very general stochastic capacity planning problems, which have complicated decision structure.     

An inventory control problem for deteriorating items with back-ordering and financial considerations

This paper investigates the effects of time value of money and inflation on the optimal ordering policy in an inventory control system. We proposed an economic order quantity model to manage a perishable item over the finite horizon planning under which back-ordering and delayed payment are assumed. The demand and deterioration rates are constant. The present value of total cost during the planning horizon in this inventory system is modeled first, then a three phases solution procedure is proposed to derive the optimal order and shortage quantities, and the number of replenishment during the planning horizon. Finally, the proposed model is illustrated through numerical examples and the sensitivity analysis is reported to find some managerial insights.     

Single item lot-sizing problems with backlogging on a single machine at a finite production rate

In this paper we consider a single item lot-sizing problem with backlogging on a single machine at a finite production rate. The objective is to minimize the total cost of setup, stockholding and backlogging to satisfy a sequence of discrete demands. Both varying demands over a finite planning horizon and fixed demands at regular intervals over an infinite planning horizon are considered. We have characterized the structure of an optimal production schedule for both cases. As a consequence of this characterization, a dynamic programming algorithm is proposed for the computation of an optimal production schedule for the varying demands case and a simpler one for the fixed demands case.     

Controlled jump processes

Finite and infinite planning horizon Markov decision problems are formulated for a class of jump processes with general state and action spaces and controls which are measurable functions on the time axis taking values in an appropriate metrizable vector space. For the finite horizon problem, the maximum expected reward is the unique solution, which exists, of a certain differential equation and is a strongly continuous function in the space of upper semi-continuous functions. A necessary and sufficient condition is provided for an admissible control to be optimal, and a sufficient condition is provided for the existence of a measurable optimal policy. For the infinite horizon problem, the maximum expected total reward is the fixed point of a certain operator on the space of upper semi-continuous functions. A stationary policy is optimal over all measurable policies in the transient and discounted cases as well as, with certain added conditions, in the positive and negative cases.     

Existence of efficient solutions in infinite horizon optimization under continuous and discrete controls

For time-varying deterministic infinite horizon control problems, we provide conditions for the existence of efficient solutions, i.e., solutions which are optimal to each of the states through which they pass. A sufficient condition is that the mappings from controls to states be open. Applications to production planning are considered.     

Necessary conditions of Pareto optimality for multiobjective optimal control problems under constraints

This paper studies multiobjective optimal control problems in presence of constraints in the discrete time framework. Both the finite- and infinite-horizon settings are considered. The paper provides necessary conditions of Pareto optimality under lighter smoothness assumptions compared to the previously obtained results. These conditions are given in the form of weak and strong Pontryagin principles which generalize the existing ones. To obtain some of these results, we provide new multiplier rules for multiobjective static optimization problems and new Pontryagin principles for the finite horizon multiobjective optimal control problems.     

Necessary and Sufficient Conditions for Feedback Nash Equilibria for the Affine-Quadratic Differential Game

In this note, we consider the non-cooperative linear feedback Nash quadratic differential game with an infinite planning horizon. The performance function is assumed to be indefinite and the underlying system affine. We derive both necessary and sufficient conditions under which this game has a Nash equilibrium. As a special case, we derive existence conditions for the multi-player zero-sum game.     

On the control of a generalized storage model

A finite-capacity storage model is considered. The random inputs (negative inputs represent demands) are of various types, determined by a Markov chain, and occur at discrete times. Under suitable assumptions on the costs involved, including a penalty cost for unmet demand, an optimal control policy is determined for the releases from the storage facility, when operated over a finite horizon. Stationary control policies for the unbounded horizon are also determined and conditions for their optimality are discussed. Finally, a few simple examples are considered.The author would like to acknowledge the constructive comments of the referee, which led to an improved exposition of the present paper.     

Mean-field stochastic control with elephant memory in finite and infinite time horizon

ABSTRACT

Our purpose of this paper is to study stochastic control problems for systems driven by mean-field stochastic differential equations with elephant memory, in the sense that the system (like the elephants) never forgets its history. We study both the finite horizon case and the infinite time horizon case.

• In the finite horizon case, results about existence and uniqueness of solutions of such a system are given. Moreover, we prove sufficient as well as necessary stochastic maximum principles for the optimal control of such systems. We apply our results to solve a mean-field linear quadratic control problem.

• For infinite horizon, we derive sufficient and necessary maximum principles.

  As an illustration, we solve an optimal consumption problem from a cash flow modelled by an elephant memory mean-field system.

     

Sufficient and necessary conditions for stochastic near-optimal controls: A stochastic chemostat model with non-zero cost inhibiting

Near-optimal controls are as important as optimal controls for both theory and applications. Meanwhile, using inhibitor to control harmful microorganisms and ensure maximum growth of beneficial microorganisms (target microorganisms) is a very interesting topic in the chemostat. Thus, in this paper, we consider a stochastic chemostat model with non-zero cost inhibiting in finite time. The near-optimal control problem was constructed by minimizing the number of harmful microorganisms and minimizing the cost of inhibitor. We find that the Hamiltonian function is key to estimate objective function, and according to the adjoint equation, we obtain some error estimations of the near-optimality. Finally, we establish sufficient and necessary conditions for stochastic near-optimal controls of this model and numerical simulations and some conclusions are given.     

A deterministic,multi-item inventory model with supplier selection and imperfect quality

This paper considers the scenario of supply chain with multiple products and multiple suppliers, all of which have limited capacity. We assume that received items from suppliers are not of perfect quality. Items of imperfect quality, not necessarily defective, could be used in another inventory situation. Imperfect items are sold as a single batch, prior to receiving the next shipment, at a discounted price. The demand over a finite planning horizon is known, and an optimal procurement strategy for this multi-period horizon is to be determined. Each of products can be sourced from a set of approved suppliers, a supplier-dependent transaction cost applies for each period in which an order is placed on a supplier. A product-dependent holding cost per period applies for each product in the inventory that is carried across a period in the planning horizon. Also a maximum storage space for the buyer in each period is considered. The decision maker, the buyer, needs to decide what products to order, in what quantities, with which suppliers, and in which periods. Finally, a genetic algorithm (GA) is used to solve the model.     

Markov跳变系统滚动时域有限记忆控制

针对离散时间Markov跳变系统,提出滚动时域有限记忆控制的方法.在一段有限滤波时域上,利用系统输入与输出变量的线性组合构造一段有限控制时域上的输出反馈控制器.首先,不考虑跳变系统均方可镇定,基于最优控制的方法,获得以迭代计算形式给出的控制器,并使其在无偏条件下能优化二次型性能指标.其次,进一步考虑在成本衰减条件下确定终端加权矩阵,并以它作为边界条件计算得到最优控制律,调节系统均方稳定.为便于求解,成本衰减条件以线性矩阵不等式的形式给出.仿真实例验证了所提方法的可行性和有效性.     

A successive convex approximation method for multistage workforce capacity planning problem with turnover

Workforce capacity planning in human resource management is a critical and essential component of the services supply chain management. In this paper, we consider the planning problem of transferring, hiring, or firing employees among different departments or branches of an organization under an environment of uncertain workforce demands and turnover, with the objective of minimizing the expected cost over a finite planning horizon. We model the problem as a multistage stochastic program and propose a successive convex approximation method which solves the problem in stages and iteratively. An advantage of the method is that it can handle problems of large size where normally solving the problems by equivalent deterministic linear programs is considered to be computationally infeasible. Numerical experiments indicate that solutions obtained by the proposed method have expected costs near optimal.     

Finite horizon semi-Markov decision processes with application to maintenance systems

This paper investigates finite horizon semi-Markov decision processes with denumerable states. The optimality is over the class of all randomized history-dependent policies which include states and also planning horizons, and the cost rate function is assumed to be bounded below. Under suitable conditions, we show that the value function is a minimum nonnegative solution to the optimality equation and there exists an optimal policy. Moreover, we develop an effective algorithm for computing optimal policies, derive some properties of optimal policies, and in addition, illustrate our main results with a maintenance system.     

On a finite horizon production lot size inventory model for deteriorating items: An optimal solution

A generalized production lot size inventory model for deteriorating items over a finite planning horizon is considered. The demand, production, and deteriorating rates are assumed to be known and continuous functions of time. Shortages are allowed and completely backlogged. The conditions under which the system total cost attains its (unique) global minimum are derived. An example which illustrate the applicability of theoretical results is also introduced.     

On the No-Gap Second-Order Optimality Conditions for a Discrete Optimal Control Problem with Mixed Constraints

Motivated by our recent works on optimality conditions in discrete optimal control problems under a nonconvex cost function, in this paper, we study second-order necessary and sufficient optimality conditions for a discrete optimal control problem with a nonconvex cost function and state-control constraints. By establishing an abstract result on second-order optimality conditions for a mathematical programming problem, we derive second-order necessary and sufficient optimality conditions for a discrete optimal control problem. Using a common critical cone for both the second-order necessary and sufficient optimality conditions, we obtain “no-gap” between second-order optimality conditions.     

A non-stationary periodic review production–inventory model with uncertain production capacity and uncertain demand

In this paper we consider a nonstationary periodic review dynamic production–inventory model with uncertain production capacity and uncertain demand. The maximum production capacity varies stochastically. It is known that order up-to (or base-stock, critical number) policies are optimal for both finite horizon problems and infinite horizon problems. We obtain upper and lower bounds of the optimal order up-to levels, and show that for an infinite horizon problem the upper and the lower bounds of the optimal order up-to levels for the finite horizon counterparts converge as the planning horizons considered get longer. Furthermore, under mild conditions the differences between the upper and the lower bounds converge exponentially to zero.     

On a class of optimal control problems with distributed and lumped parameters

The optimal control of moving sources governed by a parabolic equation and a system of ordinary differential equations with initial and boundary conditions is considered. For this problem, an existence and uniqueness theorem is proved, sufficient conditions for the Fréchet differentiability of the cost functional are established, an expression for its gradient is derived, and necessary optimality conditions in the form of pointwise and integral maximum principles are obtained.     

Structure of minimizers in linear-quadratic Bolza problems of optimal control

In this paper, we study intersections of extremals in a linear-quadratic Bolza problem of optimal control. The structure of the inter-sections is described. We show that this structure implies the semipositive definiteness of the quadratic cost functional. In addition, we derive necessary and sufficient conditions for the existence of minimizers.