Coordinating inventory control and pricing strategies: The continuous review model

We analyze an infinite horizon, single product, continuous review model in which pricing and inventory decisions are made simultaneously and ordering cost includes a fixed cost. We show that there exists a stationary (s,S) inventory policy maximizing the expected discounted or expected average profit under general conditions.     

Risk-sensitive control of continuous time Markov chains

We study risk-sensitive control of continuous time Markov chains taking values in discrete state space. We study both finite and infinite horizon problems. In the finite horizon problem we characterize the value function via Hamilton Jacobi Bellman equation and obtain an optimal Markov control. We do the same for infinite horizon discounted cost case. In the infinite horizon average cost case we establish the existence of an optimal stationary control under certain Lyapunov condition. We also develop a policy iteration algorithm for finding an optimal control.     

On the optimality of a full-service policy for a queueing system with discounted costs

We provide weak sufficient conditions for a full-service policy to be optimal in a queueing control problem in which the service rate is a dynamic decision variable. In our model there are service costs and holding costs and the objective is to minimize the expected total discounted cost over an infinite horizon. We begin with a semi-Markov decision model for a single-server queue with exponentially distributed inter-arrival and service times. Then we present a general model with weak probabilistic assumptions and demonstrate that the full-service policy minimizes both finite-horizon and infinite-horizon total discounted cost on each sample path.     

Joint pricing and inventory control with a Markovian demand model

We consider the joint pricing and inventory control problem for a single product over a finite horizon and with periodic review. The demand distribution in each period is determined by an exogenous Markov chain. Pricing and ordering decisions are made at the beginning of each period and all shortages are backlogged. The surplus costs as well as fixed and variable costs are state dependent. We show the existence of an optimal (s, S, p)-type feedback policy for the additive demand model. We extend the model to the case of emergency orders. We compute the optimal policy for a class of Markovian demand and illustrate the benefits of dynamic pricing over fixed pricing through numerical examples. The results indicate that it is more beneficial to implement dynamic pricing in a Markovian demand environment with a high fixed ordering cost or with high demand variability.     

Dynamic cost allocation for economic lot sizing games

We consider a cooperative game defined by an economic lot sizing problem with concave ordering costs over a finite time horizon, in which each player faces demand for a single product in each period and coalitions can pool orders. We show how to compute a dynamic cost allocation in the strong sequential core of this game, i.e. an allocation over time that exactly distributes costs and is stable against coalitional defections at every period of the time horizon.     

Controlled jump processes

Finite and infinite planning horizon Markov decision problems are formulated for a class of jump processes with general state and action spaces and controls which are measurable functions on the time axis taking values in an appropriate metrizable vector space. For the finite horizon problem, the maximum expected reward is the unique solution, which exists, of a certain differential equation and is a strongly continuous function in the space of upper semi-continuous functions. A necessary and sufficient condition is provided for an admissible control to be optimal, and a sufficient condition is provided for the existence of a measurable optimal policy. For the infinite horizon problem, the maximum expected total reward is the fixed point of a certain operator on the space of upper semi-continuous functions. A stationary policy is optimal over all measurable policies in the transient and discounted cases as well as, with certain added conditions, in the positive and negative cases.     

Asymptotic properties of constrained Markov Decision Processes

We present in this paper several asymptotic properties of constrained Markov Decision Processes (MDPs) with a countable state space. We treat both the discounted and the expected average cost, with unbounded cost. We are interested in (1) the convergence of finite horizon MDPs to the infinite horizon MDP, (2) convergence of MDPs with a truncated state space to the problem with infinite state space, (3) convergence of MDPs as the discount factor goes to a limit. In all these cases we establish the convergence of optimal values and policies. Moreover, based on the optimal policy for the limiting problem, we construct policies which are almost optimal for the other (approximating) problems. Based on the convergence of MDPs with a truncated state space to the problem with infinite state space, we show that an optimal stationary policy exists such that the number of randomisations it uses is less or equal to the number of constraints plus one. We finally apply the results to a dynamic scheduling problem.This work was partially supported by the Chateaubriand fellowship from the French embassy in Israel and by the European Grant BRA-QMIPS of CEC DG XIII     

Optimal policy for a dynamic,non-stationary,stochastic inventory problem with capacity commitment

This paper studies a single-product, dynamic, non-stationary, stochastic inventory problem with capacity commitment, in which a buyer purchases a fixed capacity from a supplier at the beginning of a planning horizon and the buyer’s total cumulative order quantity over the planning horizon is constrained with the capacity. The objective of the buyer is to choose the capacity at the beginning of the planning horizon and the order quantity in each period to minimize the expected total cost over the planning horizon. We characterize the structure of the minimum sum of the expected ordering, storage and shortage costs in a period and thereafter and the optimal ordering policy for a given capacity. Based on the structure, we identify conditions under which a myopic ordering policy is optimal and derive an equation for the optimal capacity commitment. We then use the optimal capacity and the myopic ordering policy to evaluate the effect of the various parameters on the minimum expected total cost over the planning horizon.     

Optimal Control of Markov Processes with Age-Dependent Transition Rates

We study optimal control of Markov processes with age-dependent transition rates. The control policy is chosen continuously over time based on the state of the process and its age. We study infinite horizon discounted cost and infinite horizon average cost problems. Our approach is via the construction of an equivalent semi-Markov decision process. We characterise the value function and optimal controls for both discounted and average cost cases.     

A deterministic,multi-item inventory model with supplier selection and imperfect quality

This paper considers the scenario of supply chain with multiple products and multiple suppliers, all of which have limited capacity. We assume that received items from suppliers are not of perfect quality. Items of imperfect quality, not necessarily defective, could be used in another inventory situation. Imperfect items are sold as a single batch, prior to receiving the next shipment, at a discounted price. The demand over a finite planning horizon is known, and an optimal procurement strategy for this multi-period horizon is to be determined. Each of products can be sourced from a set of approved suppliers, a supplier-dependent transaction cost applies for each period in which an order is placed on a supplier. A product-dependent holding cost per period applies for each product in the inventory that is carried across a period in the planning horizon. Also a maximum storage space for the buyer in each period is considered. The decision maker, the buyer, needs to decide what products to order, in what quantities, with which suppliers, and in which periods. Finally, a genetic algorithm (GA) is used to solve the model.     

Infinite horizon optimal policy for an inventory system with two types of product sharing common hardware platforms

We consider a periodic review inventory system and present its optimal policy in the infinite horizon setting. The optimal inventory policy that maximizes the infinite horizon expected discounted profit for the model is analytically obtained by relating to the finite horizon setting using results from variational analysis. Results are provided that elucidate the operations of the inventory system in the long run.     

Inventory decisions for a finite horizon problem with product substitution options and time varying demand

The inventory control of substitutable products has been recognized as a problem worthy of study in the operations management literature. Product substitution provides flexibility in supply chain management and enhances response time in production control. This paper proposes a finite horizon inventory control problem for two substitutable products, which are ordered jointly in each replenishment epoch. Demand for the products are assumed to be time–varying. In case of a stock–out for one of the products, its demand is satisfied by using the stock of the other product. The optimal ordering schedule, for both products, that minimizes the total cost over a finite planning horizon is derived. Numerical examples along with sensitivity analyses are also presented.     

Direct shipping and the dynamic single-depot/multi-retailer inventory system

In this paper we study a single-depot/multi-retailer system with independent stochastic stationary demands, linear inventory costs, and backlogging at the retailers over an infinite horizon. In addition, we also consider the transportation cost between the depot and the retailers. Orders are placed each period by the depot. The orders arrive at the depot and are allocated and delivered to the retailers. No inventory is held at the depot. We consider a specific policy of direct shipments. That is, a lower bound on the long run average cost per period for the system over all order/delivery strategies is developed. The simulated long term average cost per period of the delivery strategy of direct shipping with fully loaded trucks is examined via comparison to the derived lower bound. Simulation studies demonstrate that very good results can be achieved by a direct shipping policy.     

需求不确定的多周期的容量决策问题

研究每个周期的需求随机增加的情形下的容量扩充问题,建立起切合实际的有限周期随机动态规划模型及在期现值准则下的无限周期随机动态规划模型,进而探索生产单一产品的公司在面对随机增加的市场需求时,风险中立的管理者该如何扩充其生产容量,才能使得其公司在折扣意义下的总期望利润最大.研究无限阶段的容量扩充问题,得出某种约束条件下的优化策略解,给公司管理者提供了其长期可持续发展的优化策略和依据.     

Capacitated,balanced, sequential location-allocation problems on chains and trees

This paper considers finite horizon, multiperiod, sequential, minisum location-allocation problems on chain graphs and tree networks. The demand has both deterministic and probabilistic components, and increases dynamically from period to period. The problem is to locate one additionalcapacitated facility in each of thep specified periods, and to determine the service allocations of the facilities, in order to optimally satisfy the demand on the network. In this context, two types of objective criteria or location strategies are addressed. The first is a myopic strategy in which the present period cost is minimized sequentially for each period, and the second is a discounted present worth strategy. For the chain graph, we analyze ap-facility problem under both these criteria, while for the tree graph, we analyze a 3-facility myopic problem, and a 2-facility discounted present worth problem. All these problems are nonconvex, and we specify a finite set of candidate solutions which may be compared in order to determine a global optimal solution.     

A committed delivery strategy with fixed frequency and quantity

We analyze a supply chain environment in which a distributor facing price-sensitive demand has the opportunity to contractually commit to a delivery quantity at regular intervals over a finite horizon in exchange for a per-unit cost reduction for units acquired via committed delivery. Supplemental orders needed to meet demand are purchased at an additional unit cost. For normally distributed demand, we use a simulation-based approximation to develop models yielding closed-form solutions for the optimal order quantity and resell price for the distributor. Inventory, ordering and pricing implications for this “committed delivery strategy” are investigated.     

Costing minimal-repair replacement policies over finite time horizons

An integral-equation technique is used to evaluate the expectedcost of maintaining a system functioning over the period (O,t] using two minimal-repair replacement policies. These costfunctions provide appropriate criteria to determine T^*, theoptimal scheduled replacement period over this finite time horizon.For both policies, it is shown that significant cost savingscan be achieved by using the T^* values predicted by the newmodels with a finite time horizon rather than those obtainedfrom the established asymptotic formulations. An adaptive finiteminimal-repair replacement policy is also formulated using dynamicprogramming, and the expected cost of this policy is shown tobe only slightly less than that of the best stationary policy.     

Polynomial cases of the economic lot sizing problem with cost discounts

In this paper we study the economic lot sizing problem with cost discounts. In the economic lot sizing problem a facility faces known demands over a discrete finite horizon. At each period, the ordering cost function and the holding cost function are given and they can be different from period to period. There are no constraints on the quantity ordered in each period and backlogging is not allowed. The objective is to decide when and how much to order so as to minimize the total ordering and holding costs over the finite horizon without any shortages. We study two different cost discount functions. The modified all-unit discount cost function alternates increasing and flat sections, starting with a flat section that indicates a minimum charge for small quantities. While in general the economic lot sizing problem with modified all-unit discount cost function is known to be NP-hard, we assume that the cost functions do not vary from period to period and identify a polynomial case. Then we study the incremental discount cost function which is an increasing piecewise linear function with no flat sections. The efficiency of the solution algorithms follows from properties of the optimal solution. We computationally test the polynomial algorithms against the use of CPLEX.     

Optimal dynamic pricing of inventories with stochastic demand and discounted criterion

We consider a continuous time dynamic pricing problem for selling a given number of items over a finite or infinite time horizon. The demand is price sensitive and follows a non-homogeneous Poisson process. We formulate this problem as to maximize the expected discounted revenue and obtain the structural properties of the optimal revenue function and optimal price policy by the Hamilton-Jacobi-Bellman (HJB) equation. Moreover, we study the impact of the discount rate on the optimal revenue function and the optimal price. Further, we extend the problem to the case with discounting and time-varying demand, the infinite time horizon problem. Numerical examples are used to illustrate our analytical results.     

Denumerable controlled Markov chains with strong average optimality criterion: Bounded & unbounded costs

This paper studies discrete-time nonlinear controlled stochastic systems, modeled by controlled Markov chains (CMC) with denumerable state space and compact action space, and with an infinite planning horizon. Recently, there has been a renewed interest in CMC with a long-run, expected average cost (AC) optimality criterion. A classical approach to study average optimality consists in formulating the AC case as a limit of the discounted cost (DC) case, as the discount factor increases to 1, i.e., as the discounting effectvanishes. This approach has been rekindled in recent years, with the introduction by Sennott and others of conditions under which AC optimal stationary policies are shown to exist. However, AC optimality is a rather underselective criterion, which completely neglects the finite-time evolution of the controlled process. Our main interest in this paper is to study the relation between the notions of AC optimality andstrong average cost (SAC) optimality. The latter criterion is introduced to asses the performance of a policy over long but finite horizons, as well as in the long-run average sense. We show that for bounded one-stage cost functions, Sennott's conditions are sufficient to guarantee thatevery AC optimal policy is also SAC optimal. On the other hand, a detailed counterexample is given that shows that the latter result does not extend to the case of unbounded cost functions. In this counterexample, Sennott's conditions are verified and a policy is exhibited that is both average and Blackwell optimal and satisfies the average cost inequality.