Two-mode control of Brownian Motion with quadratic loss and switching costs

We consider a simple problem in the optimal control of Brownian Motion. There are two modes of control available, each with its own drift and diffusion coefficients, and switching costs are incurred whenever the control mode is changed. Finally, holding costs are incurred according to a quadratic function of the state of the system, and all costs are continuously discounted. It is shown that there exists an optimal policy involving just two critical numbers, and formulas are given for computation of the critical numbers.     

An approximation algorithm for a facility location problem with stochastic demands and inventories

We propose a 2-approximation algorithm for a facility location problem with stochastic demands. At open facilities, inventory is kept such that arriving requests find a zero inventory with (at most) some pre-specified probability. Costs incurred are expected transportation costs, facility operating costs and inventory costs.     

Optimal control of a divergent multi-echelon inventory system

Consider a divergent multi-echelon inventory system, such as a distribution system or a production system. At every facility in the system orders are placed (or production is initiated) periodically. The order arrives after a fixed lead time. At the end of each period linear costs are incurred penalty costs are incurred at the most downstream facilities for back-orders. The objective is to minimize the expected holding and penalty costs per period. We prove that under the balance assumption it is cost optimal to control every facility by an order-up-to-policy. The optimal replenishment policy, i.e. the order-up-to-level and the allocation functions at each facility, can be determined by system decomposition. This decomposition reduces complex multi-dimensional control problems to simple one-dimensional problems.     

An impulse control of a geometric Brownian motion with quadratic costs

We examine an optimal impulse control problem of a stochastic system whose state follows a geometric Brownian motion. We suppose that, when an agent intervenes in the system, it requires costs consisting of a quadratic form of the system state. Besides the intervention costs, running costs are continuously incurred to the system, and they are also of a quadratic form. Our objective is to find an optimal impulse control of minimizing the expected total discounted sum of the intervention costs and running costs incurred over the infinite time horizon. In order to solve this problem, we formulate it as a stochastic impulse control problem, which is approached via quasi-variational inequalities (QVI). Under a suitable set of sufficient conditions on the given problem parameters, we prove the existence of an optimal impulse control such that, whenever the system state reaches a certain level, the agent intervenes in the system. Consequently it instantaneously reduces to another level.     

Maintenance policies under imperfect information

This paper presents a continuous time maintenance problem where deterioration is Markovian and the state of the system is not directly observable except by means of an inspection. The costs incurred are inspection costs, state occupancy costs and replacement costs. We examine the problem of minimizing the expected average cost per unit time.     

Variance minimization for constrained discounted continuous-time MDPs with exponentially distributed stopping times

This paper deals with minimization of the variances of the total discounted costs for constrained Continuous-Time Markov Decision Processes (CTMDPs). The costs consist of cumulative costs incurred between jumps and instant costs incurred at jump epochs. We interpret discounting as an exponentially distributed stopping time. According to existing theory, for the expected total discounted costs optimal policies exist in the forms of randomized stationary and switching stationary policies. While the former is typically unique, the latter forms a finite set whose number of elements grows exponentially with the number of constraints. This paper investigates the problem when the process stops immediately after the first jump. For costs up to the first jump we provide an index for selection of actions by switching stationary policies and show that the indexed switching policy achieves a smaller variance than the randomized stationary policy. For problems without instant costs, the indexed switching policy achieves the minimum variance of costs up to the first jump among all the equivalent switching policies.     

Assignment problems with changeover cost

We consider some variant models, having changeover cost, of the assignment problem. In these models, multiple assignments to an operator are allowed. In addition to assignment costs, a changeover cost is incurred if an operator does one job after another is completed. Two different types of changeover costs and related two models are considered. Mathematical programming formulations are given for the models. When changeover costs are dependent on the operator but independent of the jobs and are non-negative, a linear programming model is obtained. For the case when changeover costs are dependent on the jobs, a linear integer programming formulation is obtained. We also show that, this problem is strongly NP-hard. A heuristic solution method is suggested for it. Numerical findings on the performance of the method are given.     

A multi-period order selection problem in flexible manufacturing systems

We consider a multi-period order selection problem in flexible manufacturing systems, which is the problem of selecting orders to be produced in each period during the upcoming planning horizon with the objective of minimising earliness and tardiness costs and subcontracting costs. The earliness and tardiness costs are incurred if an order is not finished on time, while subcontracting cost is incurred if an order is not selected within the planning horizon (and must be subcontracted) due to processing time capacity or tool magazine capacity. This problem is formulated as a 0–1 integer program which can be transformed into a generalised assignment problem. To solve the problem, a heuristic algorithm is developed using a Lagrangian relaxation technique. Effectiveness of the algorithm is tested on randomly generated problems and results are reported.     

The resource constrained project scheduling problem with multiple crashable modes: A heuristic procedure

We present a heuristic procedure for a nonpreemptive resource constrained project scheduling problem in which the duration/cost of an activity is determined by the mode selection and the duration reduction (crashing) applied within the selected mode. This problem is a natural combination of the time/cost trade-off problem and the resource constrained project scheduling problem. The objective is to determine each activity's start (finish) time, mode and duration so that the total project cost is minimized. Total project cost is the sum of all activity costs and the penalty cost for completing the project beyond its due date. We introduce a multi-pass algorithm. We report computational results with a set of 100 test problems and demonstrate the efficacy of the proposed heuristic procedure.     

A cost-based importance measure for system components: An extension of the Birnbaum importance

In reliability engineering, component importance measures are used to prioritise components in a system for purposes such as reliability improvement and maintenance planning. Existing importance measures have paid little attention to the costs incurred by maintaining a system and its components within a given time period. Cost-effectiveness analysis, however, is critically important in increasingly competitive markets. This paper proposes a new cost-based importance measure which considers costs incurred by maintaining a system and its components within a finite time horizon. Possible extensions are discussed and examples are given to show the use of the new measure.     

Optimal server assignment in a two-stage tandem queueing system

We study Markovian queueing systems consisting of two stations in tandem. There is a dedicated server in each station and an additional server that can be assigned to any station. Assuming that linear holding costs are incurred by jobs in the system and two servers can collaborate to work on the same job, we determine structural properties of optimal server assignment policies under the discounted and the average cost criteria.     

Vehicle routing with soft time windows and stochastic travel times: A column generation and branch-and-price solution approach

We study a vehicle routing problem with soft time windows and stochastic travel times. In this problem, we consider stochastic travel times to obtain routes which are both efficient and reliable. In our problem setting, soft time windows allow early and late servicing at customers by incurring some penalty costs. The objective is to minimize the sum of transportation costs and service costs. Transportation costs result from three elements which are the total distance traveled, the number of vehicles used and the total expected overtime of the drivers. Service costs are incurred for early and late arrivals; these correspond to time-window violations at the customers. We apply a column generation procedure to solve this problem. The master problem can be modeled as a classical set partitioning problem. The pricing subproblem, for each vehicle, corresponds to an elementary shortest path problem with resource constraints. To generate an integer solution, we embed our column generation procedure within a branch-and-price method. Computational results obtained by experimenting with well-known problem instances are reported.     

A simple algorithm for the source-induced fixed-charge transportation problem

The fixed-charge problem is a non-linear programming problem of practical interest in business and industry. The source-induced fixed-charge transportation problem (SIFCTP) is a variation of the regular fixed-charge transportation problem (FCTP) in which a fixed cost is incurred for every supply point that is used in the solution, along with a variable cost that is proportional to the amount shipped. This problem is significantly different from the widely studied FCTP, where a fixed cost is incurred upon activation of a route. The introduction of the fixed costs in addition to variable costs results in the objective function being a step function. Therefore, fixed-charge problems are usually solved using sophisticated analytical or computer software. This paper deviates from that approach. It presents a computationally simple algorithm for the solution of source-induced fixed-charge problems. The results of empirical tests of the effectiveness of the proposed algorithm are presented.     

Mixed-integer programming approaches for index tracking and enhanced indexation

We consider the problem of reproducing the performance of a stock market index, but without purchasing all of the stocks that make up the index, index tracking. We also consider the problem of out-performing the index, enhanced indexation. We present mixed-integer linear programming formulations of these problems. Our formulations include transaction costs, a constraint limiting the number of stocks that can be purchased and a limit on the total transaction cost that can be incurred. As our formulations of these problems are mixed-integer linear programs we can use a standard solver (Cplex). Numeric results are presented for eight data sets drawn from major markets. The largest of these data sets involves over 2000 stocks.     

Coordinated control of distribution supply chains in the presence of fuzzy customer demand

This paper considers a single product inventory control in a Distribution Supply Chain (DSC). The DSC operates in the presence of uncertainty in customer demands. The demands are described by imprecise linguistic expressions that are modelled by discrete fuzzy sets. Inventories at each facility within the DSC are replenished by applying periodic review policies with optimal order up-to-quantities. Fuzzy customer demands imply fuzziness in inventory positions at the end of review intervals and in incurred relevant costs per unit time interval. The determination of the minimum of defuzzified total cost of the DSC is a complex problem which is solved by applying decomposition; the original problem is decomposed into a number of simpler independent optimisation subproblems, where each retailer and the warehouse determine their optimum periodic reviews and order up-to-quantities. An iterative coordination mechanism is proposed for changing the review periods and order up-to-quantities for each retailer and the warehouse in such a way that all parties within the DSC are satisfied with respect to total incurred costs per unit time interval. Coordination is performed by introducing fuzzy constraints on review periods and fuzzy tolerances on retailers and warehouse costs in local optimisation subproblems.     

3.1. OR in banking

In this paper, we describe a deterministic multiperiod capacity expansion model in which a single facility serves the demand for many products. Potential applications for the model can be found in the capacity expansion planning of communication systems as well as in the production planning of heavy process industries. The model assumes that each capacity unit simultaneously serves a prespecified (though not necessarily integer) number of demand units of each product. Costs considered include capacity expansion costs, idle capacity holding costs, and capacity shortage costs. All cost functions are assumed to be nondecreasing and concave. Given the demand for each product over the planning horizon, the objective is to find the capacity expansion policy that minimizes the total cost incurred. We develop a dynamic programming algorithm that finds optimal policies. The required computational effort is a polynomial function of the number of products and the number of time periods. When the number of products equals one, the algorithm reduces to the well-known algorithm for the classical dynamic lot size problem.     

First passage models for denumerable semi-Markov decision processes with nonnegative discounted costs

This paper considers a first passage model for discounted semi-Markov decision processes with denumerable states and nonnegative costs.The criterion to be optimized is the expected discounted cost incurred during a first passage time to a given target set.We first construct a semi-Markov decision process under a given semi-Markov decision kernel and a policy.Then,we prove that the value function satisfies the optimality equation and there exists an optimal(or e-optimal) stationary policy under suitable conditions by using a minimum nonnegative solution approach.Further we give some properties of optimal policies.In addition,a value iteration algorithm for computing the value function and optimal policies is developed and an example is given.Finally,it is showed that our model is an extension of the first passage models for both discrete-time and continuous-time Markov decision processes.     

A framework for predicting gross institutional long-term care cost arising from known commitments at local authority level

As the UK population ages, it is forecasted that there will be an unsustainable increase in the need for, and therefore in the costs of long-term care. Although several studies have been performed to estimate these costs, they do not take into account the impact of survival patterns on costs. Focussing only on residents already in care (known commitments), we have developed, in association with an English local authority, a framework for estimating the future gross cost incurred by this group, built around a survival model. We apply this framework to forecast the cost over a given period of time, of maintaining a group of individuals in residential and nursing care, funded by the local authority. One of the novelties in the model is that it translates survival inputs and unit fees for care into cost in a manner, which was useful and meaningful to decision makers.     

The impact of cost uncertainty on the location of a distribution center

The location of a distribution center (DC) is a key consideration for the design of supply chain networks. When deciding on it, firms usually allow for transportation costs, but not supplier prices. We consider simultaneously the location of a DC and the choice of suppliers offering different, possibly random, prices for a single product. A buying firm attempts to minimize the sum of the price charged by a chosen supplier, and inbound and outbound transportation costs. No costs are incurred for switching suppliers. We first derive a closed-form optimal location for the case of a demand-populated unit line between two suppliers offering deterministic prices. We then let one of the two suppliers offer a random price. If the price follows a symmetric and unimodal distribution, the optimal location is closer to the supplier with a lower mean price. We also show the dominance of high variability: the buyer can decrease the total cost more for higher price variability for any location. The dominance result holds for normal, uniform, and gamma distributions. We propose an extended model with more than two suppliers on a plane and show that the dominance result still holds. From numerical examples for a line and a plane, we observe that an optimal location gets closer to the center of gravity of demands as the variability of any supplier’s price increases.