The sample average approximation method for empty container repositioning with uncertainties

One of the challenges faced by liner operators today is to effectively operate empty containers in order to meet demand and to reduce inefficiency in an uncertain environment. To incorporate uncertainties in the operations model, we formulate a two-stage stochastic programming model with random demand, supply, ship weight capacity, and ship space capacity. The objective of this model is to minimize the expected operational cost for Empty Container Repositioning (ECR). To solve the stochastic programs with a prohibitively large number of scenarios, the Sample Average Approximation (SAA) method is applied to approximate the expected cost function. To solve the SAA problem, we consider applying the scenario aggregation by combining the approximate solution of the individual scenario problem. Two heuristic algorithms based on the progressive hedging strategy are applied to solve the SAA problem. Numerical experiments are provided to show the good performance of the scenario-based method for the ECR problem with uncertainties.     

Dynamic repositioning for vehicle sharing with setup costs

This study considers a multi-period two-region repositioning problem with setup repositioning costs involved for vehicle sharing systems. We find that incorporating such costs can influence the total cost significantly and complicate the structure of the optimal policy. Moreover, we manage to partially characterize the optimal policy, and then develop an easy-to-implement heuristic policy. The performance of the heuristic policy and the influence of setup repositioning costs on policies are assessed numerically.     

Fleet-sizing and service availability for a vehicle rental system via closed queueing networks

In this paper, we address the problem of determining the optimal fleet size for a vehicle rental company and derive analytical results for its relationship to vehicle availability at each rental station in the company’s network of locations. This work is motivated by the recent surge in interest for bicycle and electric car sharing systems, one example being the French program Vélib (2010). We first formulate a closed queueing network model of the system, obtained by viewing the system from the vehicle’s perspective. Using this framework, we are able to derive the asymptotic behavior of vehicle availability at an arbitrary rental station with respect to fleet size. These results allow us to analyze imbalances in the system and propose some basic principles for the design of system balancing methods. We then develop a profit-maximizing optimization problem for determining optimal fleet size. The large-scale nature of real-world systems results in computational difficulties in obtaining this exact solution, and so we provide an approximate formulation that is easier to solve and which becomes exact as the fleet size becomes large. To illustrate our findings and validate our solution methods, we provide numerical results on some sample networks.     

An approximate dynamic programming approach for the vehicle routing problem with stochastic demands

This paper examines approximate dynamic programming algorithms for the single-vehicle routing problem with stochastic demands from a dynamic or reoptimization perspective. The methods extend the rollout algorithm by implementing different base sequences (i.e. a priori solutions), look-ahead policies, and pruning schemes. The paper also considers computing the cost-to-go with Monte Carlo simulation in addition to direct approaches. The best new method found is a two-step lookahead rollout started with a stochastic base sequence. The routing cost is about 4.8% less than the one-step rollout algorithm started with a deterministic sequence. Results also show that Monte Carlo cost-to-go estimation reduces computation time 65% in large instances with little or no loss in solution quality. Moreover, the paper compares results to the perfect information case from solving exact a posteriori solutions for sampled vehicle routing problems. The confidence interval for the overall mean difference is (3.56%, 4.11%).     

A probabilistic model applied to emergency service vehicle location

This paper is concerned with the formulation and the solution of a probabilistic model for determining the optimal location of facilities in congested emergency systems. The inherent uncertainty which characterizes the decision process is handled by a new stochastic programming paradigm which embeds the probabilistic constraints within the traditional two-stage framework. The resulting model drops simplifying assumptions on servers independence allowing at the same time to handle the spatial dependence of demand calls. An exact solution method and different tailored heuristics are presented to efficiently solve the problem. Computational experience is reported with application to various networks.     

Single vehicle routing problems with a predefined customer sequence, compartmentalized load and stochastic demands

We consider the problem of finding the optimal routing of a single vehicle that delivers K different products to N customers according to a particular customer order. The demands of the customers for each product are assumed to be random variables with known distributions. Each product type is stored in its dedicated compartment in the vehicle. Using a suitable dynamic programming algorithm we find the policy that satisfies the demands of the customers with the minimum total expected cost. We also prove that this policy has a specific threshold-type structure. Furthermore, we investigate a corresponding infinite-time horizon problem in which the service of the customers does not stop when the last customer has been serviced but it continues indefinitely with the same customer order. It is assumed that the demands of the customers at different tours have the same distributions. It is shown that the discounted-cost optimal policy and the average-cost optimal policy have the same threshold-type structure as the optimal policy in the original problem. The theoretical results are illustrated by numerical examples.     

Stochastic single vehicle routing with a predefined customer sequence and multiple depot returns

We study the routing of a single vehicle that delivers multiple products under stochastic demand. Specifically, we investigate two practical variations of this problem: (i) The case in which each product type is stored in its dedicated compartment in the vehicle, and (ii) the case in which all products are stored together in the vehicle’s single compartment. Suitable dynamic programming algorithms are proposed to determine the minimum expected (routing) cost for each case. Furthermore, the optimal routing policy is derived by developing appropriate theorems. The efficiency of the algorithms is studied by solving large problem sets.     

An arc-exchange decomposition method for multistage dynamic networks with random arc capacities

Multistage dynamic networks with random arc capacities (MDNRAC) have been successfully used for modeling various resource allocation problems in the transportation area. However, solving these problems is generally computationally intensive, and there is still a need to develop more efficient solution approaches. In this paper, we propose a new heuristic approach that solves the MDNRAC problem by decomposing the network at each stage into a series of subproblems with tree structures. Each subproblem can be solved efficiently. The main advantage is that this approach provides an efficient computational device to handle the large-scale problem instances with fairly good solution quality. We show that the objective value obtained from this decomposition approach is an upper bound for that of the MDNRAC problem. Numerical results demonstrate that our proposed approach works very well.     

Optimal stochastic scheduling of two interconnected queues with varying service rates

We consider two-stage tandem queueing systems attended by two specialized and one flexible server, where all servers have time varying rates. Assuming exponential processing times and linear holding costs, we derive properties of server allocation policies that minimize expected costs over an infinite time horizon.     

Optimal inventory policy with supply uncertainty and demand cancellation

We consider a periodic review model where the firm manages its inventory under supply uncertainty and demand cancellation. We show that because of supply uncertainty, the optimal inventory policy has the structure of re-order point type. That is, we order if the initial inventory falls below this re-order point, otherwise we do not order. This is in contrast to the work of Yuan and Cheung (2003) who prove the optimality of an order up to policy in the absence of supply uncertainty. We also investigate the impact of supply uncertainty and demand cancellation on the performance of the supply chain. Using our model, we are able to quantify the importance of reducing the variance of either the distribution of yield or the distribution of demand cancellation. The single, multiple periods and the infinite horizon models are studied.     

Stochastic single vehicle routing problem with delivery and pick up and a predefined customer sequence

In this paper we study the routing of a single vehicle that delivers products and picks up items with stochastic demand. The vehicle follows a predefined customer sequence and is allowed to return to the depot for loading/unloading as needed. A suitable dynamic programming algorithm is proposed to determine the minimum expected routing cost. Furthermore, the optimal routing policy to be followed by the vehicle’s driver is derived by proposing an appropriate theorem. The efficiency of the algorithm is studied by solving large problem sets.     

Column generation approaches to ship scheduling with flexible cargo sizes

We present a Dantzig–Wolfe procedure for the ship scheduling problem with flexible cargo sizes. This problem is similar to the well-known pickup and delivery problem with time windows, but the cargo sizes are defined by intervals instead of by fixed values. The flexible cargo sizes have consequences for the times used in the ports because both the loading and unloading times depend on the cargo sizes. We found it computationally hard to find exact solutions to the subproblems, so our method does not guarantee to find the optimum over all solutions. To be able to say something about how good our solution is, we generate a bound on the difference between the true optimal objective and the objective in our solution. We have compared our method with an a priori column generation approach, and our computational experiments on real world cases show that our Dantzig–Wolfe approach is faster than the a priori generation of columns, and we are able to deal with larger or more loosely constrained instances. By using the techniques introduced in this paper, a more extensive set of real world cases can be solved either to optimality or within a small deviation from optimality.     

An index heuristic for transshipment decisions in multi-location inventory systems based on a pairwise decomposition

In multi-location inventory systems, transshipments are often used to improve customer service and reduce cost. Determining optimal transshipment policies for such systems involves a complex optimisation problem that is only tractable for systems with few locations. Consequently simple heuristic transshipment policies are often applied in practice. This paper develops an approximate solution method which applies decomposition to reduce a Markov decision process model of a multi-location inventory system into a number of models involving only two locations. The value functions from the subproblems are used to estimate the fair charge for the inventory provided in a transshipment. This estimate of the fair charge is used as the decision criterion in a heuristic transshipment policy for the multi-location system. A numerical study shows that the proposed heuristic can deliver considerable cost savings compared to the simple heuristics often used in practice.     

Optimal ordering policies for periodic-review systems with a refined intra-cycle time scale

Chiang [C. Chiang, Optimal ordering policies for periodic-review systems with replenishment cycles, European Journal of Operational Research 170 (2006) 44–56] recently proposed a dynamic programming model for periodic-review systems in which a replenishment cycle consists of a number of small periods (each of identical but arbitrary length) and holding and shortage costs are charged based on the ending inventory of small periods. The current paper presents an alternative (and concise) dynamic programming model. Moreover, we allow the possibility of a positive fixed cost of ordering. The optimal policy is of the familiar (s, S) type because of the convexity of the one-cycle cost function. As in the periodic-review inventory literature, we extend this result to the lost-sales periodic problem with zero lead-time. Computation shows that the long-run average cost is rather insensitive to the choice of the period length. In addition, we show how the proposed model is modified to handle the backorder problem where shortage is charged on a per-unit basis irrespective of its duration. Finally, we also investigate the lost-sales problem with positive lead-time, and provide some computational results.     

Finding and identifying optimal inventory levels for systems with common components

In this article, we consider the problem of finding the optimal inventory level for components in an assembly system where multiple products share common components in the presence of random demand. Previously, solution procedures that identify the optimal inventory levels for components in a component commonality problem have been considered for two product or one common component systems. We will here extend this to a three products system considering any number of common components. The inventory problem considered is modeled as a two stage stochastic recourse problem where the first stage is to set the inventory levels to maximize expected profit while the second stage is to allocate components to products after observing demand. Our main contribution, and the main focus of this paper, is the outline of a procedure that finds the gradient for the stochastic problem, such that an optimal solution can be identified and a gradient based search method can be used to find the optimal solution.     

A branch-and-price algorithm for the capacitated vehicle routing problem with stochastic demands

This article introduces a new exact algorithm for the capacitated vehicle routing problem with stochastic demands (CVRPSD). The CVRPSD can be formulated as a set partitioning problem and it is shown that the associated column generation subproblem can be solved using a dynamic programming scheme. Computational experiments show promising results.     

A network flow model for the optimal allocation of both foldable and standard containers

This paper considers a multi-port and multi-period container planning problem of shipping companies that use both standard and foldable containers. A company must decide which number of empty containers of each type to purchase and reposition at each port within a defined period to minimize the total purchasing, repositioning, and storage costs.We develop a model to optimally allocate both foldable and standard containers. We show that a single commodity minimum cost network flow algorithm solves the problem by proving that a two commodity flow problem can be modeled as a single commodity flow problem.     

Parallel computing applied to the stochastic dynamic programming for long term operation planning of hydrothermal power systems

In this paper, parallel processing techniques are employed to improve the performance of the stochastic dynamic programming applied to the long term operation planning of electrical power system. The hydroelectric plants are grouped into energy equivalent reservoirs and the expected cost functions are modeled by a piecewise linear approximation, by means of the Convex Hull algorithm. In order to validate the proposed methodology, data from the Brazilian electrical power system is utilized.     

Optimal control for nonlinear systems calculated with small computers

Using Ritz's procedure of representing the control functions of an optimal control problem by a function series with parameters to be optimized, it is shown that, from the well-known gradient procedure for dynamic problems, a simple iteration formula for the optimization of these parameters can be derived. Using an example with a technical background, the effectiveness of the program realization of this approach is demonstrated and is compared with the results of unrestricted dynamic optimization.This work was performed at the Technische Hochschule in Darmstadt, West Germany, with financial support from the DFG (Deutsche Forschungs-Gemeinschaft).     

Optimal location of dwell points in a single loop AGV system with time restrictions on vehicle availability

Since the workload of a manufacturing system changes over time, the material handling equipment used in the facility will be idle at certain time intervals to avoid system overload. In this context, a relevant control problem in operating an automated guided vehicle (AGV) system is where to locate idle vehicles. These locations, called dwell points, establish the response times for AVG requests. In this article, a dynamic programming algorithm to solve idle vehicle positioning problems in unidirectional single loop systems is developed to minimize the maximum response time considering restrictions on vehicle time available to travel and load/unload requests. This polynomial time algorithm finds optimal dwell points when all requests from a given pick-up station are handled by a single AGV. The proposed algorithm is used to study the change in maximum response time as a function of the number of vehicles in the system.