Limit of the solutions for the finite horizon problems as the optimal solution to the infinite horizon optimization problems

In this paper, we consider how to construct the optimal solutions for the undiscounted discrete time infinite horizon optimization problems. We present the conditions under which the limit of the solutions for the finite horizon problems is optimal among all attainable paths for the infinite horizon problem under two modified overtaking criteria, as well as the conditions under which it is the unique optimum under the sum-of-utilities criterion. The results are applied to a parametric example of a simple one-sector growth model to examine the impacts of discounting on the optimal path.     

Joint production and preventive maintenance scheduling for a single degraded machine by considering machine failures

Production scheduling and maintenance planning are two interdependent issues that most often have been investigated independently. Although both preventive maintenance (PM) and minimal repair affect availability and failure rate of a machine, only a few researchers have considered this interdependency in the literature. Furthermore, most of the existing joint production and preventive maintenance scheduling methods assume that machine is available during the planning horizon and consider only a possible level for PM. In this research, an integrated model is proposed that coordinates preventive maintenance planning with single-machine scheduling to minimize the weighted completion time of jobs and maintenance cost, simultaneously. This paper not only considers multiple PM levels with different costs, times and reductions in the hazard rate of the machine, but also assumes that a machine failure may occur at any time. To illustrate the effectiveness of the suggested method, it is compared to two situations of no PM and a single PM level. Eventually, to tackle the suggested problem, multi-objective particle swarm optimization and non-dominated sorting genetic algorithm (NSGA-II) are employed and their parameters are tuned Furthermore, their performances are compared in terms of three metrics criteria.     

Predictive control of nonlinear dynamic processes

Predictive control can be applied if the reference value of the process is known in advance and the deterministic disturbances can be predicted. A cost function defined in the future horizon is minimized. The control signal is calculated for a control horizon, but only the first one is applied and the procedure is repeated (receding horizon strategy). Processes with mild analytical nonlinear characteristics are considered. The possible process models are either nonparametric (linear, Hammerstein, and Volterra weighting function series) or parametric ones (generalized Hammerstein, parametric Volterra, and bilinear models). The algorithms of the optimal and suboptimal predictive control based on the nonparametric and the parametric models mentioned are derived. Several simulations present how effective these methods are. The adaptive case is dealt with as well.     

A stochastic programming approach for planning horizons of infinite horizon capacity planning problems

Planning horizon is a key issue in production planning. Different from previous approaches based on Markov Decision Processes, we study the planning horizon of capacity planning problems within the framework of stochastic programming. We first consider an infinite horizon stochastic capacity planning model involving a single resource, linear cost structure, and discrete distributions for general stochastic cost and demand data (non-Markovian and non-stationary). We give sufficient conditions for the existence of an optimal solution. Furthermore, we study the monotonicity property of the finite horizon approximation of the original problem. We show that, the optimal objective value and solution of the finite horizon approximation problem will converge to the optimal objective value and solution of the infinite horizon problem, when the time horizon goes to infinity. These convergence results, together with the integrality of decision variables, imply the existence of a planning horizon. We also develop a useful formula to calculate an upper bound on the planning horizon. Then by decomposition, we show the existence of a planning horizon for a class of very general stochastic capacity planning problems, which have complicated decision structure.     

An integrated production and preventive maintenance planning model

We are given a set of items that must be produced in lots on a capacitated production system throughout a specified finite planning horizon. We assume that the production system is subject to random failures, and that any maintenance action carried out on the system, in a period, reduces the system’s available production capacity during that period. The objective is to find an integrated lot-sizing and preventive maintenance strategy of the system that satisfies the demand for all items over the entire horizon without backlogging, and which minimizes the expected sum of production and maintenance costs. We show how this problem can be formulated and solved as a multi-item capacitated lot-sizing problem on a system that is periodically renewed and minimally repaired at failure. We also provide an illustrative example that shows the steps to obtain an optimal integrated production and maintenance strategy.     

Competitive production scheduling: A two-firm,noncooperative finite dynamic game

In this paper, we study the production scheduling problem in a competitive environment. Two firms produce the same product and compete in a market. The demand is random and so is the production capacity of each firm, due to random breakdowns. We consider a finite planning horizon. The scheduling problem is formulated as a finite dynamic game. Algorithms are developed to determine the security, hazard, and Nash policies. Numerical examples are discussed. A single-firm optimization model is also analyzed and it is observed that the production control policy from the single-firm optimization model may not perform well in a competitive environment.     

Portfolio Optimization in a Semi-Markov Modulated Market

We address a portfolio optimization problem in a semi-Markov modulated market. We study both the terminal expected utility optimization on finite time horizon and the risk-sensitive portfolio optimization on finite and infinite time horizon. We obtain optimal portfolios in relevant cases. A numerical procedure is also developed to compute the optimal expected terminal utility for finite horizon problem. This work was supported in part by a DST project: SR/S4/MS: 379/06; also supported in part by a grant from UGC via DSA-SAP Phase IV, and in part by a CSIR Fellowship.     

A convex analytic approach to Markov decision processes

Summary This paper develops a new framework for the study of Markov decision processes in which the control problem is viewed as an optimization problem on the set of canonically induced measures on the trajectory space of the joint state and control process. This set is shown to be compact convex. One then associates with each of the usual cost criteria (infinite horizon discounted cost, finite horizon, control up to an exit time) a naturally defined occupation measure such that the cost is an integral of some function with respect to this measure. These measures are shown to form a compact convex set whose extreme points are characterized. Classical results about existence of optimal strategies are recovered from this and several applications to multicriteria and constrained optimization problems are briefly indicated.Research supported by NSF Grant CDR-85-00108     

Risk-sensitive stopping problems for continuous-time Markov chains

In this paper we consider stopping problems for continuous-time Markov chains under a general risk-sensitive optimization criterion for problems with finite and infinite time horizon. More precisely our aim is to maximize the certainty equivalent of the stopping reward minus cost over the time horizon. We derive optimality equations for the value functions and prove the existence of optimal stopping times. The exponential utility is treated as a special case. In contrast to risk-neutral stopping problems it may be optimal to stop between jumps of the Markov chain. We briefly discuss the influence of the risk sensitivity on the optimal stopping time and consider a special house selling problem as an example.     

Optimal corrective maintenance contract planning for aging multi‐state system

This paper considers an aging multi‐state system, where the system failure rate varies with time. After any failure, maintenance is performed by an external repair team. Repair rate and cost of each repair are determined by a corresponding corrective maintenance contract with a repair team. The service market can provide different kinds of maintenance contracts to the system owner, which also can be changed after each specified time period. The owner of the system would like to determine a series of repair contracts during the system life cycle in order to minimize the total expected cost while satisfying the system availability. Operating cost, repair cost and penalty cost for system failures should be taken into account. The paper proposes a method for determining such optimal series of maintenance contracts. The method is based on the piecewise constant approximation for an increasing failure rate function in order to assess lower and upper bounds of the total expected cost and system availability by using Markov models. The genetic algorithm is used as the optimization technique. Numerical example is presented to illustrate the approach. Copyright © 2009 John Wiley & Sons, Ltd.     

Optimal preventive maintenance for equipment with two quality states and general failure time distributions

We present an economic model for the optimization of preventive maintenance in a production process with two quality states. The equipment starts its operation in the in-control state but it may shift to the out-of-control state before failure or scheduled preventive maintenance. The time of shift and the time of failure are generally distributed random variables. The two states are characterized by different failure rates and revenues. We first derive the structure of the optimal maintenance policy, which is defined by two critical values of the equipment age that determine when to perform preventive maintenance depending on the actual (observable) state of the process. We then provide properties of the optimal solution and show how to determine the optimal values of the two critical maintenance times accurately and efficiently. The proposed model and, in particular, the behavior of the optimal solution as the model parameters and the shift and failure time distributions change are illustrated through numerical examples.     

时变需求等量进货情形下集成供应链生产订货策略研究

构建了一个包含原料采购、生产和销售过程的集成供应链模型,研究了由原料、生产商和销售商产品构成的三层库存系统的生产订货问题。在有限的规划期内,销售商每次进货量相同,生产商按照EOQ模型采购原材料。以最小化供应链系统的总运营成本为目标,构建一个混合整数非线性规划模型,寻找销售商最优订货方案和生产商最佳生产策略。首先利用网络优化方法求解生产商的最优生产计划,其次利用定界穷举法寻求销售商最优的订货周期,给出了具体的计算方法和Matlab程序。通过算例分析验证了算法的有效性,并研究了各参数对最小费用及最优解的影响。     

Availability and maintenance modeling for systems subject to dependent hard and soft failures

This paper develops availability and maintenance models for single‐unit systems subject to dependent hard and soft failures. A hard failure stops the system immediately, whereas a soft failure only reduces the performance capacity of the system. Dependence between these 2 types of failures is reflected in the fact that each soft failure directly increases the hazard rate of the hard failure. On the basis of such interaction, we derive recursive equations for the system reliability and availability functions. To detect both types of failures, inspections are executed periodically. Furthermore, we investigate the optimal inspection policy via the minimization of the expected cost per unit time. The applicability of the developed availability and maintenance models is validated by a case study on an electrical distribution system.     

A stochastic model for joint spare parts inventory and planned maintenance optimisation

Spare parts demands are usually generated by the need of maintenance either preventively or at failures. These demands are difficult to predict based on historical data of past spare parts usages, and therefore, the optimal inventory control policy may be also difficult to obtain. However, it is well known that maintenance costs are related to the availability of spare parts and the penalty cost of unavailable spare parts consists of usually the cost of, for example, extended downtime for waiting the spare parts and the emergency expedition cost for acquiring the spare parts. On the other hand, proper planned maintenance intervention can reduce the number of failures and associated costs but its performance also depends on the availability of spare parts. This paper presents the joint optimisation for both the inventory control of the spare parts and the Preventive Maintenance (PM) inspection interval. The decision variables are the order interval, PM interval and order quantity. Because of the random nature of plant failures, stochastic cost models for spare parts inventory and maintenance are derived and an enumeration algorithm with stochastic dynamic programming is employed for finding the joint optimal solutions over a finite time horizon. The delay-time concept developed for inspection modelling is used to construct the probabilities of the number of failures and the number of the defective items identified at a PM epoch, which has not been used in this type of problems before. The inventory model follows a periodic review policy but with the demand governed by the need for spare parts due to maintenance. We demonstrate the developed model using a numerical example.     

A preventive maintenance policy for a continuously monitored system with correlated wear indicators

A continuously monitored system is considered, that gradually and stochastically deteriorates according to a bivariate non-decreasing Lévy process. The system is considered as failed as soon as its bivariate deterioration level enters a failure zone, assumed to be an upper set. A preventive maintenance policy is proposed, which involves a delayed replacement, triggered by the reaching of some preventive zone for the system deterioration level. The preventive maintenance policy is assessed through a cost function on an infinite horizon time. The cost function is provided in full form, and tools are provided for its numerical computation. The influence of different parameters on the cost function is studied, both from a theoretical and/or numerical point of view.     

Uniqueness of unbounded viscosity solutions for impulse control problem

We study here the impulse control problem in infinite as well as finite horizon. We allow the cost functionals and dynamics to be unbounded and hence the value function can possibly be unbounded. We prove that the value function is the unique viscosity solution in a suitable subclass of continuous functions, of the associated quasivariational inequality. Our uniqueness proof for the infinite horizon problem uses stopping time problem and for the finite horizon problem, comparison method. However, we assume proper growth conditions on the cost functionals and the dynamics.     

A production-repairing inventory model with fuzzy rough coefficients under inflation and time value of money

In this paper, a production-repairing inventory model in fuzzy rough environment is proposed incorporating inflationary effects where a part of the produced defective units are repaired and sold as fresh units. Here, production and repairing rates are assumed as dynamic control variables. Due to complexity of environment, different costs and coefficients are considered as fuzzy rough type and these are reduced to crisp ones using fuzzy rough expectation. Here production cost is production rate dependent, repairing cost is repairing rate dependent and demand of the item is stock-dependent. Goal of the research work is to find decisions for the decision maker (DM) who likes to maximize the total profit from the above system for a finite time horizon. The model is formulated as an optimal control problem and solved using a gradient based non-linear optimization method. Some particular cases of the general model are derived. The results of the models are illustrated with some numerical examples.     

Formulations for a problem of petroleum transportation

Oil tankers play a fundamental role in every offshore petroleum supply chain and due to its high price, it is essential to optimize its use. Since this optimization requires handling detailed operational aspects, complete optimization models are typically intractable. Thus, a usual approach is to solve a tactical level model prior to optimize the operational details. In this case, it is desirable that tactical models are as precise as possible to avoid too severe adjustments in the next optimization level. In this paper, we study tactical models for a crude oil transportation problem by tankers. We did our work on the top of a previous paper found in the literature. The previous model considers inventory capacities and discrete lot sizes to be transported, aiming to meet given demands over a finite time horizon. We compare several formulations for this model using 50 instances from the literature and proposing 25 new harder ones. A column generation-based heuristic is also proposed to find good feasible solutions with less computational burden than the heuristics of the commercial solver used.     

The average optimality of a repair-limit replacement policy

We consider a minimal-repair and replacement problem of a reliability system whose state at a failure is described by a pair of two attributes, i.e., the total number of its past failures and the current failure level. It is assumed that the system is bothered by more frequent and more costly failures as time passes. Our problem is to find and/or characterize a minimal-repair and replacement policy of minimizing the long-run average expected maintenance cost per unit time over the infinite time horizon. Formulating the problem as a semi-Markov decision process, we show that a repairlimit replacement policy is average optimal. That is, for each total number of past system failures, there exists a threshold, called a repair limit, such that it is optimal to repair minimally if the current failure level is lower than the repair limit, and to replace otherwise. Furthermore, the repair limit is decreasing in the total number of past system failures.     

Sensitivity of constrained Markov decision processes

We consider the optimization of finite-state, finite-action Markov decision processes under constraints. Costs and constraints are of the discounted or average type, and possibly finite-horizon. We investigate the sensitivity of the optimal cost and optimal policy to changes in various parameters. We relate several optimization problems to a generic linear program, through which we investigate sensitivity issues. We establish conditions for the continuity of the optimal value in the discount factor. In particular, the optimal value and optimal policy for the expected average cost are obtained as limits of the dicounted case, as the discount factor goes to one. This generalizes a well-known result for the unconstrained case. We also establish the continuity in the discount factor for certain non-stationary policies. We then discuss the sensitivity of optimal policies and optimal values to small changes in the transition matrix and in the instantaneous cost functions. The importance of the last two results is related to the performance of adaptive policies for constrained MDP under various cost criteria [3,5]. Finally, we establish the convergence of the optimal value for the discounted constrained finite horizon problem to the optimal value of the corresponding infinite horizon problem.