On the optimal control of a two-queue polling model

This paper deals with two M/M/1 queues served by a single server with threshold switching. Our main goal is to solve the Poisson equation and, as a result, give expressions for the long-run expected average cost of holding units and switching actions of the server, and the bias vector.     

Asymptotically optimal production policies in dynamic stochastic jobshops with limited buffers

We consider a production planning problem for a jobshop with unreliable machines producing a number of products. There are upper and lower bounds on intermediate parts and an upper bound on finished parts. The machine capacities are modelled as finite state Markov chains. The objective is to choose the rate of production so as to minimize the total discounted cost of inventory and production. Finding an optimal control policy for this problem is difficult. Instead, we derive an asymptotic approximation by letting the rates of change of the machine states approach infinity. The asymptotic analysis leads to a limiting problem in which the stochastic machine capacities are replaced by their equilibrium mean capacities. The value function for the original problem is shown to converge to the value function of the limiting problem. The convergence rate of the value function together with the error estimate for the constructed asymptotic optimal production policies are established.     

Asymptotic normality of discounted random series with applications in reliability and queueing

It is proved that a certain kind of randomly discounted random sums is asymptotically normal as the discount constant tends to zero. For replaceable systems with random lifetime, these sums represent the total discounted cost of policies of the age-replacement type; other applications to queueing and related areas are also indicated.     

基于实物期权的油气开采许可证策略分析

石油与天然气作为我国最重要的矿产资源,其矿权管理采用许可证制度.基于我国的石油与天然气许可证体系结构,分析了石油天然气勘查与开采许可证的实物期权特性,采用实物期权思想对油气勘探开发项目进行战略经济评价,针对传统方法在颁发开采许可证时忽略了时间灵活性价值这一问题,提出了估算颁发开采许可证价值和对投资开发时机进行选择的办法.为资源管理部门和石油公司的决策提供科学依据.最后,应用实物期权法对一个算例进行了分析.     

映谱仪常见故障的维修方法

映谱仪在使用一段时间后，往往会出现光路成像不清，机械可调部分失灵等故障，文中主要介绍了这些故障的排除方法。     

A ratio‐dependent predator–prey model with stage structure and optimal harvesting policy

In this paper, a ratio‐dependent predator–prey model with stage structure and harvesting is investigated. Mathematical analyses of the model equations with regard to boundedness of solutions, nature of equilibria, permanence and stability are performed. By constructing appropriate Lyapunov functions, a set of easily verifiable sufficient conditions are obtained for the global asymptotic stability of nonnegative equilibria of the model. The existence possibilities of bioeconomic equilibria have been examined. An optimal harvesting policy is also given by using Pontryagin's maximal principle. Copyright © 2007 John Wiley & Sons, Ltd.     

An economic model for investing in sulfur oxide control technology development

The model estimates, subject to restrictions, the functional relationship between national sulfur dioxide discharges and investment in control technology development. Estimates may be made for different product demands, allowed cost increases, and clean fuel availabilities. Control technology development may be accelerated by increased investment. Both optimal and sub-optimal solutions are calculated for an example problem. A general computing method is provided.The model was presented at the Industrial Process Design for Pollution Control Workshop, Chicago, Illinois, Oct. 1973; copyright released by the American Institute of Chemical Engineers for publication for the first time in the monographNormative Analysis in Policy Decisions: Public and Private.     

On the convergence of policy iteration for controlled diffusions

The convergence of an approximation scheme known as policy iteration has been demonstrated for controlled diffusions by Fleming, Puterman, and Bismut. In this paper, we show that this approximation scheme is equivalent to the Newton-Kantorovich iteration for solving the optimality equation and exploit this equivalence to obtain a new proof of convergence. Estimates of the rate of convergence of this procedure are also obtained.This research was partially supported by NRC Grant No. A-3609.     

On the control of queueing systems with failures and repairs

Several classes of problems can be modelled as queueing systems with failures where preventative maintenance has to be optimized: relevant examples are computer systems, databases and production lines. This paper studies a simple case of such a situation based on the M/M/1 queue where the state of the server can take two values (on, off); the transition on–off happens either when there is a failure or when one decides to maintain. The characterization and an approximation of an optimal policy are given. Extensions to more general models, including general Markov processes, are examined.