One-armed bandit models with continuous and delayed responses

One-armed bandit processes with continuous delayed responses are formulated as controlled stochastic processes following the Bayesian approach. It is shown that under some regularity conditions, a Gittins-like index exists which is the limit of a monotonic sequence of break-even values characterizing optimal initial selections of arms for finite horizon bandit processes. Furthermore, there is an optimal stopping solution when all observations on the unknown arm are complete. Results are illustrated with a bandit model having exponentially distributed responses, in which case the controlled stochastic process becomes a Markov decision process, the Gittins-like index is the Gittins index and the Gittins index strategy is optimal. Acknowledgement.We thank an anonymous referee for constructive and insightful comments, especially those related to the notion of the Gittins index.Both authors are funded by the Natural Sciences and Engineering Research Council (NSERC) of Canada.     

从极优基未必能迅达最优基：兼与文献[1]作者商榷

本对献[1]提出的“求解线性规划的快速换基迭代法”从多阶段决策的观点阐述并举证了从极优基未必能快速到达最优基的论断。旨在说明用此方法求解一般线性规划问题时不一定能实现快速换基迭代的概念。     

Weighted Influence Non-linear Gauge System (WINGS) – An analysis method for the systems of interrelated components

The WINGS method has been derived from DEMATEL and can be widely used as a structural model for analysis of intertwined factors and causal relations between them. Its novelty comes from an idea of including in one mathematical mechanism both strength (importance) and influence of the system components. In particular, WINGS can be applied as the MCDA method for evaluating alternatives when interrelations between criteria cannot be neglected. For the problem with independent criteria, WINGS reproduces the additive aggregation of preferences, a classical method in MCDA.     

Remarks on maximal meanstandard devition ratio in undiscounted mdps

In the steady state of an undiscounted Markov decision process, we consider the problem to find an optimal stationary probability distribution that maximizes the mean standard deviation ratio among all the stationary probability distributions. The problem injects considerations in MDPs from the relative point of view     

航空公司航线决策的一种系统方法

本通过对航空公司基于现有运力选择航线这一决策问题的诸多影响因素的综合分析，根据经验和灵敏度分析的结果，提炼出适于决策的关键因素作为这个多目标决策问题的目标属性，给出了确定各属性值和其权的相应技术和方法，并运用适宜本问题的决策分析方法，完成决策过程，这是作提出的一种较为系统的航线决策概念和方法，也是一种可程序化的方法，借助于计算机并建立相应的数据库，能快速，方便地完成这一决策分析，对如何选择最佳的航线网络，也可类此采用本方法。     

Admission control of a service station when the arrivals are internal

All studies in the admission control of a service station make decisions at arrival epochs. When arrivals are internal and are rejected from a queue, the rejected jobs have to be routed to other stations in the system. However the system will not know whether a job will be admitted to a queue or not until its arrival epoch to that queue. Thus, the system has to react dynamically and agilely to the decisions made at a specific queue and may try several queues before finding a queue that admits the job. This paper remedies these difficulties by changing the decision epochs of the admission control from arrival epochs to departure epochs with the actions of switching (keeping) the arrival stream on or off. Thus upstream stations will have information on the admission status of their downstream stations all the time. It is proved that the optimal policy for this revised admission control system is of control limit type for an M/G/1 queue. Comparisons of the optimal values and optimal policies for the admission controls made at arrival epochs and at departure epochs are included in the paper.     

基于DEA的vague值的确定性转化及其应用

含糊性和不可分辨性是决策中不确定性的两个方面.Vague集由真、假隶属度两方面来定义,具有强大的表达不精确数据的能力.在介绍Vague集的有关概念的基础上,基于DEA方法,将vague值转化为确定性数据,能够对vague值之间进行比较,且为同时包含vague值和其他定量指标的多目标决策提供思路.     

基于集对分析的混合型多属性决策方法的研究

针对属性权重信息不完全且属性值为实数、区间数和模糊语言值相结合的混合型多属性决策问题,提出了一种基于集对分析的多属性决策方法.该方法所需计算量较少,方法简单,易于计算.最后通过实例验证了该方法的有效性和实用性.