Zero-sum stochastic games with unbounded costs: Discounted and average cost cases

Zero-sum stochastic games with countable state space and with finitely many moves available to each player in a given state are treated. As a function of the current state and the moves chosen, player I incurs a nonnegative cost and player II receives this as a reward. For both the discounted and average cost cases, assumptions are given for the game to have a finite value and for the existence of an optimal randomized stationary strategy pair. In the average cost case, the assumptions generalize those given in Sennott (1993) for the case of a Markov decision chain. Theorems of Hoffman and Karp (1966) and Nowak (1992) are obtained as corollaries. Sufficient conditions are given for the assumptions to hold. A flow control example illustrates the results.     

Near optimality of stochastic control in systems with unknown parameter processes

Stochastic control for systems with an unknown parameter is considered in this paper. The underlying problem is to minimize a functional subject to a system described by a singularly perturbed differential equation with an unknown parameter process driven by fast fluctuating random disturbances. This problem arises in the context of stochastic adaptive control, adaptive signal processing, and failure-prone manufacturing systems. Due to the nature of the wide-bandwidth noise processes, identifying the parameter process for eacht is very hard since the driving noise changes very rapidly. An alternative approach is used, and an auxiliary control problem is introduced to overcome the difficulties. By means of weak convergence methods and comparison control techniques, nearly optimal controls are obtained.This research was supported in part by the National Science Foundation under Grant DMS-9022139 and DMS-9224372.     

Optimal control of infinite-dimensional uncertain systems

In this paper, we consider a minimax problem of optimal control for a class of strongly nonlinear uncertain evolution equations on a Banach space. We prove the existence of optimal controls. A nontrivial example of a class of systems governed by a nonlinear partial differential equation with uncertain spatial parameters is presented for illustration.This work was supported in part by the National Science and Engineering Research Council of Canada under Grant No. A7109 and The Engineering Faculty Development Fund, University of Ottawa.The authors would like to thank the anonymous reviewers for their valuable comments and suggestions.     

Control and scheduling in a two-station queueing network: Optimal policies and heuristics

Consider a two-station queueing network with two types of jobs: type 1 jobs visit station 1 only, while type 2 jobs visit both stations in sequence. Each station has a single server. Arrival and service processes are modeled as counting processes with controllable stochastic intensities. The problem is to control the arrival and service processes, and in particular to schedule the server in station 1 among the two job types, in order to minimize a discounted cost function over an infinite time horizon. Using a stochastic intensity control approach, we establish the optimality of a specific stationary policy, and show that its value function satisfies certain properties, which lead to a switching-curve structure. We further classify the problem into six parametric cases. Based on the structural properties of the stationary policy, we establish the optimality of some simple priority rules for three of the six cases, and develop heuristic policies for the other three cases.     

非线性系统的高阶迭代学习控制算法

本文对一般非线性系统,提出了三种高阶迭代学习控制算法:(Ⅰ)u_(h 1)=sum from j=1 to r(P_ju_(k-j 1) Г_je_(h-j 1));(Ⅱ)u_(k 1)=sum from j=1 to r(P_ju_(k-j 1) F_je_(k-j 1));(Ⅲ)u_(k 1)=sum from j=1 to r{P_ju_(k-j 1) (Г_j F_jd/(dt))e_(k-j 1)},其中u_(k 1)=u_(k 1)(t)表示系统第k 1次运行时的输入;e_k=y_k-y_d;y_d是系统所期望的输出;y_k是系统第k次运行时的输出;P_j,Г_j,F_j(j=1,…,r)是常数阵;进而给出了比较弱的收敛性条件。     

由偏微支配的系统的最优控制理论中的奇异摄动方法*

本文介绍了由偏微分方程支配的系统的最优控制理论中有关应用奇异摄动方法时出现的各种问题。考虑了渐近分析来自状态方程。或来自性能指标函数,也考虑了状态方程是定义在摄动域内的情形。     

基于Web的图书馆管理系统访问控制策略

针对基于Web的图书馆管理系统资源访问控制的动态性问题，提出了一种基于角色的访问控制策略描述方案．通过对基于Web的图书馆管理系统访问控制管理影响因素和访问控制需求的分析，结合NIST基于角色的访问控制统一模型标准，构造了一种基于角色的访问控制元模型．并在这一元模型的基础上，提出了一种紧凑的基于角色的访问控制XML策略描述语言框架．结果表明该访问控制策略描述语言框架适合表述动态环境下对图书馆资源的访问策略，提高了基于Web的图书馆管理系统资源访问的安全性．     

定速风力发电机模型参考自适应控制

在对定速风力发电机建模的基础上,设计了模型参考自适应控制器,并进行了跟随性能和抗干扰性能仿真,仿真结果表明自适应控制器的自适应能力很好.     

中国聚变工程实验堆水冷包层钢构件流道成形控制研究

针对CFETR水冷包层流道钢构件热等静压制备时易变形压塌问题,利用单轴扩散焊设备开展了焊接工艺参数优化试验。在此基础上,重新设计了流道焊接界面位置和尺寸,用两步热等静压扩散焊法制备出了流道变形可控的平板型第一壁钢构件模块。优化试验表明,低活化钢试样的固相扩散焊温度需高于950℃,焊后经过760℃/60min回火热处理试样力学性能可以得到有效回复。     

基于虚拟中心电流法的HL-2M快控电源数学模型

针对中国环流器2号M(HL-2M)装置中用于核聚变物理实验等离子体的垂直不稳定性控制的快控电源拓扑结构,充分考虑线圈的自感与互感对输出的影响,构建出数学模型,首次提出并运用虚拟中心电流法,使得控制算法更加简单,采用多输入多输出的控制方法,利用2个参量控制3个变量。本文基于基本供电方案得到多线圈耦合电压,基于快控电源拓扑推导出快控电源电路方程,再将其合并得到最终的线圈电压数学模型,最后进行仿真验证。结果表明数学模型搭建正确,为今后进行进一步计算提供了坚实的基础。