Nonparametric estimation and adaptive control in a class of finite Markov decision chains

We consider a class of Markov decision processes withfinite state and action spaces which, essentially, is determined by the following condition: The state space isirreducible under the action of any stationary policy. However, except by this restriction, the transition law iscompletely unknown to the controller. In this context, we find a set of policies under which thefrequency estimators of the transition law are strongly consistent and then, this result is applied to constructadaptive asymptotically discount-optimal policies.Dedicated to Professor Truman O. Lewis, on the occasion of his sixtieth birthdayThis research was supported in part by the Third World Academy of Sciences (TWAS) under Grant TWAS RG MP 898-152, and in part by the Consejo Nacional de Ciencia y Tecnología (CONACYT) under Grant A128CCOEO550 (MT-2).     

Amine‐blocked polyisocyanates. I. Synthesis of novel N‐methylaniline‐blocked polyisocyanates and deblocking studies using hot‐stage fourier transform infrared spectroscopy

A series of substituted N‐methylaniline‐blocked polyisocyanates based on 4,4′‐methylenebis(phenyl isocyanate) and poly(tetrahydrofuran) were prepared and characterized thoroughly with FTIR, ¹H NMR, and ¹³C NMR spectroscopy methods. Compared with unsubstituted N‐methylaniline, a blocking agent with an electron‐releasing substituent at the para position took a shorter time, whereas those with an electron‐releasing substituent at the ortho position or an electron‐withdrawing substituent at the ortho and para positions took longer times for the blocking reaction. The thermal dissociation reactions of blocked polyisocyanates were carried out with an FTIR spectrophotometer attached to hot‐stage accessories under dynamic and isothermal conditions. The dynamic method was used to determine the deblocking temperature, and the isothermal method was used to calculate the deblocking kinetics and activation parameters. The cure times of blocked polyisocyanates with hydroxyl‐terminated polybutadiene were also determined. The deblocking temperatures, the results of cure‐time studies, and the kinetic parameters revealed that the thermal dissociation of the N‐methylaniline‐blocked polyisocyanates was retarded by electron‐donating substituents and facilitated by electron‐withdrawing substituents. The action of N‐methylanilines as blocking agents for isocyanate was explained by the formation of a four‐center, intramolecularly hydrogen‐bonded ring structure during the thermal dissociation of the blocked polyisocyanates. The formation of such a hydrogen‐bonded ring structure was confirmed and supported by variable‐temperature ¹H NMR studies and entropy parameters, respectively. © 2006 Wiley Periodicals, Inc. J Polym Sci Part A: Polym Chem 45: 1557–1570, 2007     

How to assess and report the performance of a stochastic algorithm on a benchmark problem: mean or best result on a number of runs?

Some authors claim that reporting the best result obtained by a stochastic algorithm in a number of runs is more meaningful than reporting some central statistic. In this short note, we analyze and refute the main argument brought in favor of this statement.     

On an approach to the study of the Jaynes–Cummings sum in quantum optics

A new approach to the study of the Jaynes–Cummings sum, which determines the atomic inversion in quantum model of a single two-level atom interacting with a single mode of the quantized radiation field, based on the number theory theorems on approximation of trigonometric sums is presented.      

Surfaces of revolution in the Heisenberg group and the spectral generalization of the Willmore functional

We study the generalization of the Willmore functional for surfaces in the three-dimensional Heisenberg group. Its construction is based on the spectral theory of the Dirac operator entering into theWeierstrass representation of surfaces in this group. Using the surfaces of revolution we demonstrate that the generalization resembles the Willmore functional for the surfaces in the Euclidean space in many geometrical aspects. We also observe the relation of these functionals to the isoperimetric problem.     

Isosteres of peptides: boron analogs as dipolar forms of α‐amino acids – a theoretical study

Modification of peptides to produce peptidomimetics is of great interest, with the aim of designing potent, selective, and metabolically stable analogs having certain conformational properties. Organoboranes have been reported in the literature with a wide range of therapeutic applications. One of the therapeutically important class of molecules is amine‐carboxyboranes derived from amino acids by replacement of the Cα atom of an amino acid/peptide by boron. The conformational preferences of these peptides, with respect to backbone ω, ?, and ψ torsion angles, have been investigated by theoretical calculations. The amide bond in these molecules has the same geometry in the ground and transition states as the natural peptides. However, the boron isosteres of glycine and alanine peptides are less structured than their natural derivatives, but are distinguished by structures with a positive value for the ? angle, which is normally disfavored for natural peptides. This property could be used to build peptides with a geometry not usually seen in natural peptides. Copyright © 2007 John Wiley & Sons, Ltd.     

Speed of adaptation in structured populations

Adaptation of populations takes place with the occurrence and subsequent fixation of mutations that confer some selective advantage to the individuals which acquire it. For this reason, the study of the process of fixation of advantageous mutations has a long history in the population genetics literature. Particularly, the previous investigations aimed to find out the main evolutionary forces affecting the strength of natural selection in the populations. In the current work, we investigate the dynamics of fixation of beneficial mutations in a subdivided population. The subpopulations (demes) can exchange migrants among their neighbors, in a migration network which is assumed to have either a random graph or a scale-free topology. We have observed that the migration rate drastically affects the dynamics of mutation fixation, despite of the fact that the probability of fixation is invariant on the migration rate, accordingly to Maruyama's conjecture. In addition, we have noticed a topological dependence of the adaptive evolution of the population when clonal interference becomes effective.     

C++QED: an object-oriented framework for wave-function simulations of cavity QED systems

We present a framework for efficiently performing Monte Carlo wave-function simulations in cavity QED with moving particles. It relies heavily on the object-oriented programming paradigm as realised in C++, and is extensible and applicable for simulating open interacting qua ntum dynamics in general. The user is provided with a number of “elements”, e.g. pumped moving particles, pumped lossy cavity modes, and various interactions to compose complex interacting systems, which contain several particles moving in electromagnetic fields of various configurations, and perform wave-function simulations on such systems. A number of tools are provided to facilitate the implementation of new elements.     

Series solution to the laser-ion interaction in a Raman-type configuration

The Raman interaction of a ultracold ion trapped with two travelling wave lasers is studied analytically with series solutions, in the absence of the rotating wave approximation (RWA) and without restrictions of both the Lamb-Dicke limit and the weak excitation regime. The comparison is made between our solutions and those obtained under the RWA in order to demonstrate the validity region of the RWA. As a practical example, the preparation of Schr?dinger-cat states is proposed beyond the weak excitation regime, using our calculations. Received 12 March 2001 and Received in final form 16 October 2001     

炉液倾动重心近似计算的数学分析

为给转炉设计提供依据,需要计算炉液倾动的重心.利用数学方法将实际问题进行简化,通过分析炉液倾动过程中变量间的相互关系,来确定每个倾动角度对应情况下的液面位置.利用数学中三重积分的有关应用,进一步得出转炉在每个倾动角度为α∈(0,π2)时的重心计算方法及相关结论,在理论上为工程计算重心的方法提供参考.