Asymptotic properties of constrained Markov Decision Processes

We present in this paper several asymptotic properties of constrained Markov Decision Processes (MDPs) with a countable state space. We treat both the discounted and the expected average cost, with unbounded cost. We are interested in (1) the convergence of finite horizon MDPs to the infinite horizon MDP, (2) convergence of MDPs with a truncated state space to the problem with infinite state space, (3) convergence of MDPs as the discount factor goes to a limit. In all these cases we establish the convergence of optimal values and policies. Moreover, based on the optimal policy for the limiting problem, we construct policies which are almost optimal for the other (approximating) problems. Based on the convergence of MDPs with a truncated state space to the problem with infinite state space, we show that an optimal stationary policy exists such that the number of randomisations it uses is less or equal to the number of constraints plus one. We finally apply the results to a dynamic scheduling problem.This work was partially supported by the Chateaubriand fellowship from the French embassy in Israel and by the European Grant BRA-QMIPS of CEC DG XIII     

钢卷尺刻度在线测量系

本文介绍了一种钢卷尺刻度在线测量系统 ,它采用了高速摄像及计算机数据处理技术 ,文章阐述了系统的非接触动态测量原理 ,描述了光电信号的处理方法 .     

Viscoelasticity and birefringence of polyisoprene

The complex Young's modulus, E^*(ω), and the complex strain-optical coefficient, O^*(ω), which is the ratio of the birefringence to the strain, were measured for polyisoprene (PIP) over a frequency range of 1 ～ 130 Hz and a temperature range of 22 ～ ?100°C. The imaginary part of O^*, O″, was positive at low frequencies and negative at high frequencies. The real part, O′, was always positive and showed a maximum. The complicated behavior of O^* could be understood by the assumption that E^* = E_R^* + E_G^* and O^* = C_RE_R^* + C_GE_G^*, where E_R^* and E_G^* were complex quantities and C_R and C_G were constants. The C_R value, equal to the ordinary stress-optical coefficient measured in the rubbery plateau zone, was 2.0 × 10^?9 Pa^?1. The C_G value, defined as the ratio O″/E″ in the glassy zone, was ?1.1 × 10^?11 Pa^?1. The E_G^*, which was the major component of E^* in the glassy zone, showed almost the same frequency dependence as that of polystyrene and polycarbonate. The E_R^*, which was dominant in the rubbery zone, was described well by the bead-spring theory. The temperature dependence of the E_G^* was stronger than that of the E_R^*. This difference caused the breakdown of the thermorheological simplicity for E^* and O^* around the glass-to-rubber transition zone. © 1995 John Wiley & Sons, Inc.     

Experimental investigation on large deflection response of a frame impacted by a moving body

This paper reports on the experimental investigation of the dynamic large deflection response of a portal frame impacted at its midspan by a body moving at a certain speed. Both the deflection and velocity vs. time curves of the midspan and the dynamic history of a number of desired locations were recorded during the process of response. On the basis of the test data, the momentum and kinetic energy conversion between the frame and the moving body in the impact process are realized, and the occurrence and expansion of plastic regions are described. Investigation results show that the initial collision is approximately ideally inelastic, and that the elastic deformation plays a considerable role in the response though the input energy is much larger than the maximum elastic energy capacity of the beam member; therefore, in a general impact, the energy ratio should not be regarded as a sufficient criterion for a rigid—plastic solution. The ratios of the impulse transferred to and the energy absorbed by the frame in the initial collision to that carried by the moving body before impact is only related to the ratiobetween the equivalent mass of the frame paticipating in the initial collision and the mass of the impacting body, having nothing to do with the impacting velocity to a certain extent.     

PHASE INVERSION AND ITS MECHANICAL MODEL STUDIES FOR THE TWO-PHASE POLYMER BLEND SYSTEMS (Ⅱ)——DYNAMIC VISCOELASTIC RESPONSE

The dynamic viscoelastic response of the two-phase polymer blend systems shows the characteristics of the thermorheologically complex materials. In this paper theoretical equations for describing the dynamic viscoelastic response of such polymer blend systems have been established by means of the mechanical modeling technique. The dynamic viscoelastic response of the blend systems at any blend composition can be predicted theoretically by using the equations established, provided that the dynamic viscoelastic response of the two pure components and the mechanical model parameters are known in advance. Thus, we provide an effective method for studying the dynamic mechanical properties and the molecular relaxation characteristics of the two-phase polymer blend systems.     

Age related changes in the thermal transition of Turkey leg flexor tendon collagen

A differential scanning calorimetric, thermogravimetric and electron microscopic investigation has been carried out on the uncalcified areas of turkey leg flexor tendon as a function of age. Rehydrated samples exhibit an increase of thermal stability with age. The H_D values drop from about 11 cal·g^–1 in the first weeks of life down to 7 cal·g^–1 after the 11th week.At about 11 weeks, the collagen fibril diameter distribution passes from unimodal to multimodal. The DSC curves as well as the TG-DTG curves recorded from dried samples do not show any appreciable difference with ageing. The variations in thermal behaviour of rehydrated samples and fibril diameter distribution could be related to modifications in water binding with ageing.The Authors are grateful to Dr. G. Fabris for discussion and help in the selection of the samples. They also wish to thank Mr. G. Pizzuto for excellent technical assistance. The financial support by Consiglio Nazionale delle Ricerche is gratefully acknowledged.     

Surface forces in foam films from ABA block copolymer: a dynamic method study

The thinning of foam films from aqueous solutions of an ABA triblock copolymer of polyethylene oxide and polypropylene oxide (average molecular weight 14,000 g/mol) is studied experimentally. The dependence of the surface forces on film thickness is obtained by the dynamic method of Scheludko and Exerowa.The total surface force measured in foam films (radius 60–70 m) from 10^–5 M (0.014 wt%) polymer solution with 0.1 M NaCl is positive at thicknesses from about 800 down to 460 . The electrostatic repulsion is negligible while the contribution of van der Waals attraction is small (within 15%). Therefore a positive surface force component predominates. Most probably it arises from steric interactions between the hydrophilic polyethylene oxide tails of the polymer. The dynamic method appears to be a suitable technique for exploring the stabilization of foam films from ABA copolymers.     

On Aging of Acid-Catalyzed Silica Sols—A Dynamic Light Scattering Study

Dynamic light scattering experiments in acid-catalyzed silica sols are discussed. It is shown that in spite of limited parameter accuracy and limited absolute knowledge of the particle sizes, the scattering data from various experiments are comparable with one another and give information about structural differences. Measurements at various angles indicate changes between non-spherical and nearly spherical particles and allow the estimation of gelling times before gelation.     

Kinetic versus thermodynamic control during the formation of [2]rotaxanes by a dynamic template-directed clipping process

A template-directed dynamic clipping procedure has generated a library of nine [2]rotaxanes that have been formed from three dialkylammonium salts-acting as the dumbbell-shaped components-and three dynamic, imino bond-containing, [24]crown-8-like macrocycles-acting as the ring-shaped components-which are themselves assembled from three dialdehydes and one diamine. The rates of formation of these [2]rotaxanes differ dramatically, from minutes to days depending on the choice of dialkylammonium ion and dialdehyde, as do their thermodynamic stabilities. Generally, [2]rotaxanes formed by using 2,6-diformylpyridine as the dialdehyde component, or bis(3,5-bis(trifluoromethyl)benzyl)ammonium hexafluorophosphate as the dumbbell-shaped component, assembled the most rapidly. Those rotaxanes containing this particular electron-deficient dumbbell-shaped unit, or 2,5-diformylfuran units in the macroring, were the most stable thermodynamically. The relative thermodynamic stabilities of all nine of the [2]rotaxanes were determined by competition experiments that were monitored by (1)H NMR spectroscopy.     

Dynamic stereochemistry of hypervalent silicon, germanium and tin compounds containing amidomethyl C, O-chelating ligands

The results of NMR-spectroscopy studies of the structure, dynamic stereochemistry, and intermolecular interactions in solutions of organic derivatives of penta-and hexacoordinated silicon, germanium, and tin containing amidomethyl, lactamomethyl, and related bidentate ligands are surveyed. For the series of works “Dynamic stereochemistry of hypervalent compounds of silicon, germanium, and tin,” the author was awarded the Academia Europea Prize for young scientists from CIS in 1996. Translated fromIzvestiya Akademii Nauk. Seriya Khimicheskaya, No. 11, pp. 1912–1934. November, 1997.