Nonparametric estimation and adaptive control in a class of finite Markov decision chains

We consider a class of Markov decision processes withfinite state and action spaces which, essentially, is determined by the following condition: The state space isirreducible under the action of any stationary policy. However, except by this restriction, the transition law iscompletely unknown to the controller. In this context, we find a set of policies under which thefrequency estimators of the transition law are strongly consistent and then, this result is applied to constructadaptive asymptotically discount-optimal policies.Dedicated to Professor Truman O. Lewis, on the occasion of his sixtieth birthdayThis research was supported in part by the Third World Academy of Sciences (TWAS) under Grant TWAS RG MP 898-152, and in part by the Consejo Nacional de Ciencia y Tecnología (CONACYT) under Grant A128CCOEO550 (MT-2).     

Pattern Search Method for Discrete <Emphasis Type="Italic">L</Emphasis><Subscript>1</Subscript>–Approximation

We propose a pattern search method to solve a classical nonsmooth optimization problem. In a deep analogy with pattern search methods for linear constrained optimization, the set of search directions at each iteration is defined in such a way that it conforms to the local geometry of the set of points of nondifferentiability near the current iterate. This is crucial to ensure convergence. The approach presented here can be extended to wider classes of nonsmooth optimization problems. Numerical experiments seem to be encouraging. This work was supported by M.U.R.S.T., Rome, Italy.     

Ab-initio simulation of elastic constants for some ceramic materials

Athermal elasticity for some ceramic materials (α-Al₂O₃, SiC (α and β phases), TiO₂ (rutile and anatase), hexagonal AlN and TiB₂, cubic BN and CaF₂, and monoclinic ZrO₂) have been investigated via density functional theory. Energy-volume equation-of-state computations to obtain the zero pressure equilibrium volume and bulk modulus as well as computations of the full elastic constant tensor of these ceramics at the experimental zero pressure volume have been performed. The present results for the single crystal elasticity are in good agreement with experiments both for the aggregate properties (bulk and shear modulus) and the elastic anisotropy. In contrast, a considerable discrepancy for the zero pressure bulk modulus of some ceramics evaluated from the energy-volume fit to the computational zero pressure volume has been observed.     

Local polynomial fitting under association

We consider the estimation of multivariate regression functions r(x₁,…,x_d) and their partial derivatives up to a total order p1 using high-order local polynomial fitting. The processes {Y_i,X_i} are assumed to be (jointly) associated. Joint asymptotic normality is established for the estimates of the regression function r and all its partial derivatives up to the total order p. Expressions for the bias and variance/covariance matrix (of the asymptotic distribution) are given.     

关于非光滑不变凸多目标规划的Wolfe型对偶

本文讨论定义在Banach空间上的,既具有等式约束又具有不等式约束的,非光滑(F,P)不变凸多目标规划的Wolfe对偶性,Mond-Weir型对偶性可类似讨论之。     

A geometric theory forL 2-stability of the inverse problem in a one-dimensional elliptic equation from anH 1-observation

This study provides a stability theory for the nonlinear least-squares formulation of estimating the diffusion coefficient in a two-point boundary-value problem from an error-corrupted observation of the state variable. It is based on analysing the projection of the observation on the nonconvex attainable set.This research was started while G. Chavent visited the Technical University of Graz. Support through the Steiermaerkische Landesregierung is gratefully acknowledged.     

BAHADUR ASYMPTOTIC EFFICIENCY IN A SEMIPARAMETRIC REGRESSION MODEL

ＢＡＨＡＤＵＲＡＳＹＭＰＴＯＴＩＣＥＦＦＩＣＩＥＮＣＹＩＮＡＳＥＭＩＰＡＲＡＭＥＴＲＩＣＲＥＧＲＥＳＳＩＯＮＭＯＤＥＬ￥ＬＩＡＮＧＨＵＡ；ＣＨＥＮＧＰＩＮＧＡｂｓｔｒａｃｔ：ＴｈｅａｕｔｈｏｒＳｇｉｖｅＭＬＥθ１ＭＬｏｆθ１ｉｎｔｈｅｍｏｄｅｌＹ＝θ...     

一类三参数混沌动力学系统模型及其在经济增长研究中的应用

从非线性自回归模型Xt+1=-αXtλ+1+βXt+γ出发,通过变量替换Xt=aYt,推出三参数混沌动力学系统模型Yt+1=kYt(1-Ytλ)+c;采用线性回归与非线性回归相结合的改进的混合法,对模型参数作了估计;实际研究表明,该模型可以用于对国内生产总值GDP增长的研究.     

Vehicle density and velocity estimation on highways for on-ramp metering control

A scheme for vehicle density and velocity estimation in a stretch of highway based on a modified cell transmission model [C. F. Daganzo, Transportation Research, Part B, 28B(4),269–287, 1994. Elsevier is presented. The scheme is intended for use with on-ramp metering control algorithms, providing local knowledge of densities and velocities that is helpful to improve on-ramp metering control performance. Estimation of density is obtained by nonlinear estimators, while velocity estimation is obtained by gradient algorithms. There is one density–velocity estimator for free traffic flow and other for congested traffic flow. Both estimator schemes work in parallel. The final estimation of density and velocity results from a convex combination of the predictions of the two estimators. This combination depends on occupancy or density measurements at the boundaries of the stretch and is produced by a fuzzy inference system. Stability and convergence of the density and velocity estimation scheme is proved by Lyapunov based techniques. Simulation results comparing measured and estimated traffic data are presented. They confirm good performance of the estimators. Research sponsored by grants UNAM PAPIIT IN110403 and CONACYT 47583.     

Assessment of some iterative methods for non-symmetric linear systems arising in computational fluid dynamics

Various tests have been carried out in order to compare the performances of several methods used to solve the non-symmetric linear systems of equations arising from implicit discretizations of CFD problems, namely the scalar advection-diffusion equation and the compressible Euler equations. The iterative schemes under consideration belong to three families of algorithms: relaxation (Jacobi and Gauss-Seidel), gradient and Newton methods. Two gradient methods have been selected: a Krylov subspace iteration method (GMRES) and a non-symmetric extension of the conjugate gradient method (CGS). Finally, a quasi-Newton method has also been considered (Broyden). The aim of this paper is to provide indications of which appears to be the most adequate method according to the particular circumstances as well as to discuss the implementation aspects of each scheme.