Nonparametric estimation and adaptive control in a class of finite Markov decision chains

We consider a class of Markov decision processes withfinite state and action spaces which, essentially, is determined by the following condition: The state space isirreducible under the action of any stationary policy. However, except by this restriction, the transition law iscompletely unknown to the controller. In this context, we find a set of policies under which thefrequency estimators of the transition law are strongly consistent and then, this result is applied to constructadaptive asymptotically discount-optimal policies.Dedicated to Professor Truman O. Lewis, on the occasion of his sixtieth birthdayThis research was supported in part by the Third World Academy of Sciences (TWAS) under Grant TWAS RG MP 898-152, and in part by the Consejo Nacional de Ciencia y Tecnología (CONACYT) under Grant A128CCOEO550 (MT-2).     

Domain decomposition for an asymptotic geological fault modeling

We present in this paper a domain decomposition method to treat faults in geological basin modeling. The particularity of this model is that the faults whose widths are very small in comparison with the basin size, are not characterized as subdomains any more but as interfaces between sedimentary blocks. The originality of this work lies in the formulation of this new fault model and in the definition and the computation of the interface conditions between the subdomains. To cite this article: E. Flauraud et al., C. R. Mecanique 331 (2003).     

A Nonlinear Drift - Diffusion System with Electric Convection Arising in Electrophoretic and Semiconductor Modeling

A multi-dimensional transient drift-diffusion model for (at most) three charged particles, consisting of the continuity equations for the concentrations of the species and the Poisson equation for the electric potential, is considered. The diffusion terms depend on the concentrations. Such a system arises in electrophoretic modeling of three species (neutrally, positively and negatively charged) and in semiconductor theory for two species (positively charged holes and negatively charged electrons). Diffusion terms of degenerate type are also possible in semiconductor modeling. For the initial boundary value problem with mixed Dirichlet - Neumann boundary conditions and general reaction rates, a global existence result is proved. Uniqueness of solutions follows in the Dirichlet boundary case if the diffusion terms are uniformly parabolic or if the initial and boundary densities are strictly positive. Finally, we prove that solutions exist which are positive uniformly in time and globally bounded if the reaction rates satisfy appropriate growth conditions.     

具有非局部边界条件的奇摄动反应扩散问题

本文研究了一类具有非局部边界条件的奇摄动反应扩散初始边值问题．在适当的条件下，利用比较定理讨论了问题解的渐近性态．     

Cyclic reduction and FACR methods for piecewise hermite bicubic orthogonal spline collocation

Cyclic reduction and Fourier analysis-cyclic reduction (FACR) methods are presented for the solution of the linear systems which arise when orthogonal spline collocation with piecewise Hermite bicubics is applied to boundary value problems for certain separable partial differential equations on a rectangle. On anN×N uniform partition, the cyclic reduction and Fourier analysis-cyclic reduction methods requireO(N ²log₂ N) andO(N ²log₂log₂ N) arithmetic operations, respectively.     

Differential Conditions for Constrained Nonlinear Programming via Pareto Optimization

We deal with the differential conditions for local optimality. The conditions that we derive for inequality constrained problems do not require constraint qualifications and are the broadest conditions based on only first-order and second-order derivatives. A similar result is proved for equality constrained problems, although the necessary conditions require the regularity of the equality constraints.     

On the properties of solutions to the Goursat-Darboux problem with boundary and distributed controls

We consider a control system described by the Goursat-Darboux equation. The system is controlled by distributed and boundary controls. The controls are subject to the constraints given as multivalued mappings with closed, possibly nonconvex, values depending on the phase variable. Alongside the initial constraints, we consider the convexified constraints and the constraints whose values are the extreme points of the convexified constraints. We study the questions of existence of solutions and establish connections between the solutions under various constraints.     

Global existence and blow-up of solutions to a parabolic system with nonlocal sources and boundaries

This paper deals with a semi-linear parabolic system with nonlinear nonlocal sources and nonlocal boundaries.By using super-and sub-solution techniques,we first give the sufficient conditions that the classical solution exists globally and blows up in a finite time respectively,and then give the necessary and sufficient conditions that two components u and v blow up simultaneously.Finally,the uniform blow-up profiles in the interior are presented.     

Fixed-sign solutions for a system of singular focal boundary value problems

We consider a system of focal boundary value problems where the nonlinearities may be singular in the independent variable and may also be singular in the dependent arguments. Using Schauder fixed point theorem, we establish criteria such that the system of boundary value problems has at least one fixed-sign solution.     

On Nash Equilibria for Noncooperative Games Governed by the Burgers Equation

Existence of a Nash equilibrium in a noncooperative game governed by the one-dimensional Burgers equation, proposed in the case of pointwise controls in Ref. 1, is proved under data qualifications that guarantee the diffusion term in the Burgers’ equation to be dominant enough with respect to the uniform convexity of the payoffs. This work was partly supported by Grants 201/03/0934 (GA čR) and MSM 0021620839 (MšMT čR). Inspiring discussions with Angel M. Ramos are acknowledged.