Nonparametric estimation and adaptive control in a class of finite Markov decision chains

We consider a class of Markov decision processes withfinite state and action spaces which, essentially, is determined by the following condition: The state space isirreducible under the action of any stationary policy. However, except by this restriction, the transition law iscompletely unknown to the controller. In this context, we find a set of policies under which thefrequency estimators of the transition law are strongly consistent and then, this result is applied to constructadaptive asymptotically discount-optimal policies.Dedicated to Professor Truman O. Lewis, on the occasion of his sixtieth birthdayThis research was supported in part by the Third World Academy of Sciences (TWAS) under Grant TWAS RG MP 898-152, and in part by the Consejo Nacional de Ciencia y Tecnología (CONACYT) under Grant A128CCOEO550 (MT-2).     

Endogenous phosphorus excretion by sheep fed hydrolyzed sugarcane bagasse, lucerne hay and citrus pulp

Summary The objective of this study was to determine endogenous phosphorus excretion in sheep fed with different diets. Sixteen male growing sheep, received a basic diet with: 42% hydrolyzed sugarcane bagasse (HSB), 45% lucerne hay (LH) plus 14% hydrolyzed sugarcane bagasse, and 30% citrus pulp (CTP) plus 40% hydrolyzed sugarcane bagasse. A dose of 7.7 MBq ³²P was injected into the left jugular vein of each animal. The P endogenous fecal losses were: 1.69, 2.50, 2.33 and 1.45 g/animal for treatments HSB, LH, and CTP respectively (P>0.05). The type of diet influenced slight endogenous P excretion but altered excretion of P in urine. Endogenous P excreted in feces (P_F) comes mainly from saliva and represents an important loss of P. The estimation of net requirements of phosphorus (P) for ruminants includes endogenous losses, which is also essential for calculating true absorption of this mineral. Physical structure of the feed may influence endogenous losses, altering the metabolism of P and also the demand of this mineral, therefore being important to know how different feeds affect endogenous P losses.     

Density estimation and adaptive control of markov processes: Average and discounted criteria

We consider a class of discrete-time Markov control processes with Borel state and action spaces, and ^d i.i.d. disturbances with unknown distribution . Under mild semi-continuity and compactness conditions, and assuming that is absolutely continuous with respect to Lebesgue measure, we establish the existence of adaptive control policies which are (1) optimal for the average-reward criterion, and (2) asymptotically optimal in the discounted case. Our results are obtained by taking advantage of some well-known facts in the theory of density estimation. This approach allows us to avoid restrictive conditions on the state space and/or on the system's transition law imposed in recent works, and on the other hand, it clearly shows the way to other applications of nonparametric (density) estimation to adaptive control.Research partially supported by The Third World Academy of Sciences under Research Grant No. MP 898-152.     

Palladium catalyzed Heck reaction of arenediazonium tetrafluoroborate salts with Baylis-Hillman adducts: production of α-benzyl-β-keto esters

A novel experimental procedure to obtain α-benzyl-β-keto esters from the Heck reaction between arenediazonium tetrafluoroborate salts and Baylis-Hillman (BH) adducts in the presence of Pd(OAc)₂ as catalyst is described. The methodology is simple, straightforward and the use of arenediazonium salts as opposed to conventional arylhalides/triflates over the usual Heck reaction is highlighted.     

Effects of Total Thermal Balance on the Thermal Energy Absorbed or Released by a High-Temperature Phase Change Material

Front tracking and enthalpy methods used to study phase change processes are based on a local thermal energy balance at the liquid–solid interface where mass accommodation methods are also used to account for the density change during the phase transition. Recently, it has been shown that a local thermal balance at the interface does not reproduce the thermodynamic equilibrium in adiabatic systems. Total thermal balance through the entire liquid–solid system can predict the correct thermodynamic equilibrium values of melted (solidified) mass, system size, and interface position. In this work, total thermal balance is applied to systems with isothermal–adiabatic boundary conditions to estimate the sensible and latent heat stored (released) by KNO3 and KNO3/NaNO3 salts which are used as high-temperature phase change materials. Relative percent differences between the solutions obtained with a local thermal balance at the interface and a total thermal balance for the thermal energy absorbed or released by high-temperature phase change materials are obtained. According to the total thermal balance proposed, a correction to the liquid–solid interface dynamics is introduced, which accounts for an extra amount of energy absorbed or released during the phase transition. It is shown that melting or solidification rates are modified by using a total thermal balance through the entire system. Finally, the numerical and semi-analytical methods illustrate that volume changes and the fraction of melted (solidified) solid (liquid) estimated through a local thermal balance at the interface are not invariant in adiabatic systems. The invariance of numerical and semi-analytical solutions in adiabatic systems is significantly improved through the proposed model.     

The CuII−CuI−Cu0(Hg) system in the presence of benzotriazole: Part II. A chronocoulometric investigation

Both the oxidation of Cu⁰ at dropping amalgam electrodes immersed in solutions of benzotriazole (BTA) and the reduction of Cu^II at a dropping mercury electrode from BTA solutions have been investigated by the single potential-step chronocoulometric technique. The dependence of the charge Q(t) flowing as a consequence of a given potential jump E_i→E_f upon the initial and final potentials E_i and E_f, as well as upon the time t elapsed from the instant of the potential jump provides direct evidence for the presence of a single adsorbed monolayer of a Cu^I compound on a mercury electrode immersed in a Cu^II solution containing BTA, at applied potentials positive to ≈?0.4 V/SCE. Analogous measurements carried out at dropping amalgam electrodes reveal the presence of a single adsorbed monolayer of a Cu^I compound, or else of an adsorbed multilayer, depending on the potential range investigated. The results of the chronocoulometric measurements are in agreement with those of the polarographic measurements of Part I.     

Comparison of low-energy CAD spectra of sulphonium,ammonium and phosphonium cations,propene elimination from allyl-substituted oniums

The low-energy collision-activated dissociation of symmetrical n-butyl-substituted and of allyl-substituted onium cations has been recorded using fast atom bombardment ionization and a tandem mass spectrometry quadrupole mass spectrometer. Structure of the fragments and decomposition pathways have been ascertained using a multi-quadrupole MS/MS/MS triple analyser instrument. Whereas most sulphonium cations exhibit only heterolytic cleavages, fragmentation of ammonium and phosphonium is mainly homolytic. Allylic sulphonium, and to a lesser extent allylic ammonium, easily undergo propene elimination. This reaction, which does not occur in 1-propenyl oniums, might involve a McLafferty type rearrangement.     

Kinetics of Reactions of α,β-Unsaturated Surfactants with Secondary Amines in a Solution

The kinetics of reactions of acrylamide derivatives (acrylamidotrihydroxymethylmethane (TA), sodium 4-acrylamidobutanoate (AA₃), sodium 6-acrylamidohexanoate (AA₅), and sodium 11-acrylamido-undecanoate (AA10)) with piperidine and morpholine in water (for TA, also in DMF, DMSO, and formamide) is studied at 293 K. These compounds are weak surfactant monomers. The critical concentrations of micelle formation (CCM) for them are determined. The self-association of AA₃, AA₅, and AA₁₀ producing micelles results in a decrease in their reactivity compared to the monomeric forms. The rates of the reactions of surfactant monomers (SM) with morpholine and piperidine are described by the second-order rate law w ₀ = k[SM]₀[Amine]₀. An empirical equation is derived that relates the CCM values to the rate constant for the reaction of a surfactant monomer with a secondary amine with charges on the -carbon and oxygen atoms of the amide group of a surfactant monomer. The rates of the reactions of TA with piperidine and morpholine are determined by the electrophilicity (acidity) of the medium, which is favorable for the Michael reaction.