Density estimation and adaptive control of markov processes: Average and discounted criteria

We consider a class of discrete-time Markov control processes with Borel state and action spaces, and ^d i.i.d. disturbances with unknown distribution . Under mild semi-continuity and compactness conditions, and assuming that is absolutely continuous with respect to Lebesgue measure, we establish the existence of adaptive control policies which are (1) optimal for the average-reward criterion, and (2) asymptotically optimal in the discounted case. Our results are obtained by taking advantage of some well-known facts in the theory of density estimation. This approach allows us to avoid restrictive conditions on the state space and/or on the system's transition law imposed in recent works, and on the other hand, it clearly shows the way to other applications of nonparametric (density) estimation to adaptive control.Research partially supported by The Third World Academy of Sciences under Research Grant No. MP 898-152.     

Diffusion in three-dimensional random systems at their percolation thresholds

Extensive Monte Carlo simulations of theant-in-the-labyrinth problem on randomL* L* L simple cubic lattices are performed, forL up to 960 on a CRAY-YMP supercomputer. The exponentk for the rms displacementr witht inrt ^k is found to bek=0.190±0.003. As a second approach, large percolation clusters with chemical shells up to 300 are generated on a simple cubic lattice at criticality. The diffusion equation is then solved by using the exact enumeration technique. The corresponding critical exponentd ^w is found to be 1/d ^w =0.250±0.003.On leave from I. Institut für Theoretische für Physik, Universität Hamburg, D-2000 Hamburg, Federal Republic of Germany.     

Monotone Chemical Reaction Networks

We analyze certain chemical reaction networks and show that every solution converges to some steady state. The reaction kinetics are assumed to be monotone but otherwise arbitrary. When diffusion effects are taken into account, the conclusions remain unchanged. The main tools used in our analysis come from the theory of monotone dynamical systems. We review some of the features of this theory and provide a self-contained proof of a particular attractivity result which is used in proving our main result.     

Defect concentration in Ti-substituted YIG from TG curves

The article discusses theory and experiment about the measurement of defect concentration in Ti-substituted yttrium iron garnet by means of thermogravimetry techniques. The two possible cases arising from oxygen interchange with atmosphere, oxygen vacancies and interstitial cations, may be analyzed quantitatively from the derived expressions. The possibility of another type of defects being present in the samples, not associated to oxygen evolution, is not excluded. Measurements were carried out in air and CO₂ for different Ti contents. The substitution tends to increase slightly the defect parameter θ in YIG, while a CO₂ reducing atmosphere is much more effective than the Ti substitution for increasing θ. Calculations for a given single-phased sample sintered in air show two possibilities: a deficit of one oxygen atom for every 2.5 unit cells of 96 atoms, or one excess cation for every 3.5 cells. Other samples show very similar results. The accuracy involved in the measurements is about 2–3%.     

Proton nuclear magnetic resonance characterisation of glycosaminoglycans using chemometric techniques

Various types of glycosaminoglycans (GAGs) including heparins, chondroitin sulfates, dermatan sulfate and hyaluronic acid were studied from their proton nuclear magnetic resonance (1H NMR) spectra using chemometric techniques. Despite the complexity of the 1H NMR signals, data analysis using principal component analysis enabled the different GAG classes to be distinguished and permitted their classification according to their chemical structure. The analysis of the composition of the major disaccharide unit and other relevant chemical structures in the heparin samples was performed using partial least squares regression.     

Structure of hydroxycinnamic acid derivatives established by high-perfomance liquid chromatography with photodiode-array detection

Summary The present paper describes the development of a method for the differentiation of hydroxycinnamic acid derivatives by HPLC with photodiode-array detection. Furthermore spectral data of the compounds under investigation are given. Whereas p-coumaric acid derivatives are distinguishable from caffeic and ferulic acid derivatives by the positions of their spectrum maxima and their convexity interval value, it is not possible to distinguish between caffeic and ferulic acid derivatives because of overlapping spectrum maxima and convexity interval values.     

Lipase from a Brazilian StrainPenicillium citrinum Cultured in a Simple and Inexpensive Medium st]Heat-Denaturation, Kinetics, and pH Stability

This work is a study of lipase production by a Brazilian strain ofPenicillium citrinum using an inexpensive and simple medium without organic nitrogen sources and of some important industrial properties, including thermostability in relation to ionic strength. The maximal lipase activity (1585 U/L) was obtained whenPenicillium citrinum was cultured on 0.75% ammonium sulfate complemented with minerals salts instead of yeast extract. Although this activity was about 55% lower than that produced in medium with yeast extract (2850 U/L), the specific activity (7.8 U/mg proteins) was higher than that obtained with the yeast extract (4.9 U/mg proteins). The morphology of fungus changed totally, with yeast extract there are smooth, solid, and spherical pellets whereas on ammonium sulfate there are small “hairy” pellets uniformly suspended in the medium. The effect of ferrous (Fe⁺⁺) ions was carried out using medium MA with and without Fe⁺⁺ ions. Lipase production byPenicillium citrinum in medium MA requires Fe⁺⁺ ions, the absence of which caused a decreased of about 50% in the specific activity (3.5 U/mg proteins). The utilization of commercial, locally available oils as carbon sources, such as soybean oil (236 U/L) and corn oil (74 U/L) resulted in lower activity compared to olive oil, showing that lipase production byPenicillium citrinum is specifically induced by olive oil. Potassium concentration in the medium can effects the production of lipase (1 mM (1585 U/L), 10 mM (1290 U/L), and 30 mM (1238 U/L), 50 mM (195 U/L), and 100 mM (2 U/L). The crude culture filtered was susceptable to thermal deactivation. It was stable at pH 6.0, but was not stable at the optimum pH (8.0-8.5) at 50 mM. At the low ionic concentration (1-25 mM) this lipase was stable at low pH (3.5-4.0). The activation energy was 22.4 ±2.2 Kcal. mol 1.     

Chemical, structural, and thermal properties of Zn(II)-Cr(III) layered double hydroxides intercalated with sulfated and sulfonated surfactants

Zn(II)-Cr(III)-LDHs (layered double hydroxides) containing sulfated or sulfonated surfactants as the interlamellar anion were synthesized by the coprecipitation method. The syntheses were conducted under various different experimental conditions, such as the Zn : Cr ratio, pH, and aging time. In each of the prepared materials, unlike previously reported data, the interlayer anion arrangement did not change, being consistent with a perpendicular monolayer. The thermal decomposition process of the prepared materials was studied by a set of analysis methods, such as TG/DTA, TG/MS, PXRD, and FT-IR. From the results obtained it was possible to conclude that, in an air atmosphere, the anions decomposed by a partial combustion, leading to the formation of sulfide. The results also showed that sulfonated surfactants containing LDHs are much more stable than those containing sulfated surfactants. A mechanism was proposed for the thermal decomposition of such LDHs based on the experimental results.     

Reactivity of 2-deoxy-2-iodoglycosyl isothiocyanates with O-, S-, and N-nucleophiles. Synthesis of glycopyranoso-fused thiazoles

The reactivity of 2-deoxy-2-iodoglycosyl isothiocyanates toward O- and S-nucleophiles gives an easy access to 2-deoxy-2-iodoglycopyranosyl thiocarbamates and dithiocarbamates. Internal nucleophilic displacement of the iodine by the sulfur atom in these compounds allows the preparation of glycopyranoso[1,2-d]-1,3-thiazoles and glycopyranoso[1,2-d]-1,3-thiazolidin-2-one or -2-thione. Reaction with amines or polyamines as N-nucleophiles led directly to 2-aminoglycopyranoso[1,2-d]-1,3-thiazoles without isolation of the intermediate thioureas. Methyl 2-deoxy-2-iodoglycopyranosyl thiocarbamates also allow the synthesis of 2-deoxyglycopyranosyl thiocarbamates or 2-deoxy-2-iodoglycopyranosyl carbamates.