Application of a Near-Optimal Reinforcement Learning Controller to a Robotics Problem in Manufacturing: A Hybrid Approach

Optimization theory provides a framework for determining the best decisions or actions with respect to some mathematical model of a process. This paper focuses on learning to act in a near-optimal manner through reinforcement learning for problems that either have no model or the model is too complex. One approach to solving this class of problems is via approximate dynamic programming. The application of these methods are established primarily for the case of discrete state and action spaces. In this paper we develop efficient methods of learning which act in complex systems with continuous state and action spaces. Monte-Carlo approaches are employed to estimate function values in an iterative, incremental procedure. Derivative-free line search methods are used to obtain a near-optimal action in the continuous action space for a discrete subset of the state space. This near-optimal control policy is then extended to the entire continuous state space via a fuzzy additive model. To compensate for approximation errors, a modified procedure for perturbing the generated control policy is developed. Convergence results under moderate assumptions and stopping criteria are established.     

Dielectronic Recombination of Very Heavy Lithiumlike Ions

Hyperfine Interactions - An overview of measurements of dielectronic recombination (DR) with the heaviest lithiumlike ions is presented. The experiments have been carried out at the heavy ion...     

Inhibition of the reduction of Cr(VI) at the magnetite–water interface by calcium carbonate coatings

The effect of calcium carbonate coatings on the reduction of aqueous chromate on the magnetite(1 1 1) surface has been investigated using a combination of synchrotron based X-ray photoemission spectroscopy (PES) and X-ray absorption near edge structure (XANES) spectroscopy, along with laboratory-based powder X-ray diffraction (XRD) and scanning electron microscopy (SEM). CaCO₃ coatings (dominantly calcite with minor quantities of aragonite and vaterite) of thicknesses ranging from 10 Å to 20 m were grown on magnetite(1 1 1) surfaces by exposure to supersaturated aqueous solutions followed by evaporation of the solution—a process that mimics pore-water evaporation in vadose zones leading to the formation of caliche and calcium carbonate coatings on mineral grains. Coating thicknesses were determined from attenuation of the Fe 2p photoemission signal by the carbonate coating. For coatings less than 15 Å thick, Cr 2p photoemission and Cr L_II, L_III-edge XANES spectra show that chromate is reduced by the underlying magnetite surface; however, as the minimum coating thickness increases beyond 15 Å, the magnetite surface becomes passivated and further chromate reduction ceases. Our findings suggest that carbonate coatings on natural magnetite grains can significantly reduce or eliminate their ability to reduce Cr(VI), which is a toxic and highly mobile environmental contaminant.     

A symmetry-adapted force-constant lattice-dynamical model for single-walled carbon nanotubes

We develop a lattice-dynamical model based on the screw symmetry of single-walled carbon nanotubes that allows for reducing the size of the dynamical matrix to six, for all tube chiralities. The model uses force constants derived from fitting to the phonon dispersion of 2D graphite. We present the calculation procedure in a clear and transparent way, making the model easier to follow. We calculate the phonon dispersions of a number of nanotubes of different chiralities. The splitting of two highest Raman active modes and the radial breathing mode frequency are studied by changing the tube diameter and chirality.     

A proof of Culter’s theorem on the existence of periodic orbits in polygonal outer billiards

We prove a recent theorem by C. Culter every polygonal outer billiard in the affine plane has a periodic trajectory.      

Orbifold fibrations of Eschenburg spaces

Most of the few known examples of compact Riemannian manifolds with positive sectional curvature are the total space of a Riemannian submersion. In this article we show that this is true for all known examples, if we enlarge the category to orbifold fibrations. For this purpose we study all almost free isometric circle actions on positively curved Eschenburg spaces, which give rise to principle orbifold bundle structures, and we examine in detail their geometric properties. In particular, we obtain a new family of 6-dimensional orbifolds with positive sectional curvature whose singular locus consists of just two points.      

Existence and Ergodicity for the Two-Dimensional Stochastic Magneto-Hydrodynamics Equations

The paper proves the existence of solutions to the magneto-hydrodynamics equations driven by random exterior forcing terms both in the velocity and in the magnetic field. The existence and uniqueness of an invariant measure is also obtained via coupling methods.