A Neural Network-Based Policy Iteration Algorithm with Global $$H^2$$ -Superlinear Convergence for Stochastic Games on Domains

In this work, we propose a class of numerical schemes for solving semilinear Hamilton–Jacobi–Bellman–Isaacs (HJBI) boundary value problems which arise naturally from exit time problems of diffusion processes with controlled drift. We exploit policy iteration to reduce the semilinear problem into a sequence of linear Dirichlet problems, which are subsequently approximated by a multilayer feedforward neural network ansatz. We establish that the numerical solutions converge globally in the \(H^2\)-norm and further demonstrate that this convergence is superlinear, by interpreting the algorithm as an inexact Newton iteration for the HJBI equation. Moreover, we construct the optimal feedback controls from the numerical value functions and deduce convergence. The numerical schemes and convergence results are then extended to oblique derivative boundary conditions. Numerical experiments on the stochastic Zermelo navigation problem are presented to illustrate the theoretical results and to demonstrate the effectiveness of the method.

     

Understanding the solubility and crystallization of molybdenum in high-sodium borosilicate glasses: effect of lanthanum oxide

Journal of Radioanalytical and Nuclear Chemistry - The simplified 8-oxide system (SiO2-B2O3-Na2O-Al2O3-CaO-TiO2-MoO3-La2O3) has been prepared under two types of cooling methods, and analyzed with...     

Anti-fibrosis attributes: UHPLC-MS/MS-based pharmacokinetics profiling of a novel autotaxin inhibitor with excellent in vivo efficacy in rat

3,4-Difluorobenzyl(1-ethyl-5-(4-((4-hydroxypiperidin-1-yl)-methyl)thiazol-2-yl)-1H-indol-3-yl)carbamate (NAI59), a small molecule with outstanding therapeutic effectiveness to anti-pulmonary fibrosis, was developed as an autotaxin inhibitor candidate compound. To evaluate the pharmacokinetics and plasma protein binding of NAI59, a UPLC–MS/MS method was developed to quantify NAI59 in plasma and phosphate-buffered saline. The calibration curve linearity ranged from 9.95 to 1990.00 ng/mL in plasma. The accuracy was −6.8 to 5.9%, and the intra- and inter-day precision was within 15%. The matrix effect and recovery, as well as dilution integrity, were within the criteria. The chromatographic and mass spectrometric conditions were also feasible to determine phosphate-buffered saline samples, and it has been proved that this method exhibits good precision and accuracy in the range of 9.95–497.50 ng/mL in phosphate-buffered saline. This study is the first to determine the pharmacokinetics, absolute bioavailability, and plasma protein binding of NAI59 in rats using this established method. Therefore, the pharmacokinetic profiles of NAI59 showed a dose-dependent relationship after oral administration, and the absolute bioavailability in rats was 6.3%. In addition, the results of protein binding showed that the combining capacity of NAI59 with plasma protein attained 90% and increased with the increase in drug concentration.     

A New Quassinoid from Brucea javanica

Chemistry of Natural Compounds - A new quassinoid, dehydrobruceantinol B (1), was isolated from the seeds of Brucea javanica, together with two known compounds, bruceantinol (2) and bruceine A (3)....     

Visible-light-induced,autopromoted nickel-catalyzed three-component arylsulfonation of 1,3-enynes and mechanistic insights

Science China Chemistry - A light-induced, nickel-catalyzed three-component arylsulfonation of 1,3-enynes in the absence of photocatalyst is reported. This methodology exhibited mild conditions,...     

Model and nonlinear dynamic analysis of linear guideway subjected to external periodic excitation in five directions

Nonlinear Dynamics - Investigation of the dynamic characteristics of linear guideway is essential for enhancing structural performance of machine tools. However, few mechanical models are...     

EcoLens: visual analysis of ecological regions in urban contexts using traffic data

Journal of Visualization - The increasing availability of spatiotemporal data provides unprecedented opportunities for understanding the structure of an urban area in terms of people’s...     

Majorana Representation for a Composite System

International Journal of Theoretical Physics - The Majorana representation, which provides an intuitive way to represent the quantum state by stars on the Bloch sphere, has drawn considerable...     

Visible light-driven acridone catalysis for atom transfer radical polymerization

Acridone as a new kind of visible light photocatalyst has been developed to catalyze metal free atom transfer radical polymerization (ATRP). The photocatalyst possess low excited state potential as can undergo an oxidative quenching pathway to initiate ATRP of vinyl monomers. Kinetic study and light on/off reaction demonstrate the “living”/controlled nature of the polymerization by light. Block copolymers can be achieved by using PMMA as macroinitiator to reinitiate polymerization of other vinyl monomers, which shows highly preserved Br chain-end functionality in the synthesized polymers. Moreover, the polymerization can be conducted under air atmosphere as most photocatalysts need anaerobic condition, which may give inspiration of further application of this kind of photocatalyst.