A Neural Network-Based Policy Iteration Algorithm with Global $$H^2$$ -Superlinear Convergence for Stochastic Games on Domains

In this work, we propose a class of numerical schemes for solving semilinear Hamilton–Jacobi–Bellman–Isaacs (HJBI) boundary value problems which arise naturally from exit time problems of diffusion processes with controlled drift. We exploit policy iteration to reduce the semilinear problem into a sequence of linear Dirichlet problems, which are subsequently approximated by a multilayer feedforward neural network ansatz. We establish that the numerical solutions converge globally in the \(H^2\)-norm and further demonstrate that this convergence is superlinear, by interpreting the algorithm as an inexact Newton iteration for the HJBI equation. Moreover, we construct the optimal feedback controls from the numerical value functions and deduce convergence. The numerical schemes and convergence results are then extended to oblique derivative boundary conditions. Numerical experiments on the stochastic Zermelo navigation problem are presented to illustrate the theoretical results and to demonstrate the effectiveness of the method.

     

基于SRAM的通用存算一体架构平台在物联网中的应用

最近,存算一体(IMC)架构引起了广泛关注,并被认为有望成为突破冯诺依曼瓶颈的新型计算机架构,特别是在数据密集型(data-intensive)计算中能够带来显著的性能和功耗优势.其中,基于SRAM的IMC架构方案也被大量研究与应用.该文在一款基于SRAM的通用存算一体架构平台——DM-IMCA的基础上,探索IMC架构在物联网领域中的应用价值.具体来说,该文选取了物联网中包括信息安全、二值神经网络和图像处理在内的多个轻量级数据密集型应用,对算法进行分析或拆分,并将关键算法映射到DM-IMCA中的SRAM中,以达到加速应用计算的目的.实验结果显示,与基于传统冯诺依曼架构的基准系统相比,利用DM-IMCA来实现物联网中的轻量级计算密集型应用,可获得高达24倍的计算加速比.     

Understanding the solubility and crystallization of molybdenum in high-sodium borosilicate glasses: effect of lanthanum oxide

Journal of Radioanalytical and Nuclear Chemistry - The simplified 8-oxide system (SiO2-B2O3-Na2O-Al2O3-CaO-TiO2-MoO3-La2O3) has been prepared under two types of cooling methods, and analyzed with...     

Anti-fibrosis attributes: UHPLC-MS/MS-based pharmacokinetics profiling of a novel autotaxin inhibitor with excellent in vivo efficacy in rat

3,4-Difluorobenzyl(1-ethyl-5-(4-((4-hydroxypiperidin-1-yl)-methyl)thiazol-2-yl)-1H-indol-3-yl)carbamate (NAI59), a small molecule with outstanding therapeutic effectiveness to anti-pulmonary fibrosis, was developed as an autotaxin inhibitor candidate compound. To evaluate the pharmacokinetics and plasma protein binding of NAI59, a UPLC–MS/MS method was developed to quantify NAI59 in plasma and phosphate-buffered saline. The calibration curve linearity ranged from 9.95 to 1990.00 ng/mL in plasma. The accuracy was −6.8 to 5.9%, and the intra- and inter-day precision was within 15%. The matrix effect and recovery, as well as dilution integrity, were within the criteria. The chromatographic and mass spectrometric conditions were also feasible to determine phosphate-buffered saline samples, and it has been proved that this method exhibits good precision and accuracy in the range of 9.95–497.50 ng/mL in phosphate-buffered saline. This study is the first to determine the pharmacokinetics, absolute bioavailability, and plasma protein binding of NAI59 in rats using this established method. Therefore, the pharmacokinetic profiles of NAI59 showed a dose-dependent relationship after oral administration, and the absolute bioavailability in rats was 6.3%. In addition, the results of protein binding showed that the combining capacity of NAI59 with plasma protein attained 90% and increased with the increase in drug concentration.     

Optimal parameter selection for constraint-following control for mechanical systems based on Stackelberg game

Nonlinear Dynamics - This paper proposes an optimal parameter design of control scheme for mechanical systems by adopting the Stackelberg game theory. The goal of the control is to drive the...     

Model and nonlinear dynamic analysis of linear guideway subjected to external periodic excitation in five directions

Nonlinear Dynamics - Investigation of the dynamic characteristics of linear guideway is essential for enhancing structural performance of machine tools. However, few mechanical models are...     

Spatiotemporal Magnetocaloric Microenvironment for Guiding the Fate of Biodegradable Polymer Implants

The degradation behavior of implants is significantly important for bone repair. However, it is still unprocurable to spatiotemporally regulate the degradation of the implants to match bone ingrowth. In this paper, a magneto-controlled biodegradation model is established to explore the degradation behavior of magnetic scaffolds in a magnetothermal microenvironment generated by an alternating magnetic field (AMF). The results demonstrate that the scaffolds can be heated by magnetic nanoparticles (NPs) under AMF, which dramatically accelerated scaffold degradation. Especially, magnetic NPs modified by oleic acid with a better interface compatibility exhibit a greater heating efficiency to further facilitate the degradation. Furthermore, the molecular dynamics simulations reveal that the enhanced motion correlation between magnetic NPs and polymer matrix can accelerate the energy transfer. As a proof-of-concept, the feasibility of magneto-controlled degradation for implants is demonstrated, and an optimizing strategy for better heating efficiency of nanomaterials is provided, which may have great instructive significance for clinical medicine.     

A Highly Sensitive,Reversible, and Bidirectional Humidity Actuator by Calcium Carbonate Ionic Oligomers Incorporated Poly(Vinylidene Fluoride)

Sensitivity and multi-directional motivation are major two factors for developing optimized humidity-response materials, which are promising for sensing, energy production, etc. Organic functional groups are commonly used as the water sensitive units through hydrogen bond interactions with water molecules in actuators. The multi-coordination ability of inorganic ions implies that the inorganic ionic compounds are potentially superior water sensitive units. However, the particle forms of inorganic ionic compounds produced by classical nucleation limit the number of exposed ions to interact with water. Recent progress on the inorganic ionic oligomers has broken through the limitation of classical nucleation, and realized the molecular-scaled incorporation of inorganic ionic compounds into an organic matrix. Here, the incorporation of hydrophilic calcium carbonate ionic oligomers into hydrophobic poly(vinylidene fluoride) (PVDF) is demonstrated. The ultra-small calcium carbonate oligomers within a PVDF film endow it with an ultra-sensitive, reversible, and bidirectional response. The motivation ability is superior to other bidirectional humidity-actuators at present, which realizes self-motivation on an ice surface, converting the chemical potential energy of the humidity gradient from ice to kinetic energy.     

Performance analysis of bit error rate of data link system under pulse LFM interference in time-varying rayleigh channel

Wireless Networks - In such mobile platforms as ships and aircraft, the detection and reconnaissance devices are near to the communication facilities. When working at the same time, they will...     

A note on statistical analysis of factor models of high dimension

Science China Mathematics - Linear factor models are familiar tools used in many fields. Several pioneering literatures established foundational theoretical results of the quasi-maximum likelihood...