A Neural Network-Based Policy Iteration Algorithm with Global $$H^2$$ -Superlinear Convergence for Stochastic Games on Domains

In this work, we propose a class of numerical schemes for solving semilinear Hamilton–Jacobi–Bellman–Isaacs (HJBI) boundary value problems which arise naturally from exit time problems of diffusion processes with controlled drift. We exploit policy iteration to reduce the semilinear problem into a sequence of linear Dirichlet problems, which are subsequently approximated by a multilayer feedforward neural network ansatz. We establish that the numerical solutions converge globally in the \(H^2\)-norm and further demonstrate that this convergence is superlinear, by interpreting the algorithm as an inexact Newton iteration for the HJBI equation. Moreover, we construct the optimal feedback controls from the numerical value functions and deduce convergence. The numerical schemes and convergence results are then extended to oblique derivative boundary conditions. Numerical experiments on the stochastic Zermelo navigation problem are presented to illustrate the theoretical results and to demonstrate the effectiveness of the method.

     

The influence of the first integrals and the rolling resistance model on tippe top inversion

Nonlinear Dynamics - In this paper, we analyze the effect which the choice of a friction model has on tippe top inversion in the case where the resulting action of all dissipative forces is...     

A probabilistic approach to spectral analysis of growth-fragmentation equations

The growth-fragmentation equation describes a system of growing and dividing particles, and arises in models of cell division, protein polymerisation and even telecommunications protocols. Several important questions about the equation concern the asymptotic behaviour of solutions at large times: at what rate do they converge to zero or infinity, and what does the asymptotic profile of the solutions look like? Does the rescaled solution converge to its asymptotic profile at an exponential speed? These questions have traditionally been studied using analytic techniques such as entropy methods or splitting of operators. In this work, we present a probabilistic approach: we use a Feynman–Kac formula to relate the solution of the growth-fragmentation equation to the semigroup of a Markov process, and characterise the rate of decay or growth in terms of this process. We then identify the Malthus exponent and the asymptotic profile in terms of a related Markov process, and give a spectral interpretation in terms of the growth-fragmentation operator and its dual.     

Synthesis of Highly Substituted γ‐Butyrolactones by a Gold‐Catalyzed Cascade Reaction of Benzyl Esters

Easily accessible benzylic esters of 3‐butynoic acids in a gold‐catalyzed cyclization/rearrangement cascade reaction provided 3‐propargyl γ‐butyrolactones with the alkene and the carbonyl group not being conjugated. Crossover experiments showed that the formation of the new C?C bond is an intermolecular process. Initially propargylic–benzylic esters were used, but alkyl‐substituted benzylic esters worked equally well. In the case of the propargylic–benzylic products, a simple treatment of the products with aluminum oxide initiated a twofold tautomerization to the allenyl‐substituted γ‐butyrolactones with conjugation of the carbonyl group, the olefin, and the allene. The synthetic sequence can be conducted stepwise or as a one‐pot cascade reaction with similar yields. Even in the presence of the gold catalyst the new allene remains intact.     

Iodine(III)‐Catalyzed Rearrangements of Imides: A Versatile Route to α,α‐Dialkylated α‐Hydroxy Carboxylamides

A tertiary hydroxy group α to a carboxyl moiety comprises a key structural motif in many bioactive substances. With the herein presented metal‐free rearrangement of imides triggered by hypervalent λ³‐iodane, an easy and selective way to gain access to such a compound class, namely α,α‐disubstituted‐α‐hydroxy carboxylamides, was established. Their additional methylene bromide side chain constitutes a useful handle for rapid diversification, as demonstrated by a series of further functionalizations. Moreover, the in situ formation of an iodine(III) species under the reaction conditions was proven. Our findings clearly corroborate that hypervalent λ³‐benziodoxolones are involved in these organocatalytic reactions.     

Modular Synthetic Approach to Carboranyl‒Biomolecules Conjugates

The development of novel, tumor-selective and boron-rich compounds as potential agents for use in boron neutron capture therapy (BNCT) represents a very important field in cancer treatment by radiation therapy. Here, we report the design and synthesis of two promising compounds that combine meta-carborane, a water-soluble monosaccharide and a linking unit, namely glycine or ethylenediamine, for facile coupling with various tumor-selective biomolecules bearing a free amino or carboxylic acid group. In this work, coupling experiments with two selected biomolecules, a coumarin derivative and folic acid, were included. The task of every component in this approach was carefully chosen: the carborane moiety supplies ten boron atoms, which is a tenfold increase in boron content compared to the l-boronophenylalanine (l-BPA) presently used in BNCT; the sugar moiety compensates for the hydrophobic character of the carborane; the linking unit, depending on the chosen biomolecule, acts as the connection between the tumor-selective component and the boron-rich moiety; and the respective tumor-selective biomolecule provides the necessary selectivity. This approach makes it possible to develop a modular and feasible strategy for the synthesis of readily obtainable boron-rich agents with optimized properties for potential applications in BNCT.     

Discovery of Novel Symmetrical 1,4-Dihydropyridines as Inhibitors of Multidrug-Resistant Protein (MRP4) Efflux Pump for Anticancer Therapy

Despite the development of targeted therapies in cancer, the problem of multidrug resistance (MDR) is still unsolved. Most patients with metastatic cancer die from MDR. Transmembrane efflux pumps as the main cause of MDR have been addressed by developed inhibitors, but early inhibitors of the most prominent and longest known efflux pump P-glycoprotein (P-gp) were disappointing. Those inhibitors have been used without knowledge about the expression of P-gp by the treated tumor. Therefore the use of inhibitors of transmembrane efflux pumps in clinical settings is reconsidered as a promising strategy in the case of the respective efflux pump expression. We discovered novel symmetric inhibitors of the symmetric efflux pump MRP4 encoded by the ABCC4 gene. MRP4 is involved in many kinds of cancer with resistance to anticancer drugs. All compounds showed better activities than the best known MRP4 inhibitor MK571 in an MRP4-overexpressing cell line assay, and the activities could be related to the various substitution patterns of aromatic residues within the symmetric molecular framework. One of the best compounds was demonstrated to overcome the MRP4-mediated resistance in the cell line model to restore the anticancer drug sensitivity as a proof of concept.     

The Effect of the Spacer of Bis(biurea) Ligands on the Structure of A2L3‐type (A=anion) Phosphate Complexes

By tuning the length and rigidity of the spacer of bis(biurea) ligands L, three structural motifs of the A₂L₃ complexes (A represents anion, here orthophosphate PO₄^3?), namely helicate, mesocate, and mono‐bridged motif, have been assembled by coordination of the ligand to phosphate anion. Crystal structure analysis indicated that in the three complexes, each of the phosphate ions is coordinated by twelve hydrogen bonds from six surrounding urea groups. The anion coordination properties in solution have also been studied. The results further demonstrate the coordination behavior of phosphate ion, which shows strong tendency for coordination saturation and geometrical preference, thus allowing for the assembly of novel anion coordination‐based structures as in transition‐metal complexes.