Machine Learning Approximation Algorithms for High-Dimensional Fully Nonlinear Partial Differential Equations and Second-order Backward Stochastic Differential Equations

High-dimensional partial differential equations (PDEs) appear in a number of models from the financial industry, such as in derivative pricing models, credit valuation adjustment models, or portfolio optimization models. The PDEs in such applications are high-dimensional as the dimension corresponds to the number of financial assets in a portfolio. Moreover, such PDEs are often fully nonlinear due to the need to incorporate certain nonlinear phenomena in the model such as default risks, transaction costs, volatility uncertainty (Knightian uncertainty), or trading constraints in the model. Such high-dimensional fully nonlinear PDEs are exceedingly difficult to solve as the computational effort for standard approximation methods grows exponentially with the dimension. In this work, we propose a new method for solving high-dimensional fully nonlinear second-order PDEs. Our method can in particular be used to sample from high-dimensional nonlinear expectations. The method is based on (1) a connection between fully nonlinear second-order PDEs and second-order backward stochastic differential equations (2BSDEs), (2) a merged formulation of the PDE and the 2BSDE problem, (3) a temporal forward discretization of the 2BSDE and a spatial approximation via deep neural nets, and (4) a stochastic gradient descent-type optimization procedure. Numerical results obtained using TensorFlow in Python illustrate the efficiency and the accuracy of the method in the cases of a 100-dimensional Black–Scholes–Barenblatt equation, a 100-dimensional Hamilton–Jacobi–Bellman equation, and a nonlinear expectation of a 100-dimensional G-Brownian motion.

     

A New Jacobi Elliptic Function Expansion Method for Solvinga Nonlinear PDE Describing Pulse Narrowing Nonlinear Transmission Lines

In this article, we apply the first elliptic function equation to find a new kind of solutions of nonlinear partial differential equations (PDEs) based on the homogeneous balance method, the Jacobi elliptic expansion method and the auxiliary equation method. New exact solutions to the Jacobi elliptic functions of a nonlinear PDE describing pulse narrowing nonlinear transmission lines are given with the aid of computer program, e.g. Maple or Mathematica. Based on Kirchhoff's current law and Kirchhoff's voltage law, the given nonlinear PDE has been derived and can be reduced to a nonlinear ordinary differential equation (ODE) using a simple transformation. The given method in this article is straightforward and concise, and can be applied to other nonlinear PDEs in mathematical physics. Further results may be obtained.     

On modified method of simplest equation for obtaining exact and approximate solutions of nonlinear PDEs: The role of the simplest equation

The modified method of simplest equation is powerful tool for obtaining exact and approximate solutions of nonlinear PDEs. These solutions are constructed on the basis of solutions of more simple equations called simplest equations. In this paper we study the role of the simplest equation for the application of the modified method of simplest equation. We follow the idea that each function constructed as polynomial of a solution of a simplest equation is a solution of a class of nonlinear PDEs. We discuss three simplest equations: the equations of Bernoulli and Riccati and the elliptic equation. The applied algorithm is as follows. First a polynomial function is constructed on the basis of a simplest equation. Then we find nonlinear ODEs that have the constructed function as a particular solution. Finally we obtain nonlinear PDEs that by means of the traveling-wave ansatz can be reduced to the above ODEs. By means of this algorithm we make a first step towards identification of the above-mentioned classes of nonlinear PDEs.     

A positive splitting method for mixed hyperbolic‐parabolic systems

In this article we present a method of lines approach to the numerical solution of a system of coupled hyperbolic—parabolic partial differential equations (PDEs). Special attention is paid to preserving the positivity of the solution of the PDEs when this solution is approximated numerically. This is achieved by using a flux‐limited spatial discretization for the hyperbolic equation. We use splitting techniques for the solution of the resulting large system of stiff ordinary differential equations. The performance of the approach applied to a biomathematical model is compared with the performance of standard methods. © 2001 John Wiley & Sons, Inc. Numer Methods Partial Differential Eq 17: 152–168, 2001     

An indirect variable transformation approach and Jacobi elliptic solutions to Korteweg de Vries equation

Based on a variable change and the variable separated ODE method, an indirect variable transformation approach is proposed to search exact solutions to special types of partial differential equations (PDEs). The new method provides a more systematical and convenient handling of the solution process for the nonlinear equations. Its key point is to reduce the given PDEs to variable-coefficient ordinary differential equations, then we look for solutions to the resulting equations by some methods. As an application, exact solutions for the KdV equation are formally derived.     

A note on the elliptic equation method

The elliptic equation method is improved for constructing exact travelling wave solutions of nonlinear partial differential equations (PDEs). The rational forms of Jacobi elliptic functions are presented. By using new Jacobi elliptic function solutions of the elliptic equation, new doubly periodic solutions are obtained for some important PDEs. This method can be applied to many other nonlinear PDEs.     

A rational generalization of Fan’s method and its application to generalized shallow water wave equations

In this paper we employ a rational expansion to generalize Fan’s method for exact travelling wave solutions for nonlinear partial differential equations (PDEs). To verify the reliability of the proposed method, the generalized shallow water wave (GSWW) equation has been investigated as an example. Kinds of new exact travelling wave solutions of a rational form have been obtained. This indicates that the proposed method provides a more general result for exact solution of nonlinear equations.     

Probabilistic Solutions for a Class of Path-Dependent Hamilton-Jacobi-Bellman Equations

This article shows that the solution of a backward stochastic differential equation under G-expectation provides a probabilistic interpretation for the viscosity solution of a type of path-dependent Hamilton-Jacobi-Bellman equation. Particularly, a G-martingale can be considered as a nonlinear path-dependent partial differential equation (PDE). We also show that certain class of path-dependent PDEs can be transformed into classical multiple state-dependent PDEs. As an application, the path-dependent uncertain volatility model can be described directly by path-dependent Black-Scholes-Barrenblett equations.     

ODE solvers and the method of lines

Factors influencing the choice of ODE solver for the numerical solution of PDEs by the method of lines are investigated. The advection—diffusion equation is used to gain insight that is generalized to some classes of nonlinear PDEs. Numerical results for several nonlinear PDEs illustrate the theoretical developments. © 1994 John Wiley & Sons, Inc.     

On the summability of divergent power series satisfying singular PDEs

The aim of this note is to apply the Borel–Laplace summation method studied by H. Chen, Z. Luo and C. Zhang (Summability of formal solutions of singular PDEs by means of two-dimensional Borel–Laplace method, preprint) to the divergent power series solutions to two families of nonlinear PDEs. The first one contains particularly a two-dimensional version of the so-called Euler equation (ODE), while the second is called totally characteristic type PDE by H. Chen and H. Tahara (On the holomorphic solution of non-linear totally characteristic equations, Math. Nachr. 219 (2000) 85–96).     

A Jacobi–Davidson method for two‐real‐parameter nonlinear eigenvalue problems arising from delay‐differential equations

The critical delays of a delay‐differential equation can be computed by solving a nonlinear two‐parameter eigenvalue problem. The solution of this two‐parameter problem can be translated to solving a quadratic eigenvalue problem of squared dimension. We present a structure preserving QR‐type method for solving such quadratic eigenvalue problem that only computes real‐valued critical delays; that is, complex critical delays, which have no physical meaning, are discarded. For large‐scale problems, we propose new correction equations for a Newton‐type or Jacobi–Davidson style method, which also forces real‐valued critical delays. We present three different equations: one real‐valued equation using a direct linear system solver, one complex valued equation using a direct linear system solver, and one Jacobi–Davidson style correction equation that is suitable for an iterative linear system solver. We show numerical examples for large‐scale problems arising from PDEs. Copyright © 2012 John Wiley & Sons, Ltd.     

Exact Solutions and Integrability of the Duffing – Van der Pol Equation

The force-free Duffing–Van der Pol oscillator is considered. The truncated expansions for finding the solutions are used to look for exact solutions of this nonlinear ordinary differential equation. Conditions on parameter values of the equation are found to have the linearization of the Duffing–Van der Pol equation. The Painlevé test for this equation is used to study the integrability of the model. Exact solutions of this differential equation are found. In the special case the approach is simplified to demonstrate that some well-known methods can be used for finding exact solutions of nonlinear differential equations. The first integral of the Duffing–Van der Pol equation is found and the general solution of the equation is given in the special case for parameters of the equation. We also demonstrate the efficiency of the method for finding the first integral and the general solution for one of nonlinear second-order ordinary differential equations.     

Be careful with the Exp-function method – Additional remarks

It is shown that the solution produced by the Exp-function method may not hold for all initial conditions. Riccati and Maccari nonlinear differential equations are used to illustrate that fact. Conditions of existence for the produced solution in the space of initial conditions and in the space of system’s parameters are derived using the operator method based on the generalized operator of differentiation. The concept of the expansion of an ordinary differential equation is introduced and it is shown that the algebraic–analytical solution of Maccari equation can be produced by solving Riccati equation.     

Generalized Reflected BSDE and an Obstacle Problem for PDEs with a Nonlinear Neumann Boundary Condition

Abstract

In this article, we derive the existence and uniqueness of the solution for a class of generalized reflected backward stochastic differential equation involving the integral with respect to a continuous process, which is the local time of the diffusion on the boundary, in using the penalization method. We also give a characterization of the solution as the value function of an optimal stopping time problem. Then we give a probabilistic formula for the viscosity solution of an obstacle problem for PDEs with a nonlinear Neumann boundary condition.     

Numerical solution of linear and nonlinear partial differential equations using the peridynamic differential operator

This study presents numerical solutions to linear and nonlinear Partial Differential Equations (PDEs) by using the peridynamic differential operator. The solution process involves neither a derivative reduction process nor a special treatment to remove a jump discontinuity or a singularity. The peridynamic discretization can be both in time and space. The accuracy and robustness of this differential operator is demonstrated by considering challenging linear, nonlinear, and coupled PDEs subjected to Dirichlet and Neumann‐type boundary conditions. Their numerical solutions are achieved using either implicit or explicit methods. © 2017 Wiley Periodicals, Inc. Numer Methods Partial Differential Eq 33: 1726–1753, 2017     

Approximate analytical solutions of fractional gas dynamic equations

In this article, differential transform method (DTM) has been successfully applied to obtain the approximate analytical solutions of the nonlinear homogeneous and non-homogeneous gas dynamic equations, shock wave equation and shallow water equations with fractional order time derivatives. The true beauty of the article is manifested in its emphatic application of Caputo fractional order time derivative on the classical equations with the achievement of the highly accurate solutions by the known series solutions and even for more complicated nonlinear fractional partial differential equations (PDEs). The method is really capable of reducing the size of the computational work besides being effective and convenient for solving fractional nonlinear equations. Numerical results for different particular cases of the equations are depicted through graphs.     

Ermakov–Pinney and Emden–Fowler Equations: New Solutions from Novel Bäcklund Transformations

We study the class of nonlinear ordinary differential equations y″ y = F(z, y²), where F is a smooth function. Various ordinary differential equations with a well-known importance for applications belong to this class of nonlinear ordinary differential equations. Indeed, the Emden–Fowler equation, the Ermakov–Pinney equation, and the generalized Ermakov equations are among them. We construct Bäcklund transformations and auto-Bäcklund transformations: starting from a trivial solution, these last transformations induce the construction of a ladder of new solutions admitted by the given differential equations. Notably, the highly nonlinear structure of this class of nonlinear ordinary differential equations implies that numerical methods are very difficult to apply.     

A solution to the Lane–Emden equation in the theory of stellar structure utilizing the Tau method

In this paper, we propose a Tau method for solving the singular Lane–Emden equation—a nonlinear ordinary differential equation on a semi‐infinite interval. We applied collocation, Galerkin, and Tau methods for solving this problem, and according to the results, the solution of Tau method is the most accurate. The operational derivative and product matrices of the modified generalized Laguerre functions are presented. These matrices, in conjunction with the Tau method, are then utilized to reduce the solution of the Lane–Emden equation to that of a system of algebraic equations. We also present a comparison of this work with some well‐known results and show that the present solution is highly accurate. Copyright © 2012 John Wiley & Sons, Ltd.     

Error analysis and applications of the Fourier-Galerkin Runge-Kutta schemes for high-order stiff PDEs

An integrating factor mixed with Runge-Kutta technique is a time integration method that can be efficiently combined with spatial spectral approximations to provide a very high resolution to the smooth solutions of some linear and nonlinear partial differential equations. In this paper, the novel hybrid Fourier-Galerkin Runge-Kutta scheme, with the aid of an integrating factor, is proposed to solve nonlinear high-order stiff PDEs. Error analysis and properties of the scheme are provided. Application to the approximate solution of the nonlinear stiff Korteweg-de Vries (the 3rd order PDE, dispersive equation), Kuramoto-Sivashinsky (the 4th order PDE, dissipative equation) and Kawahara (the 5th order PDE) equations are presented. Comparisons are made between this proposed scheme and the competing method given by Kassam and Trefethen. It is found that for KdV, KS and Kawahara equations, the proposed method is the best.     

Master partial differential equations for a Type II hidden symmetry

An approach for determining a class of master partial differential equations from which Type II hidden point symmetries are inherited is presented. As an example a model nonlinear partial differential equation (PDE) reduced to a target PDE by a Lie symmetry gains a Lie point symmetry that is not inherited (hidden) from the original PDE. On the other hand this Type II hidden symmetry is inherited from one or more of the class of master PDEs. The class of master PDEs is determined by the hidden symmetry reverse method. The reverse method is extended to determine symmetries of the master PDEs that are not inherited. We indicate why such methods are necessary to determine the genesis of Type II symmetries of PDEs as opposed to those that arise in ordinary differential equations (ODEs).