A sparse grid method for the Navier–Stokes equations based on hyperbolic cross

A sparse grid method for the time‐dependent Navier–Stokes equations based on hyperbolic cross approximation is considered in this article. Subsequent truncation of the associated series expansion results in a sparse grid discretization. Stability and convergence of the fully discrete sparse grid method are established. Finally, the numerical experiment is presented to show the effectiveness of this sparse grid method. Copyright © 2013 John Wiley & Sons, Ltd.     

On coordinate transformation and grid stretching for sparse grid pricing of basket options

We evaluate two coordinate transformation techniques in combination with grid stretching for pricing basket options in a sparse grid setting. The sparse grid technique is a basic technique for solving a high-dimensional partial differential equation. By creating a small hypercube sub-grid in the ‘composite’ sparse grid we can also determine hedge parameters accurately. We evaluate these techniques for multi-asset examples with up to five underlying assets in the basket.     

A solver for the stochastic master equation applied to gene regulatory networks

An important driver of gene regulatory networks is noise arising from the stochastic nature of interactions of genes, their products and regulators. Thus, such systems are stochastic and can be modelled by the chemical master equations. A major challenge is the curse of dimensionality which occurs when one attempts to integrate these equations. While stochastic simulation techniques effectively address the curse, many repeated simulations are required to provide precise information about stationary points, bifurcation phenomena and other properties of the stochastic processes. An alternative way to address the curse of dimensionality is provided by sparse grid approximations. The sparse grid methodology is applied and the application demonstrated to work efficiently for up to 10 proteins. As sparse grid methods have been developed for the approximation of smooth functions, a variant for infinite sequences had to be developed together with a multiresolution analysis similar to Haar wavelets. Error bounds are provided which confirm the effectiveness of sparse grid approximations for smooth high-dimensional probability distributions.     

Sparse grids for boundary integral equations

Summary. The potential of sparse grid discretizations for solving boundary integral equations is studied for the screen problem on a square in . Theoretical and numerical results on approximation rates, preconditioning, adaptivity and compression for piecewise constant and linear sparse grid spaces are obtained. Received March 17, 1998 / Revised version received September 10, 1998     

Mitigating the curse of dimensionality: sparse grid characteristics method for optimal feedback control and HJB equations

We address finding the semi-global solutions to optimal feedback control and the Hamilton–Jacobi–Bellman (HJB) equation. Using the solution of an HJB equation, a feedback optimal control law can be implemented in real-time with minimum computational load. However, except for systems with two or three state variables, using traditional techniques for numerically finding a semi-global solution to an HJB equation for general nonlinear systems is infeasible due to the curse of dimensionality. Here we present a new computational method for finding feedback optimal control and solving HJB equations which is able to mitigate the curse of dimensionality. We do not discretize the HJB equation directly, instead we introduce a sparse grid in the state space and use the Pontryagin’s maximum principle to derive a set of necessary conditions in the form of a boundary value problem, also known as the characteristic equations, for each grid point. Using this approach, the method is spatially causality free, which enjoys the advantage of perfect parallelism on a sparse grid. Compared with dense grids, a sparse grid has a significantly reduced size which is feasible for systems with relatively high dimensions, such as the 6-D system shown in the examples. Once the solution obtained at each grid point, high-order accurate polynomial interpolation is used to approximate the feedback control at arbitrary points. We prove an upper bound for the approximation error and approximate it numerically. This sparse grid characteristics method is demonstrated with three examples of rigid body attitude control using momentum wheels.     

Mixed two‐grid finite difference methods for solving one‐dimensional and two‐dimensional Fitzhugh–Nagumo equations

The aim of this paper is to propose mixed two‐grid finite difference methods to obtain the numerical solution of the one‐dimensional and two‐dimensional Fitzhugh–Nagumo equations. The finite difference equations at all interior grid points form a large‐sparse linear system, which needs to be solved efficiently. The solution cost of this sparse linear system usually dominates the total cost of solving the discretized partial differential equation. The proposed method is based on applying a family of finite difference methods for discretizing the spatial and time derivatives. The obtained system has been solved by two‐grid method, where the two‐grid method is used for solving the large‐sparse linear systems. Also, in the proposed method, the spectral radius with local Fourier analysis is calculated for different values of h and Δt. The numerical examples show the efficiency of this algorithm for solving the one‐dimensional and two‐dimensional Fitzhugh–Nagumo equations. Copyright © 2016 John Wiley & Sons, Ltd.     

Spatially adaptive sparse grids for high-dimensional data-driven problems

Sparse grids allow one to employ grid-based discretization methods in data-driven problems. We present an extension of the classical sparse grid approach that allows us to tackle high-dimensional problems by spatially adaptive refinement, modified ansatz functions, and efficient regularization techniques. The competitiveness of this method is shown for typical benchmark problems with up to 166 dimensions for classification in data mining, pointing out properties of sparse grids in this context. To gain insight into the adaptive refinement and to examine the scope for further improvements, the approximation of non-smooth indicator functions with adaptive sparse grids has been studied as a model problem. As an example for an improved adaptive grid refinement, we present results for an edge-detection strategy.     

Option pricing with a direct adaptive sparse grid approach

We present an adaptive sparse grid algorithm for the solution of the Black–Scholes equation for option pricing, using the finite element method. Sparse grids enable us to deal with higher-dimensional problems better than full grids. In contrast to common approaches that are based on the combination technique, which combines different solutions on anisotropic coarse full grids, the direct sparse grid approach allows for local adaptive refinement. When dealing with non-smooth payoff functions, this reduces the computational effort significantly. In this paper, we introduce the spatially adaptive discretization of the Black–Scholes equation with sparse grids and describe the algorithmic structure of the numerical solver. We present several strategies for adaptive refinement, evaluate them for different dimensionalities, and demonstrate their performance showing numerical results.     

Interpolation lattices for hyperbolic cross trigonometric polynomials

Sparse grid discretisations allow for a severe decrease in the number of degrees of freedom for high-dimensional problems. Recently, the corresponding hyperbolic cross fast Fourier transform has been shown to exhibit numerical instabilities already for moderate problem sizes. In contrast to standard sparse grids as spatial discretisation, we propose the use of oversampled lattice rules known from multivariate numerical integration. This allows for the highly efficient and perfectly stable evaluation and reconstruction of trigonometric polynomials using only one ordinary FFT. Moreover, we give numerical evidence that reasonable small lattices exist such that our new method outperforms the sparse grid based hyperbolic cross FFT for realistic problem sizes.     

Optimal scaling parameters for sparse grid discretizations

We apply iterative subspace correction methods to elliptic PDE problems discretized by generalized sparse grid systems. The involved subspace solvers are based on the combination of all anisotropic full grid spaces that are contained in the sparse grid space. Their relative scaling is at our disposal and has significant influence on the performance of the iterative solver. In this paper, we follow three approaches to obtain close‐to‐optimal or even optimal scaling parameters of the subspace solvers and thus of the overall subspace correction method. We employ a Linear Program that we derive from the theory of additive subspace splittings, an algebraic transformation that produces partially negative scaling parameters that result in improved asymptotic convergence properties, and finally, we use the OptiCom method as a variable nonlinear preconditioner. Copyright © 2014 John Wiley & Sons, Ltd.     

Maxima and minima of homogeneous Gaussian random fields over continuous time and uniform grids

ABSTRACT

In this paper, for centred homogeneous Gaussian random fields the joint limiting distributions of normalized maxima and minima over continuous time and uniform grids are investigated. It is shown that maxima and minima are asymptotic dependent for strongly dependent homogeneous Gaussian random field with the choice of sparse grid, Pickands' grid or dense grid, while for the weakly dependent Gaussian random field maxima and minima are asymptotically independent.     

Selected Recent Applications of Sparse Grids

Sparse grids have become a versatile tool for a vast range of applications reaching from interpolation and numerical quadrature to data-driven problems and uncertainty quantification. We review four selected real-world applications of sparse grids: financial product pricing with the Black-Scholes model, interactive exploration of simulation data with sparse-grid-based surrogate models, analysis of simulation data through sparse grid data mining methods, and stability investigations of plasma turbulence simulations.     

The combination technique and some generalisations

The combination technique has repeatedly been shown to be an effective tool for the approximation with sparse grid spaces. Little is known about the reasons of this effectiveness and in some cases the combination technique can even break down. It is known, however, that the combination technique produces an exact result in the case of a projection into a sparse grid space if the involved partial projections commute.

The performance of the combination technique is analysed using a projection framework and the C/S decomposition. Error bounds are given in terms of angles between the spanning subspaces or the projections onto these subspaces. Based on this analysis modified combination coefficients are derived which are optimal in a certain sense and which can substantially extend the applicability and performance of the combination technique.     

Block low-rank single precision coarse grid solvers for extreme scale multigrid methods

Extreme scale simulation requires fast and scalable algorithms, such as multigrid methods. To achieve asymptotically optimal complexity, it is essential to employ a hierarchy of grids. The cost to solve the coarsest grid system can often be neglected in sequential computings, but cannot be ignored in massively parallel executions. In this case, the coarsest grid can be large and its efficient solution becomes a challenging task. We propose solving the coarse grid system using modern, approximate sparse direct methods and investigate the expected gains compared with traditional iterative methods. Since the coarse grid system only requires an approximate solution, we show that we can leverage block low-rank techniques, combined with the use of single precision arithmetic, to significantly reduce the computational requirements of the direct solver. In the case of extreme scale computing, the coarse grid system is too large for a sequential solution, but too small to permit massively parallel efficiency. We show that the agglomeration of the coarse grid system to a subset of processors is necessary for the sparse direct solver to achieve performance. We demonstrate the efficiency of the proposed method on a Stokes-type saddle point system solved with a monolithic Uzawa multigrid method. In particular, we show that the use of an approximate sparse direct solver for the coarse grid system can outperform that of a preconditioned minimal residual iterative method. This is demonstrated for the multigrid solution of systems of order up to $10^{11}$ degrees of freedom on a petascale supercomputer using 43,200 processes.     

Sparse grid spaces for the numerical solution of the electronic Schrödinger equation

This article complements the author’s recent work [Numer. Math. 98, 731–759 (2004)] on the regularity of the electronic Schrödinger equation in Hilbert spaces of mixed derivatives. It has been shown there that the solutions of this equation are surprisingly smooth and possess square integrable mixed weak derivatives of order up to N+1 with N the number of electrons across the singularities of the interaction potentials, and it has been claimed that this result can help to break the complexity barriers in computational quantum mechanics using correspondingly antisymmetrized sparse grid trial functions. A construction of this kind that can be interpreted as a sparse grid sampling theorem is sketched here.     

A Sparse Grid Stochastic Collocation Discontinuous Galerkin Method for Constrained Optimal Control Problem Governed by Random Convection Dominated Diffusion Equations

A sparse grid stochastic collocation method combined with discontinuous Galerkin method is developed for solving convection dominated diffusion optimal control problem with random coefficients. By the optimal control theory, an optimality system is obtained for the problem, which consists of a state equation, a co-state equation and an inequality. Based on finite dimensional noise assumption of random field, the random coefficients are assumed to have finite term expansions depending on a finite number of mutually independent random variables in the probability space. An approximation scheme is established by using a discontinuous Galerkin method for the physical space and a sparse grid stochastic collocation method based on the Smolyak construction for the probability space, which leads to the solution of uncoupled deterministic problems. A priori error estimates are derived for the state, co-state and control variables. Numerical experiments are presented to illustrate the theoretical results.     

Adaptive sparse grid algorithms with applications to electromagnetic scattering under uncertainty

We discuss adaptive sparse grid algorithms for stochastic differential equations with a particular focus on applications to electromagnetic scattering by structures with holes of uncertain size, location, and quantity. Stochastic collocation (SC) methods are used in combination with an adaptive sparse grid approach based on nested Gauss-Patterson grids. As an error estimator we demonstrate how the nested structure allows an effective error estimation through Richardson extrapolation. This is shown to allow excellent error estimation and it also provides an efficient means by which to estimate the solution at the next level of the refinement. We introduce an adaptive approach for the computation of problems with discrete random variables and demonstrate its efficiency for scattering problems with a random number of holes. The results are compared with results based on Monte Carlo methods and with Stroud based integration, confirming the accuracy and efficiency of the proposed techniques.     

Maxima and sum for discrete and continuous time Gaussian processes

We study the asymptotic relation among the maximum of continuous weakly and strongly dependent stationary Gaussian process, the maximum of this process sampled at discrete time points, and the partial sum of this process. It is shown that these two extreme values and the sum are asymptotically independent if the grid of the discrete time points is sufficiently sparse and the Gaussian process is weakly dependent, and asymptotically dependent if the grid points are Pickands grids or dense grids.     

Sparse Distance Weighted Discrimination

Distance weighted discrimination (DWD) was originally proposed to handle the data piling issue in the support vector machine. In this article, we consider the sparse penalized DWD for high-dimensional classification. The state-of-the-art algorithm for solving the standard DWD is based on second-order cone programming, however such an algorithm does not work well for the sparse penalized DWD with high-dimensional data. To overcome the challenging computation difficulty, we develop a very efficient algorithm to compute the solution path of the sparse DWD at a given fine grid of regularization parameters. We implement the algorithm in a publicly available R package sdwd. We conduct extensive numerical experiments to demonstrate the computational efficiency and classification performance of our method.     

Two-scale sparse finite element approximations

To reduce computational cost,we study some two-scale finite element approximations on sparse grids for elliptic partial differential equations of second order in a general setting.Over any tensor product domain ?R~d with d = 2,3,we construct the two-scale finite element approximations for both boundary value and eigenvalue problems by using a Boolean sum of some existing finite element approximations on a coarse grid and some univariate fine grids and hence they are cheaper approximations.As applications,we obtain some new efficient finite element discretizations for the two classes of problem:The new two-scale finite element approximation on a sparse grid not only has the less degrees of freedom but also achieves a good accuracy of approximation.