A dynamic meshless method for the least squares problem with some noisy subdomains

The interpolation method by radial basis functions is used widely for solving scattered data approximation. However, sometimes it makes more sense to approximate the solution by least squares fit. This is especially true when the data are contaminated with noise. A meshfree method namely, meshless dynamic weighted least squares (MDWLS) method, is presented in this paper to solve least squares problems with noise. The MDWLS method by Gaussian radial basis function is proposed to fit scattered data with some noisy areas in the problem’s domain. Existence and uniqueness of a solution is proved. This method has one parameter which can adjusts the accuracy according to the size of noises. Another advantage of the developed method is that it can be applied to problems with nonregular geometrical domains. The new approach is applied for some problems in two dimensions and the obtained results confirm the accuracy and efficiency of the proposed method. The numerical experiments illustrate that our MDWLS method has better performance than the traditional least squares method in case of noisy data.     

Scattered data fitting of Hermite type by a weighted meshless method

In many practical problems, it is often desirable to interpolate not only the function values but also the values of derivatives up to certain order, as in the Hermite interpolation. The Hermite interpolation method by radial basis functions is used widely for solving scattered Hermite data approximation problems. However, sometimes it makes more sense to approximate the solution by a least squares fit. This is particularly true when the data are contaminated with noise. In this paper, a weighted meshless method is presented to solve least squares problems with noise. The weighted meshless method by Gaussian radial basis functions is proposed to fit scattered Hermite data with noise in certain local regions of the problem’s domain. Existence and uniqueness of the solution is proved. This approach has one parameter which can adjust the accuracy according to the size of the noise. Another advantage of the weighted meshless method is that it can be used for problems in high dimensions with nonregular domains. The numerical experiments show that our weighted meshless method has better performance than the traditional least squares method in the case of noisy Hermite data.     

Weighted least squares solutions to general coupled Sylvester matrix equations

This paper is concerned with weighted least squares solutions to general coupled Sylvester matrix equations. Gradient based iterative algorithms are proposed to solve this problem. This type of iterative algorithm includes a wide class of iterative algorithms, and two special cases of them are studied in detail in this paper. Necessary and sufficient conditions guaranteeing the convergence of the proposed algorithms are presented. Sufficient conditions that are easy to compute are also given. The optimal step sizes such that the convergence rates of the algorithms, which are properly defined in this paper, are maximized and established. Several special cases of the weighted least squares problem, such as a least squares solution to the coupled Sylvester matrix equations problem, solutions to the general coupled Sylvester matrix equations problem, and a weighted least squares solution to the linear matrix equation problem are simultaneously solved. Several numerical examples are given to illustrate the effectiveness of the proposed algorithms.     

A collocation method of lines for two‐sided space‐fractional advection‐diffusion equations with variable coefficients

We present the method of lines (MOL), which is based on the spectral collocation method, to solve space‐fractional advection‐diffusion equations (SFADEs) on a finite domain with variable coefficients. We focus on the cases in which the SFADEs consist of both left‐ and right‐sided fractional derivatives. To do so, we begin by introducing a new set of basis functions with some interesting features. The MOL, together with the spectral collocation method based on the new basis functions, are successfully applied to the SFADEs. Finally, four numerical examples, including benchmark problems and a problem with discontinuous advection and diffusion coefficients, are provided to illustrate the efficiency and exponentially accuracy of the proposed method.     

An efficient meshfree point collocation moving least squares method to solve the interface problems with nonhomogeneous jump conditions

We are going to study a simple and effective method for the numerical solution of the closed interface boundary value problem with both discontinuities in the solution and its derivatives. It uses a strong‐form meshfree method based on the moving least squares (MLS) approximation. In this method, for the solution of elliptic equation, the second‐order derivatives of the shape functions are needed in constructing the global stiffness matrix. It is well‐known that the calculation of full derivatives of the MLS approximation, especially in high dimensions, is quite costly. In the current work, we apply the diffuse derivatives using an efficient technique. In this technique, we calculate the higher‐order derivatives using the approximation of lower‐order derivatives, instead of calculating directly derivatives. This technique can improve the accuracy of meshfree point collocation method for interface problems with nonhomogeneous jump conditions and can efficiently estimate diffuse derivatives of second‐ and higher‐orders using only linear basis functions. To introduce the appropriate discontinuous shape functions in the vicinity of interface, we choose the visibility criterion method that modifies the support of weight function in MLS approximation and leads to an efficient computational procedure for the solution of closed interface problems. The proposed method is applied for elliptic and biharmonic interface problems. For the biharmonic equation, we use a mixed scheme, which replaces this equation by a coupled elliptic system. Also the application of the present method to elasticity equation with discontinuities in the coefficients across a closed interface has been provided. Representative numerical examples demonstrate the accuracy and robustness of the proposed methodology for the closed interface problems. © 2014 Wiley Periodicals, Inc. Numer Methods Partial Differential Eq 31: 1031–1053, 2015     

An adaptive spectral least-squares scheme for the Burgers equation

A least-squares spectral collocation method for the one-dimensional inviscid Burgers equation is proposed. This model problem shows the stability and high accuracy of these schemes for nonlinear hyperbolic scalar equations. Here we make use of a least-squares spectral approach which was already used in an earlier paper for discontinuous and singular perturbation problems (Heinrichs, J. Comput. Appl. Math. 157:329–345, 2003). The domain is decomposed in subintervals where continuity is enforced at the interfaces. Equal order polynomials are used on all subdomains. For the spectral collocation scheme Chebyshev polynomials are employed which allow the efficient implementation with Fast Fourier Transforms (FFTs). The collocation conditions and the interface conditions lead to an overdetermined system which can be efficiently solved by least-squares. The solution technique will only involve symmetric positive definite linear systems. The scheme exhibits exponential convergence where the exact solution is smooth. In parts of the domain where the solution contains discontinuities (shocks) the spectral solution displays a Gibbs-like behavior. Here this is overcome by some suitable exponential filtering at each time level. Here we observe that by over-collocation the results remain stable also for increasing filter parameters and also without filtering. Furthermore by an adaptive grid refinement we were able to locate the precise position of the discontinuity. Numerical simulations confirm the high accuracy of our spectral least-squares scheme.      

Smooth solution of partial integro-differential equations using radial basis functions

In this work, we present the method based on radial basis functions to solve partial integro-differential equations. We focus on the parabolic type of integro-differential equations as the most common forms including the ``\emph{memory}'' of the systems. We propose to apply the collocation scheme using radial basis functions to approximate the solutions of partial integro-differential equations. Due to the presented technique, system of linear or nonlinear equations is made instead of primary problem. The method is efficient because the rate of convergence of collocation method based on radial basis functions is exponential. Some numerical examples and investigation of the experimental results show the applicability and accuracy of the method.     

Least-squares spectral collocation with the overlapping Schwarz method for the incompressible Navier–Stokes equations

A least-squares spectral collocation scheme is combined with the overlapping Schwarz method. The methods are succesfully applied to the incompressible Navier–Stokes equations. The collocation conditions and the interface conditions lead to an overdetermined system which can be efficiently solved by least-squares. The solution technique will only involve symmetric positive definite linear systems. The overlapping Schwarz method is used for the iterative solution. For parallel implementation the subproblems are solved in a checkerboard manner. Our approach is successfully applied to the lid-driven cavity flow problem. Only a few Schwarz iterations are necessary in each time step. Numerical simulations confirm the high accuracy of our spectral least-squares scheme.     

On the solution of the non-local parabolic partial differential equations via radial basis functions

In this paper, the problem of solving the one-dimensional parabolic partial differential equation subject to given initial and non-local boundary conditions is considered. The approximate solution is found using the radial basis functions collocation method. There are some difficulties in computing the solution of the time dependent partial differential equations using radial basis functions. If time and space are discretized using radial basis functions, the resulted coefficient matrix will be very ill-conditioned and so the corresponding linear system cannot be solved easily. As an alternative method for solution, we can use finite-difference methods for discretization of time and radial basis functions for discretization of space. Although this method is easy to use but an accurate solution cannot be provided. In this work an efficient collocation method is proposed for solving non-local parabolic partial differential equations using radial basis functions. Numerical results are presented and are compared with some existing methods.     

Spectral domain embedding for elliptic PDEs in complex domains

Spectral methods are a class of methods for solving partial differential equations (PDEs). When the solution of the PDE is analytic, it is known that the spectral solutions converge exponentially as a function of the number of modes used. The basic spectral method works only for regular domains such as rectangles or disks. Domain decomposition methods/spectral element methods extend the applicability of spectral methods to more complex geometries. An alternative is to embed the irregular domain into a regular one. This paper uses the spectral method with domain embedding to solve PDEs on complex geometry. The running time of the new algorithm has the same order as that for the usual spectral collocation method for PDEs on regular geometry. The algorithm is extremely simple and can handle Dirichlet, Neumann boundary conditions as well as nonlinear equations.     

Numerical solution of nonlinear Volterra-Fredholm-Hammerstein integral equations via collocation method based on radial basis functions

A numerical technique based on the spectral method is presented for the solution of nonlinear Volterra-Fredholm-Hammerstein integral equations. This method is a combination of collocation method and radial basis functions (RBFs) with the differentiation process (DRBF), using zeros of the shifted Legendre polynomial as the collocation points. Different applications of RBFs are used for this purpose. The integral involved in the formulation of the problems are approximated based on Legendre-Gauss-Lobatto integration rule. The results of numerical experiments are compared with the analytical solution in illustrative examples to confirm the accuracy and efficiency of the presented scheme.     

Meshless method with ridge basis functions

Meshless collocation methods for the numerical solutions of PDEs are increasingly adopted due to their advantages including efficiency and flexibility, and radial basis functions are popularly employed to represent the solutions of PDEs. Motivated by the advantages of ridge basis function representation of a given function, such as the connection to neural network, fast convergence as the number of terms is increased, better approximation effects and various applications in engineering problems, a meshless method is developed based on the collocation method and ridge basis function interpolation. This method is a truly meshless technique without mesh discretization: it neither needs the computation of integrals, nor requires a partition of the region and its boundary. Moreover, the method is applied to elliptic equations to examine its appropriateness, numerical results are compared to that obtained from other (meshless) methods, and influence factors of accuracy for numerical solutions are analyzed.     

A meshless method based on the moving least squares (MLS) approximation for the numerical solution of two-dimensional nonlinear integral equations of the second kind on non-rectangular domains

This paper investigates a numerical method for solving two-dimensional nonlinear Fredholm integral equations of the second kind on non-rectangular domains. The scheme utilizes the shape functions of the moving least squares (MLS) approximation constructed on scattered points as a basis in the discrete collocation method. The MLS methodology is an effective technique for approximating unknown functions which involves a locally weighted least square polynomial fitting. The proposed method is meshless, since it does not need any background mesh or cell structures and so it is independent of the geometry of the domain. The scheme reduces the solution of two-dimensional nonlinear integral equations to the solution of nonlinear systems of algebraic equations. The error analysis of the proposed method is provided. The efficiency and accuracy of the new technique are illustrated by several numerical examples.     

One‐step boundary knot method for discontinuous coefficient elliptic equations with interface jump conditions

This study makes the first attempt to apply the boundary knot method (BKM), a meshless collocation method, to the solution of linear elliptic problems with discontinuous coefficients, also known as the elliptic interface problems. The additional jump conditions are usually required to be prescribed at the interface which is used to maintain the well‐posedness of the considered problem. To solve the problem efficiently, the original governing equation is first transformed into an equivalent inhomogeneous modified Helmholtz equation in the present numerical formulation. Then the computational domain is divided into several subdomains, and the solution on each subdomain is approximated using the BKM approach. Unlike the conventional two‐step BKM, this study presents a one‐step BKM formulation which possesses merely one influence matrix for inhomogeneous problems. Several benchmark examples with various discontinuous coefficients have been tested to demonstrate the accuracy and efficiency of the present BKM scheme. © 2016Wiley Periodicals, Inc. Numer Methods Partial Differential Eq 32: 1509–1534, 2016     

A High-Order Kernel-Free Boundary Integral Method for Incompressible Flow Equations in Two Space Dimensions

This paper presents a fourth-order kernel-free boundary integral method for the time-dependent, incompressible Stokes and Navier-Stokes equations defined on irregular bounded domains. By the stream function-vorticity formulation, the incompressible flow equations are interpreted as vorticity evolution equations. Time discretization methods for the evolution equations lead to a modified Helmholtz equation for the vorticity, or alternatively, a modified biharmonic equation for the stream function with two clamped boundary conditions. The resulting fourth-order elliptic boundary value problem is solved by a fourth-order kernel-free boundary integral method, with which integrals in the reformulated boundary integral equation are evaluated by solving corresponding equivalent interface problems, regardless of the exact expression of the involved Green's function. To solve the unsteady Stokes equations, a four-stage composite backward differential formula of the same order accuracy is employed for time integration. For the Navier-Stokes equations, a three-stage third-order semi-implicit Runge-Kutta method is utilized to guarantee the global numerical solution has at least third-order convergence rate. Numerical results for the unsteady Stokes equations and the Navier-Stokes equations are presented to validate efficiency and accuracy of the proposed method.     

Numerical studies on nonlinear Schrödinger equations by spectral collocation method with preconditioning

In this study, we use the spectral collocation method with preconditioning to solve various nonlinear Schrödinger equations. To reduce round-off error in spectral collocation method we use preconditioning. We study the numerical accuracy of the method. The numerical results obtained by this way have been compared with the exact solution to show the efficiency of the method.     

Radial basis function Hermite collocation approach for the numerical simulation of the effect of precipitation inhibitor on the crystallization process of an over‐saturated solution

This work is concerned with the analysis of the effect of precipitation inhibitors on the growth of crystals from over‐saturated solutions, by the numerical simulation of the fundamental mechanisms of such crystallization process. The complete crystallization process in the presence of precipitation inhibitor is defined by a set of coupled partial differential equations that needs to be solved in a recursive manner, due to the inhibitor modification of the molar flux of the mineral at the crystal interface. This set of governing equations needs to satisfy the corresponding initial and boundary conditions of the problem where it is necessary to consider the additional unknown of a moving interface, i.e., the growing crystal surface. For the numerical solution of the proposed problem, we used a truly meshless numerical scheme based upon Hermite interpolation property of the radial basis functions. The use of a Hermitian meshless collocation numerical approach was selected in this work due to its flexibility on dealing with moving boundary problems and their high accuracy on predicting surface fluxes, which is a crucial part of the diffusion controlled crystallization process considered here. © 2005 Wiley Periodicals, Inc. Numer Methods Partial Differential Eq, 2006     

Spectral methods for some singularly perturbed third order ordinary differential equations

Spectral methods with interface point are presented to deal with some singularly perturbed third order boundary value problems of reaction-diffusion and convection-diffusion types. First, linear equations are considered and then non-linear equations. To solve non-linear equations, Newton’s method of quasi-linearization is applied. The problem is reduced to two systems of ordinary differential equations. And, then, each system is solved using spectral collocation methods. Our numerical experiments show that the proposed methods are produce highly accurate solutions in little computer time when compared with the other methods available in the literature.      

The use of a stable boundary analogue of the collocation method to approximate the solution of some problems in mechanics

To solve boundary-value problems for elliptic equations, the boundary analogue of the method of least squares is replaced by a boundary analogue of the collocation method. The change is made using a discrete representation of the scalar product in the spaces of functions which, in the case of a smooth boundary, are integrable with their square over the boundary of the region, and of functions which, in the case of a piecewise-linear boundary, are integrable with their square, when weighted, over the boundary of the region. The method used to choose the collocation points which ensure the collocation method to be stable is justified for the case of the Dirichlet problem.     

Numerical solutions of the Kawahara type equations using radial basis functions

This study is carried out to investigate the numerical solutions of the Kawahara, KdV‐Kawahara, and the modified Kawahara equations by using the meshless method based on collocation with radial basis functions. Results of the meshless method with different radial basis functions are presented for the travelling wave solution of the Kawahara type equations. © 2010 Wiley Periodicals, Inc. Numer Methods Partial Differential Eq 28: 542–553, 2012