The Tikhonov regularization extended to equilibrium problems involving pseudomonotone bifunctions

We extend the Tikhonov regularization method widely used in optimization and monotone variational inequality studies to equilibrium problems. It is shown that the convergence results obtained from the monotone variational inequality remain valid for the monotone equilibrium problem. For pseudomonotone equilibrium problems, the Tikhonov regularized subproblems have a unique solution only in the limit, but any Tikhonov trajectory tends to the solution of the original problem, which is the unique solution of the strongly monotone equilibrium problem defined on the basis of the regularization bifunction.     

约束Fractional Tikhonov正则化的模迭代方法

反问题是现在数学物理研究中的一个热点问题,而反问题求解面临的一个本质性困难是不适定性。求解不适定问题的普遍方法是:用与原不适定问题相“邻近”的适定问题的解去逼近原问题的解,这种方法称为正则化方法.如何建立有效的正则化方法是反问题领域中不适定问题研究的重要内容.当前,最为流行的正则化方法有基于变分原理的Tikhonov正则化及其改进方法,此类方法是求解不适定问题的较为有效的方法,在各类反问题的研究中被广泛采用,并得到深入研究.     

Tikhonov Regularization of Large Linear Problems

Many numerical methods for the solution of linear ill-posed problems apply Tikhonov regularization. This paper presents a new numerical method, based on Lanczos bidiagonalization and Gauss quadrature, for Tikhonov regularization of large-scale problems. An estimate of the norm of the error in the data is assumed to be available. This allows the value of the regularization parameter to be determined by the discrepancy principle.     

A new Tikhonov regularization method

The numerical solution of linear discrete ill-posed problems typically requires regularization, i.e., replacement of the available ill-conditioned problem by a nearby better conditioned one. The most popular regularization methods for problems of small to moderate size, which allow evaluation of the singular value decomposition of the matrix defining the problem, are the truncated singular value decomposition and Tikhonov regularization. The present paper proposes a novel choice of regularization matrix for Tikhonov regularization that bridges the gap between Tikhonov regularization and truncated singular value decomposition. Computed examples illustrate the benefit of the proposed method.     

Iterated Tikhonov regularization with a general penalty term

Tikhonov regularization is one of the most popular approaches to solving linear discrete ill‐posed problems. The choice of the regularization matrix may significantly affect the quality of the computed solution. When the regularization matrix is the identity, iterated Tikhonov regularization can yield computed approximate solutions of higher quality than (standard) Tikhonov regularization. This paper provides an analysis of iterated Tikhonov regularization with a regularization matrix different from the identity. Computed examples illustrate the performance of this method.     

Extragradient and linesearch methods for solving split feasibility problems in Hilbert spaces

Utilizing the Tikhonov regularization method and extragradient and linesearch methods, some new extragradient and linesearch algorithms have been introduced in the framework of Hilbert spaces. In the presented algorithms, the convexity of optimization subproblems is assumed, which is weaker than the strong convexity assumption that is usually supposed in the literature, and also, the auxiliary equilibrium problem is not used. Some strong convergence theorems for the sequences generated by these algorithms have been proven. It has been shown that the limit point of the generated sequences is a common element of the solution set of an equilibrium problem and the solution set of a split feasibility problem in Hilbert spaces. To illustrate the usability of our results, some numerical examples are given. Optimization subproblems in these examples have been solved by FMINCON toolbox in MATLAB.     

Tikhonov regularization method for a backward problem for the time-fractional diffusion equation

This paper is devoted to solve a backward problem for a time-fractional diffusion equation with variable coefficients in a general bounded domain by the Tikhonov regularization method. Based on the eigenfunction expansion of the solution, the backward problem for searching the initial data is changed to solve a Fredholm integral equation of the first kind. The conditional stability for the backward problem is obtained. We use the Tikhonov regularization method to deal with the integral equation and obtain the series expression of solution. Furthermore, the convergence rates for the Tikhonov regularized solution can be proved by using an a priori regularization parameter choice rule and an a posteriori regularization parameter choice rule. Two numerical examples in one-dimensional and two-dimensional cases respectively are investigated. Numerical results show that the proposed method is effective and stable.     

Regularisierung schlecht gestellter Probleme durch Projektionsverfahren

Summary The numerical solution of ill-posed problems by projection methods is considered. Regularization is carried out simply by choosing an optimal discretization parameter. It is shown by asymptotic estimates and by numerical examples that this kind of regularization is as efficient as the method of Tikhonov and Phillips.

     

On the choice of solution subspace for nonstationary iterated Tikhonov regularization

Tikhonov regularization is a popular method for the solution of linear discrete ill-posed problems with error-contaminated data. Nonstationary iterated Tikhonov regularization is known to be able to determine approximate solutions of higher quality than standard Tikhonov regularization. We investigate the choice of solution subspace in iterative methods for nonstationary iterated Tikhonov regularization of large-scale problems. Generalized Krylov subspaces are compared with Krylov subspaces that are generated by Golub–Kahan bidiagonalization and the Arnoldi process. Numerical examples illustrate the effectiveness of the methods.     

A coupled complex boundary method for an inverse conductivity problem with one measurement

We recently proposed in [Cheng, XL et al. A novel coupled complex boundary method for inverse source problems Inverse Problem 2014 30 055002] a coupled complex boundary method (CCBM) for inverse source problems. In this paper, we apply the CCBM to inverse conductivity problems (ICPs) with one measurement. In the ICP, the diffusion coefficient q is to be determined from both Dirichlet and Neumann boundary data. With the CCBM, q is sought such that the imaginary part of the solution of a forward Robin boundary value problem vanishes in the problem domain. This brings in advantages on robustness and computation in reconstruction. Based on the complex forward problem, the Tikhonov regularization is used for a stable reconstruction. Some theoretical analysis is given on the optimization models. Several numerical examples are provided to show the feasibility and usefulness of the CCBM for the ICP. It is illustrated that as long as all the subdomains share some portion of the boundary, our CCBM-based Tikhonov regularization method can reconstruct the diffusion parameters stably and effectively.     

A Regularized Newton-Like Method for Nonlinear PDE

An adaptive regularization strategy for stabilizing Newton-like iterations on a coarse mesh is developed in the context of adaptive finite element methods for nonlinear PDE. Existence, uniqueness and approximation properties are known for finite element solutions of quasilinear problems assuming the initial mesh is fine enough. Here, an adaptive method is started on a coarse mesh where the finite element discretization and quadrature error produce a sequence of approximate problems with indefinite and ill-conditioned Jacobians. The methods of Tikhonov regularization and pseudo-transient continuation are related and used to define a regularized iteration using a positive semidefinite penalty term. The regularization matrix is adapted with the mesh refinements and its scaling is adapted with the iterations to find an approximate sequence of coarse-mesh solutions leading to an efficient approximation of the PDE solution. Local q-linear convergence is shown for the error and the residual in the asymptotic regime and numerical examples of a model problem illustrate distinct phases of the solution process and support the convergence theory.     

一种带噪声的周期函数数值微分方法

本文利用Thkhonov正则化方法讨论了带有噪声离散数据的周期函数的数值微分问题,证明了该方法存在唯一的三次周期样条函数解,并给出了其误差估计,而且从理论和数值例子说明了此方法的有效性．     

An implicit Landweber method for nonlinear ill-posed operator equations

In this paper, we are interested in the solution of nonlinear inverse problems of the form F(x)=y. We propose an implicit Landweber method, which is similar to the third-order midpoint Newton method in form, and consider the convergence behavior of the implicit Landweber method. Using the discrepancy principle as a stopping criterion, we obtain a regularization method for ill-posed problems. We conclude with numerical examples confirming the theoretical results, including comparisons with the classical Landweber iteration and presented modified Landweber methods.     

The fractional Tikhonov regularization method for simultaneous inversion of the source term and initial value in a space-fractional Allen-Cahn equation

In this paper, we consider the inverse problem for identifying the source term and initial value simultaneously in a space-fractional Allen-Cahn equation. This problem is ill-posed, i.e., the solution of this problem does not depend continuously on the data. The fractional Tikhonov method is used to solve this problem. Under the a priori and the a posteriori regularization parameter choice rules, the error estimates between the regularization solutions and the exact solutions are obtained, respectively. Different numerical examples are presented to illustrate the validity and effectiveness of our method.     

Solving an inverse problem for a generalized time-delayed Burgers-Fisher equation by Haar wavelet method

In this paper, a numerical method consists of combining Haar wavelet method and Tikhonov regularization method to determine unknown boundary condition and unknown nonlinear source term for the generalized time-delayed Burgers-Fisher equation using noisy data is presented. A stable numerical solution is determined for the problem. We also show that the rate of convergence of the method is as exponential $\Bigl(O\left(\frac{1}{2^{J+1}}\right)\Bigr)$, where $J$ is maximal level of resolution of wavelet. Some numerical results are reported to show the efficiency and robustness of the proposed approach for solving the inverse problems.     

Helmholtz方程Cauchy问题的间接积分方程方法

 本文处理二维和三维Helmholtz方程的边界数据复原问题.通过利用位势理论近似问题的解,导出了解决Cauchy问题的一种非迭代积分方程方法.为了处理形成问题的不适定性,采用了Tikhonov正则化结合Morozov偏差原理的方法,并且给出了算法的收敛性和误差估计,最后给出了二维和三维的数值算例.通过数值算例我们检验了源点和边界之间距离的关系,算法关于噪声、源点数目的数值收敛性,稳定性.     

A Joint Tikhonov Regularization and Augmented Lagrange Approach for Ill-Posed State Constrained Control Problems with Sparse Controls

Abstract

We provide a modified augmented Lagrange method coupled with a Tikhonov regularization for solving ill-posed state constrained elliptic optimal control problems with sparse controls. We consider a linear quadratic optimal control problem without any additional L² regularization terms. The sparsity is guaranteed by an additional L¹ term. Here, the modification of the classical augmented Lagrange method guarantees us uniform boundedness of the multiplier that corresponds to the state constraints. We present a coupling between the regularization parameter introduced by the Tikhonov regularization and the penalty parameter from the augmented Lagrange method, which allows us to prove strong convergence of the controls and their corresponding states. Moreover, convergence results proving the weak convergence of the adjoint state and weak*-convergence of the multiplier are provided. Finally, we demonstrate our method in several numerical examples.     

The residual method for regularizing ill-posed problems

Although the residual method, or constrained regularization, is frequently used in applications, a detailed study of its properties is still missing. This sharply contrasts the progress of the theory of Tikhonov regularization, where a series of new results for regularization in Banach spaces has been published in the recent years. The present paper intends to bridge the gap between the existing theories as far as possible. We develop a stability and convergence theory for the residual method in general topological spaces. In addition, we prove convergence rates in terms of (generalized) Bregman distances, which can also be applied to non-convex regularization functionals.We provide three examples that show the applicability of our theory. The first example is the regularized solution of linear operator equations on L^p-spaces, where we show that the results of Tikhonov regularization generalize unchanged to the residual method. As a second example, we consider the problem of density estimation from a finite number of sampling points, using the Wasserstein distance as a fidelity term and an entropy measure as regularization term. It is shown that the densities obtained in this way depend continuously on the location of the sampled points and that the underlying density can be recovered as the number of sampling points tends to infinity. Finally, we apply our theory to compressed sensing. Here, we show the well-posedness of the method and derive convergence rates both for convex and non-convex regularization under rather weak conditions.     

A new variant of L-curve for Tikhonov regularization

In this paper we introduce a new variant of L-curve to estimate the Tikhonov regularization parameter for the regularization of discrete ill-posed problems. This method uses the solution norm versus the regularization parameter. The numerical efficiency of this new method is also discussed by considering some test problems.     

A numerical study of the SVD–MFS solution of inverse boundary value problems in two‐dimensional steady‐state linear thermoelasticity

We study the reconstruction of the missing thermal and mechanical data on an inaccessible part of the boundary in the case of two‐dimensional linear isotropic thermoelastic materials from overprescribed noisy measurements taken on the remaining accessible boundary part. This inverse problem is solved by using the method of fundamental solutions together with the method of particular solutions. The stabilization of this inverse problem is achieved using several singular value decomposition (SVD)‐based regularization methods, such as the Tikhonov regularization method (Tikhonov and Arsenin, Methods for solving ill‐posed problems, Nauka, Moscow, 1986), the damped SVD and the truncated SVD (Hansen, Rank‐deficient and discrete ill‐posed problems: numerical aspects of linear inversion, SIAM, Philadelphia, 1998), whilst the optimal regularization parameter is selected according to the discrepancy principle (Morozov, Sov Math Doklady 7 (1966), 414–417), generalized cross‐validation criterion (Golub et al. Technometrics 22 (1979), 1–35) and Hansen's L‐curve method (Hansen and O'Leary, SIAM J Sci Comput 14 (1993), 1487–503). © 2014 Wiley Periodicals, Inc. Numer Methods Partial Differential Eq 31: 168–201, 2015