Processing of experimental curves by applying a regularized double period method

In physical and engineering applications, an important task is the processing of experimental curves measured with considerable errors. Such problems are solved by applying the regularization method, in which success relies heavily on the researcher’s intuition. We propose using an approximation based on the double period method designed for smooth aperiodic functions. Regularization makes use of a Tikhonov stabilizer with the second derivative squared. As a result, the spurious oscillations are suppressed and the shape of an experimental curve is well approximated. This approach makes it possible to solve broad classes of problems in a unified manner. The method is demonstrated as applied to the approximation of cross sections of nuclear reactions important for controlled thermonuclear fusion. Tables recommended as reference data are obtained.     

GCV for Tikhonov regularization via global Golub–Kahan decomposition

Generalized cross validation is a popular approach to determining the regularization parameter in Tikhonov regularization. The regularization parameter is chosen by minimizing an expression, which is easy to evaluate for small‐scale problems, but prohibitively expensive to compute for large‐scale ones. This paper describes a novel method, based on Gauss‐type quadrature, for determining upper and lower bounds for the desired expression. These bounds are used to determine the regularization parameter for large‐scale problems. Computed examples illustrate the performance of the proposed method and demonstrate its competitiveness. Copyright © 2016 John Wiley & Sons, Ltd.     

Adaptive optimal control of Signorini’s problem

In this article, we present a-posteriori error estimations in context of optimal control of contact problems; in particular of Signorini’s problem. Due to the contact side-condition, the solution operator of the underlying variational inequality is not differentiable, yet we want to apply Newton’s method. Therefore, the non-smooth problem is regularized by penalization and afterwards discretized by finite elements. We derive optimality systems for the regularized formulation in the continuous as well as in the discrete case. This is done explicitly for Signorini’s contact problem, which covers linear elasticity and linearized surface contact conditions. The latter creates the need for treating trace-operations carefully, especially in contrast to obstacle contact conditions, which exert in the domain. Based on the dual weighted residual method and these optimality systems, we deduce error representations for the regularization, discretization and numerical errors. Those representations are further developed into error estimators. The resulting error estimator for regularization error is defined only in the contact area. Therefore its computational cost is especially low for Signorini’s contact problem. Finally, we utilize the estimators in an adaptive refinement strategy balancing regularization and discretization errors. Numerical results substantiate the theoretical findings. We present different examples concerning Signorini’s problem in two and three dimensions.     

Old and new parameter choice rules for discrete ill-posed problems

Linear discrete ill-posed problems are difficult to solve numerically because their solution is very sensitive to perturbations, which may stem from errors in the data and from round-off errors introduced during the solution process. The computation of a meaningful approximate solution requires that the given problem be replaced by a nearby problem that is less sensitive to disturbances. This replacement is known as regularization. A regularization parameter determines how much the regularized problem differs from the original one. The proper choice of this parameter is important for the quality of the computed solution. This paper studies the performance of known and new approaches to choosing a suitable value of the regularization parameter for the truncated singular value decomposition method and for the LSQR iterative Krylov subspace method in the situation when no accurate estimate of the norm of the error in the data is available. The regularization parameter choice rules considered include several L-curve methods, Regińska’s method and a modification thereof, extrapolation methods, the quasi-optimality criterion, rules designed for use with LSQR, as well as hybrid methods.     

A “Nonconvex+Nonconvex” approach for image restoration with impulse noise removal

In this paper, we propose a new method for image restoration problems, which are degraded by impulsive noise, with nonconvex data fitting term and nonconvex regularizer.The proposed method possesses the advantages of nonconvex data fitting and nonconvex regularizer simultaneously, namely, robustness for impulsive noise and efficiency for restoring neat edge images.Further, we propose an efficient algorithm to solve the “Nonconvex+Nonconvex” structure problem via using the alternating direction minimization, and prove that the algorithm is globally convergent when the regularization parameter is known. However, the regularization parameter is unavailable in general. Thereby, we combine the algorithm with the continuation technique and modified Morozov’s discrepancy principle to get an improved algorithm in which a suitable regularization parameter can be chosen automatically. The experiments reveal the superior performances of the proposed algorithm in comparison with some existing methods.     

Augmented Lagrangian Homotopy Method for the Regularization of Total Variation Denoising Problems

This paper presents a homotopy procedure which improves the solvability of mathematical programming problems arising from total variational methods for image denoising. The homotopy on the regularization parameter involves solving a sequence of equality-constrained optimization problems where the positive regularization parameter in each optimization problem is initially large and is reduced to zero. Newton’s method is used to solve the optimization problems and numerical results are presented.     

Holomorphic Regularization of Singular Perturbations in a Banach Space

The holomorphic regularization method, which is a natural extension of Lomov’s regularization method, is used to solve strongly nonlinear singularly perturbed equations in Banach spaces. The existence of pseudoholomorphic solutions of such equations is proved, and the analytic properties of their Galerkin approximations are studied.     

Discretized Lavrent’ev regularization for the autoconvolution equation

Lavrent’ev regularization for the autoconvolution equation was considered by Janno J. in Lavrent’ev regularization of ill-posed problems containing nonlinear near-to-monotone operators with application to autoconvolution equation, Inverse Prob. 2000;16:333–348. Here this study is extended by considering discretization of the Lavrent’ev scheme by splines. It is shown how to maintain the known convergence rate by an appropriate choice of spline spaces and a proper choice of the discretization level. For piece-wise constant splines the discretized equation allows for an explicit solver, in contrast to using higher order splines. This is used to design a fast implementation by means of post-smoothing, which provides results, which are indistinguishable from results obtained by direct discretization using cubic splines.     

Identification of distributed systems and the theory of the regularization

The identification problems, i.e., the problems of finding unknown parameters in distributed systems from the observations are very important in modern control theory. The solutions of these identification problems can be obtained by solving the equations of the first kind. However, the solutions are often unstable. In other words, they are not continuously dependent on the data. The regularization or Tihonov's regularization is known as one of the stabilizing algorithms to solve these non well-posed problems. In this paper is studied the regularization method for identification of distributed systems. Several approximation theorems are proved to solve the equations of the first kind. Then, identification problems are reduced to the minimization of quadratic cost functionals by virtue of these theorems. On the other hand, it is known that the statistical methods for identification such as the maximum likelihood lead to the minimization problems of certain quadratic functionals. Comparing these quadratic cost functionals, the relations between the regularization and the statistical methods are discussed. Further, numerical examples are given to show the effectiveness of this method.     

Three-level schemes of the alternating triangular method

In this paper, the schemes of the alternating triangular method are set out in the class of splitting methods used for the approximate solution of Cauchy problems for evolutionary problems. These schemes are based on splitting the problem operator into two operators that are conjugate transposes of each other. Economical schemes for the numerical solution of boundary value problems for parabolic equations are designed on the basis of an explicit-implicit splitting of the problem operator. The alternating triangular method is also of interest for the construction of numerical algorithms that solve boundary value problems for systems of partial differential equations and vector systems. The conventional schemes of the alternating triangular method used for first-order evolutionary equations are two-level ones. The approximation properties of such splitting methods can be improved by transiting to three-level schemes. Their construction is based on a general principle for improving the properties of difference schemes, namely, on the regularization principle of A.A. Samarskii. The analysis conducted in this paper is based on the general stability (or correctness) theory of operator-difference schemes.     

L1 regularization method in electrical impedance tomography by using the L1-curve (Pareto frontier curve)

Electrical impedance tomography (EIT), as an inverse problem, aims to calculate the internal conductivity distribution at the interior of an object from current-voltage measurements on its boundary. Many inverse problems are ill-posed, since the measurement data are limited and imperfect. To overcome ill-posedness in EIT, two main types of regularization techniques are widely used. One is categorized as the projection methods, such as truncated singular value decomposition (SVD or TSVD). The other categorized as penalty methods, such as Tikhonov regularization, and total variation methods. For both of these methods, a good regularization parameter should yield a fair balance between the perturbation error and regularized solution. In this paper a new method combining the least absolute shrinkage and selection operator (LASSO) and the basis pursuit denoising (BPDN) is introduced for EIT. For choosing the optimum regularization we use the L1-curve (Pareto frontier curve) which is similar to the L-curve used in optimising L2-norm problems. In the L1-curve we use the L1-norm of the solution instead of the L2 norm. The results are compared with the TSVD regularization method where the best regularization parameters are selected by observing the Picard condition and minimizing generalized cross validation (GCV) function. We show that this method yields a good regularization parameter corresponding to a regularized solution. Also, in situations where little is known about the noise level σ, it is also useful to visualize the L1-curve in order to understand the trade-offs between the norms of the residual and the solution. This method gives us a means to control the sparsity and filtering of the ill-posed EIT problem. Tracing this curve for the optimum solution can decrease the number of iterations by three times in comparison with using LASSO or BPDN separately.     

A regularization method for solving the Cauchy problem for the Helmholtz equation

In this paper, we investigate a Cauchy problem associated with Helmholtz-type equation in an infinite “strip”. This problem is well known to be severely ill-posed. The optimal error bound for the problem with only nonhomogeneous Neumann data is deduced, which is independent of the selected regularization methods. A framework of a modified Tikhonov regularization in conjunction with the Morozov’s discrepancy principle is proposed, it may be useful to the other linear ill-posed problems and helpful for the other regularization methods. Some sharp error estimates between the exact solutions and their regularization approximation are given. Numerical tests are also provided to show that the modified Tikhonov method works well.     

Inverse final observation problems for Maxwell’s equations in the quasi-stationary magnetic approximation and stable sequential Lagrange principles for their solving

An initial–boundary value problem for Maxwell’s equations in the quasi-stationary magnetic approximation is investigated. Special gauge conditions are presented that make it possible to state the problem of independently determining the vector magnetic potential. The well-posedness of the problem is proved under general conditions on the coefficients. For quasi-stationary Maxwell equations, final observation problems formulated in terms of the vector magnetic potential are considered. They are treated as convex programming problems in a Hilbert space with an operator equality constraint. Stable sequential Lagrange principles are stated in the form of theorems on the existence of a minimizing approximate solution of the optimization problems under consideration. The possibility of applying algorithms of dual regularization and iterative dual regularization with a stopping rule is justified in the case of a finite observation error.     

约束Fractional Tikhonov正则化的模迭代方法

反问题是现在数学物理研究中的一个热点问题,而反问题求解面临的一个本质性困难是不适定性。求解不适定问题的普遍方法是:用与原不适定问题相“邻近”的适定问题的解去逼近原问题的解,这种方法称为正则化方法.如何建立有效的正则化方法是反问题领域中不适定问题研究的重要内容.当前,最为流行的正则化方法有基于变分原理的Tikhonov正则化及其改进方法,此类方法是求解不适定问题的较为有效的方法,在各类反问题的研究中被广泛采用,并得到深入研究.     

SAA-regularized methods for multiproduct price optimization under the pure characteristics demand model

Utility-based choice models are often used to determine a consumer’s purchase decision among a list of available products; to provide an estimate of product demands; and, when data on purchase decisions or market shares are available, to infer consumers’ preferences over observed product characteristics. These models also serve as a building block in modeling firms’ pricing and assortment optimization problems. We consider a firm’s multiproduct pricing problem, in which product demands are determined by a pure characteristics model. A sample average approximation (SAA) method is used to approximate the expected market share of products and the firm profit. We propose an SAA-regularized method for the multiproduct price optimization problem. We present convergence analysis and numerical examples to show the efficiency and the effectiveness of the proposed method.     

Joint additive Kullback–Leibler residual minimization and regularization for linear inverse problems

For the approximate solution of ill‐posed inverse problems, the formulation of a regularization functional involves two separate decisions: the choice of the residual minimizer and the choice of the regularizor. In this paper, the Kullback–Leibler functional is used for both. The resulting regularization method can solve problems for which the operator and the observational data are positive along with the solution, as occur in many inverse problem applications. Here, existence, uniqueness, convergence and stability for the regularization approximations are established under quite natural regularity conditions. Convergence rates are obtained by using an a priori strategy. Copyright © 2007 John Wiley & Sons, Ltd.     

The regularization method for an obstacle problem

Summary. We give a relatively complete analysis for the regularization method, which is usually used in solving non-differentiable minimization problems. The model problem considered in the paper is an obstacle problem. In addition to the usual convergence result and a-priori error estimates, we provide a-posteriori error estimates which are highly desired for practical implementation of the regularization method. Received March 22, 1993 / Revised version received October 11, 1993     

Two-Stage Method of Construction of Regularizing Algorithms for Nonlinear Ill-Posed Problems

For an equation with a nonlinear differentiable operator acting in a Hilbert space, we study a two-stage method of construction of a regularizing algorithm. First, we use the Lavrentiev regularization scheme. Then we apply to the regularized equation either Newton’s method or nonlinear analogs of α-processes: the minimum error method, the minimum residual method, and the steepest descent method. For these processes, we establish the linear convergence rate and the Fejér property of iterations. Two cases are considered: when the operator of the problem is monotone and when the operator is finite-dimensional and its derivative has nonnegative spectrum. For the two-stage method with a monotone operator, we give an error bound, which has optimal order on the class of sourcewise representable solutions. In the second case, the error of the method is estimated by means of the residual. The proposed methods and their modified analogs are implemented numerically for three-dimensional inverse problems of gravimetry and magnetometry. The results of the numerical experiment are discussed.     

An improved iteration regularization method and application to reconstruction of dynamic loads on a plate

We present an improved iteration regularization method for solving linear inverse problems. The algorithm considered here is detailedly given and proved that the computational costs for the proposed method are nearly the same as the Landweber iteration method, yet the number of iteration steps by the present method is even less. Meanwhile, we obtain the optimum asymptotic convergence order of the regularized solution by choosing a posterior regularization parameter based on Morozov’s discrepancy principle, and the present method is applied to the identification of the multi-source dynamic loads on a surface of the plate. Numerical simulations of two examples demonstrate the effectiveness and robustness of the present method.     

Updating the regularization parameter in the adaptive cubic regularization algorithm

The adaptive cubic regularization method (Cartis et al. in Math. Program. Ser. A 127(2):245?C295, 2011; Math. Program. Ser. A. 130(2):295?C319, 2011) has been recently proposed for solving unconstrained minimization problems. At each iteration of this method, the objective function is replaced by a cubic approximation which comprises an adaptive regularization parameter whose role is related to the local Lipschitz constant of the objective??s Hessian. We present new updating strategies for this parameter based on interpolation techniques, which improve the overall numerical performance of the algorithm. Numerical experiments on large nonlinear least-squares problems are provided.