Contingent derivatives and regularization for noncoercive inverse problems

Abstract

We study the inverse problem of parameter identification in noncoercive variational problems that commonly appear in applied models. We examine the differentiability of the set-valued parameter-to-solution map using the first-order and the second-order contingent derivatives. We explore the inverse problem using the output least-squares and the modified output least-squares objectives. By regularizing the noncoercive variational problem, we obtain a single-valued regularized parameter-to-solution map and investigate its smoothness and boundedness. We also consider optimization problems using the output least-squares and the modified output least-squares objectives for the regularized variational problem. We give a complete convergence analysis showing that for the output least-squares and the modified output least-squares, the regularized minimization problems approximate the original optimization problems suitably. We also provide the first-order and the second-order adjoint method for the computation of the first-order and the second-order derivatives of the output least-squares objective. We provide discrete formulas for the gradient and the Hessian calculation and present numerical results.     

一类正则化参数自由的线性约束凸优化问题的预测-校正算法

我们对文章的结构做这样的安排:第二节给出本文需要的预备知识;第三节简述单个目标函数问题(1.1)的己有算法和求解可能遇到的困难,第四节给出解决问题的预测-校正方法;第五节和第六节对问题(1.2)分别陈述己有方法的固有困难和我们提出的解决方案.最后,在第七节中,我们为提出的方法给出统一的算法框架,证明这类算法的收敛性和遍历意义下的收敛速率,同时给出我们的一些结论.     

约束Fractional Tikhonov正则化的模迭代方法

反问题是现在数学物理研究中的一个热点问题,而反问题求解面临的一个本质性困难是不适定性。求解不适定问题的普遍方法是:用与原不适定问题相“邻近”的适定问题的解去逼近原问题的解,这种方法称为正则化方法.如何建立有效的正则化方法是反问题领域中不适定问题研究的重要内容.当前,最为流行的正则化方法有基于变分原理的Tikhonov正则化及其改进方法,此类方法是求解不适定问题的较为有效的方法,在各类反问题的研究中被广泛采用,并得到深入研究.     

Analytical solution of stochastic differential equation by multilayer perceptron neural network approximation of Fokker–Planck equation

The Fokker–Planck equation is a useful tool to analyze the transient probability density function of the states of a stochastic differential equation. In this paper, a multilayer perceptron neural network is utilized to approximate the solution of the Fokker–Planck equation. To use unconstrained optimization in neural network training, a special form of the trial solution is considered to satisfy the initial and boundary conditions. The weights of the neural network are calculated by Levenberg–Marquardt training algorithm with Bayesian regularization. Three practical examples demonstrate the efficiency of the proposed method.     

Meshless acoustic analysis using a weakly singular Burton-Miller boundary integral formulation

The Burton-Miller boundary integral formulation is solved by a complex variable boundary element-free method (CVBEFM) for the boundary-only meshless analysis of acoustic problems with arbitrary wavenumbers. To regularize both strongly singular and hypersingular integrals and to avoid the computation of the solid angle and its normal derivative, a weakly singular Burton-Miller formulation is derived by considering the normal derivative of the solid angle and adopting the singularity subtraction procedures. To facilitate the implementation of the CVBEFM and the approximation of gradients of the boundary variables, a stabilized complex variable moving least-square approximation is selected in the meshless discretization procedure. The results show the accuracy and efficiency of the present CVBEFM and reveal that the method can produce satisfactory results for all wavenumbers, even for extremely large wavenumbers such as k = 10 000.     

TV‐like regularization for backward parabolic problems

This paper investigates an inverse problem for parabolic equations backward in time, which is solved by total‐variation‐like (TV‐like, in abbreviation) regularization method with cost function ∥u_x∥². The existence, uniqueness and stability estimate for the regularization problem are deduced in the linear case. For numerical illustration, the variational adjoint method, which presents a simple method to derive the gradient of the optimization functional, is introduced to reconstruct the unknown initial condition for both linear and nonlinear parabolic equations. The conjugate gradient method is used to iteratively search for the optimal approximation. Numerical results validate the feasibility and effectiveness of the proposed algorithm. Copyright © 2016 John Wiley & Sons, Ltd.     

Well‐posedness of initial boundary value problems on longitudinal impact on a composite linear viscoelastic bar

We investigate the correctness of the initial boundary value problem of longitudinal impact on a piecewise‐homogeneous semi‐infinite bar consisting of a semi‐infinite elastic part and finite length visco‐elastic part whose hereditary properties are described by linear integral relations with an arbitrary difference kernel. Introducing nonstationary regularization in boundary conditions and in the contact conditions, the well‐posedness of the considered problem is proved. Copyright © 2017 John Wiley & Sons, Ltd.     

Identification of source terms in wave equation with dynamic boundary conditions

This paper studies an inverse hyperbolic problem for the wave equation with dynamic boundary conditions. It consists of determining some forcing terms from the final overdetermination of the displacement. First, the Fréchet differentiability of the Tikhonov functional is studied, and a gradient formula is obtained via the solution of an associated adjoint problem. Then, the Lipschitz continuity of the gradient is proved. Furthermore, the existence and the uniqueness for the minimization problem are discussed. Finally, some numerical experiments for the reconstruction of an internal wave force are implemented via a conjugate gradient algorithm.     

Two-Phase Image Segmentation by Nonconvex Nonsmooth Models with Convergent Alternating Minimization Algorithms

Two-phase image segmentation is a fundamental task to partition an image into foreground and background. In this paper, two types of nonconvex and nonsmooth regularization models are proposed for basic two-phase segmentation. They extend the convex regularization on the characteristic function on the image domain to the nonconvex case, which are able to better obtain piecewise constant regions with neat boundaries. By analyzing the proposed non-Lipschitz model, we combine the proximal alternating minimization framework with support shrinkage and linearization strategies to design our algorithm. This leads to two alternating strongly convex subproblems which can be easily solved. Similarly, we present an algorithm without support shrinkage operation for the nonconvex Lipschitz case. Using the Kurdyka-Łojasiewicz property of the objective function, we prove that the limit point of the generated sequence is a critical point of the original nonconvex nonsmooth problem. Numerical experiments and comparisons illustrate the effectiveness of our method in two-phase image segmentation.