Inverse problems for multi-valued quasi variational inequalities and noncoercive variational inequalities with noisy data

ABSTRACT

We study the inverse problem of identifying a variable parameter in variational and quasi-variational inequalities. We consider a quasi-variational inequality involving a multi-valued monotone map and give a new existence result. We then formulate the inverse problem as an optimization problem and prove its solvability. We also conduct a thorough study of the inverse problem of parameter identification in noncoercive variational inequalities which appear commonly in applied models. We study the inverse problem by posing optimization problems using the output least-squares and the modified output least-squares. Using regularization, penalization, and smoothing, we obtain a single-valued parameter-to-selection map and study its differentiability. We consider optimization problems using the output least-squares and the modified output least-squares for the regularized, penalized and smoothened variational inequality. We give existence results, convergence analysis, and optimality conditions. We provide applications and numerical examples to justify the proposed framework.     

On convex modified output least-squares for elliptic inverse problems: stability,regularization, applications,and numerics

Abstract

Inverse problems of identifying parameters in partial differential equations constitute an important class of problems with diverse real-world applications. These identification problems are commonly explored in an optimization framework and there are many optimization formulations having their own advantages and disadvantages. Although a non-convex output least-squares (OLS) objective is commonly used, a convex-modified output least-squares (MOLS) has shown encouraging results in recent years. In this work, we focus on various aspects of the MOLS approach. We devise a rigorous (quadratic and non-quadratic) regularization framework for the identification of smooth as well as discontinuous coefficients. This framework subsumes the total variation regularization that has attracted a great deal of attention in identifying sharply varying coefficients and also in image processing. We give new existence results for the regularized optimization problems for OLS and MOLS. Restricting to the Tikhonov (quadratic) regularization, we carry out a detailed study of various stability aspects of the inverse problem under data perturbation and give new stability estimates for general inverse problems using OLS and MOLS formulations. We give a discretization scheme for the continuous inverse problem and prove the convergence of the discrete inverse problem to the continuous one. We collect discrete formulas for OLS and MOLS and compute their gradients and Hessians. We present applications of our theoretical results. To show the feasibility of the MOLS framework, we also provide computational results for the inverse problem of identifying parameters in three different classes of partial differential equations .     

A new regularized stochastic approximation framework for stochastic inverse problems

We study the nonlinear inverse problem of estimating stochastic parameters in the fourth-order partial differential equation with random data. The primary focus is on developing a novel stochastic approximation framework for inverse problems consisting of three key components. As a first step, we reformulate the inverse problem into a stochastic convex optimization problem. The second step includes developing a new regularized stochastic extragradient framework for a nonlinear variational inequality, which subsumes the optimality conditions for the optimization formulation of the inverse problem. The third step involves modeling random variables by a Karhunen–Loève type finite-dimensional noise representation, allowing the direct and the inverse problems to be conveniently discretized. We show that the regularized extragradient methods are strongly convergent in a Hilbert space setting, and we also provide several auxiliary results for the inverse problem, including Lipschitz continuity and a derivative characterization of the solution map. We provide the outcome of computational experiments to estimate stochastic and deterministic parameters. The numerical results demonstrate the feasibility and effectiveness of the developed framework and validate stochastic approximation as an effective method for stochastic inverse problems.     

On two-coefficient identification in elliptic variational inequalities

Abstract

This paper is concerned with elliptic variational inequalities that depend on two parameters. First, we investigate the dependence of the solution of the forward problem on these parameters and prove a Lipschitz estimate. Then, we study the inverse problem of identification of these two parameters and formulate two optimization approaches to this parameter identification problem. We extend the output least-squares approach, provide an existence result and establish a convergence result for finite-dimensional approximation. Further, we investigate the modified output least-squares approach which is based on energy functionals. This latter approach can be related to vector approximation.     

A New Energy Inversion for Parameter Identification in Saddle Point Problems with an Application to the Elasticity Imaging Inverse Problem of Predicting Tumor Location

The primary objective of this work is a detailed theoretical and computational study of the elasticity imaging inverse problem for tumor identification within the human body. Apart from this inverse problem's important and interesting application, it also poses noteworthy mathematical challenges since the underlying mathematical model is a system of elasticity involving incompressibility. This gives rise to the “locking” effect and special treatment is necessary for both the direct and inverse problems. To study the inverse problem in an optimization framework, we introduce a general computational scheme for handling parameter identification in saddle point problems along with the introduction and analysis of a new energy output least-squares objective functionals. We also present a treatment of the identification of discontinuous elasticity coefficients using the total variation regularization method. General formulas for the computation of the coefficient-to-solution map and a complete convergence analysis are given for the continuous problem as well as for its discrete analogue. Discrete formulas and implementation issues are discussed in detail and numerical examples for smooth and discontinuous coefficients are given.     

Switching Time Optimization for Bang-Bang and Singular Controls

Optimal control problems with the control variable appearing linearly are studied. A method for optimization with respect to the switching times of controls containing both bang-bang and singular arcs is presented. This method is based on the transformation of the control problem into a finite-dimensional optimization problem. Therein, first and second-order optimality conditions are thoroughly discussed. Explicit representations of first and second-order variational derivatives of the state trajectory with respect to the switching times are given. These formulas are used to prove that the second-order sufficient conditions can be verified on the basis of only first-order variational derivatives of the state trajectory. The effectiveness of the proposed method is tested with two numerical examples.     

Regularized gap functions for nonsmooth variational inequality problems

Under the condition that the involved function F is locally Lipschitz, but not necessarily differentiable, we investigate the regularized gap function defined by a generalized distance function for the variational inequality problem (VIP). First, we compute exactly the Clarke-Rockafellar directional derivatives of the regularized gap functions (and of some modified ones). Second, using these results, we show that, under the strongly monotonicity assumption, the regularized gap functions have fractional exponent error bounds, and thereby we provide an algorithm of Armijo type to solve the VIP.     

Textile porosity determination based on a nonlinear heat and moisture transfer model

The inverse problems of textile materials design on heat and moisture transfer properties are important and indispensable in applications in the body-clothing-environment system. We present an inverse problem of textile porosity determination (IPTPD) based on a nonlinear heat and moisture transfer model. Adopting the idea of the least-squares, the mathematical formulation of IPTPD is deduced to a regularized optimization problem with collocation method applied. The continuity of the regularized minimization problem is proved. By means of genetic algorithm (GA), the approximate solution of the IPTPD is numerically obtained. To reduce the computational cost, an improved algorithm based on BP neural network with GA is proposed in the numerical simulation. Compared with the direct GA searching, the computational cost is greatly reduced, which presents a similar result.     

Second-Order Modified Contingent Epiderivatives in Set-Valued Optimization

In this article, we introduce a second-order modified contingent cone and a second-order modified contingent epiderivative. We discuss some properties of the second-order cone and the epiderivative, respectively. Moreover, a Fritz John type necessary optimality condition is obtained for the set-valued optimization problems with constraints by using the second-order modified contingent epiderivative and an example is proposed to explain the Fritz John type necessary optimality condition. In particular, we obtain a unified second-order sufficient and necessary optimality condition for the set-valued optimization problems with constraints under twice differentiable L-quasi-convex assumption.     

Sparse regression using mixed norms

Mixed norms are used to exploit in an easy way, both structure and sparsity in the framework of regression problems, and introduce implicitly couplings between regression coefficients. Regression is done through optimization problems, and corresponding algorithms are described and analyzed. Beside the classical sparse regression problem, multi-layered expansion on unions of dictionaries of signals are also considered. These sparse structured expansions are done subject to an exact reconstruction constraint, using a modified FOCUSS algorithm. When the mixed norms are used in the framework of regularized inverse problem, a thresholded Landweber iteration is used to minimize the corresponding variational problem.     

Second-order asymptotic analysis for noncoercive convex optimization

We use second-order asymptotic analysis to deal with the minimization problem of a noncoercive convex function in a reflexive Banach space. To that end, we first introduce the definition of a second-order asymptotic cone, and its respective function, based on previous results for the finite dimensional case. We provide necessary and sufficient conditions for the existence of solutions for noncoercive convex minimization problems. Examples for which our assumptions are easier to verify than other well-known results are also provided.     

On Relations Between Vector Optimization Problems and Vector Variational Inequalities

We obtain equivalences between weak Pareto solutions of vector optimization problems and solutions of vector variational inequalities involving generalized directional derivatives.     

A modified regularized algorithm for a semilinear space‐fractional backward diffusion problem

In this paper, we investigate a backward problem for a space‐fractional partial differential equation. The main purpose is to propose a modified regularization method for the inverse problem. The existence and the uniqueness for the modified regularized solution are proved. To derive the gradient of the optimization functional, the variational adjoint method is introduced, and hence, the unknown initial value is reconstructed. Finally, numerical examples are provided to show the effectiveness of the proposed algorithm. Copyright © 2017 John Wiley & Sons, Ltd.     

Uniqueness and stability in determining the speed of propagation of second-order hyperbolic equation with variable coefficients

One of the basic inverse problems in an anisotropic media is the determination of coefficients in a bounded domain with a single measurement. We consider the problem of finding the coefficient of the second derivatives in a second-order hyperbolic equation with variable coefficients.

Under a weak regularity assumption and a geometrical condition on the metric, we prove the uniqueness in a multidimensional hyperbolic inverse problem with a single measurement. Moreover we show that our uniqueness results yield the Lipschitz stability estimate in L ² space for solution to the inverse problem under consideration.     

Inverse conductivity Problem with Internal Data

This paper concerns the reconstruction of a scalar coefficient of a second-order elliptic equation in divergence form posed on a bounded domain from internal data. This problem finds applications in multi-wave imaging, greedy methods to approximate parameter-dependent elliptic problems, and image treatment with partial differential equations. We first show that the inverse problem for smooth coefficients can be rewritten as a linear transport equation. Assuming that the coefficient is known near the boundary, we study the well-posedness of associated transport equation as well as its numerical resolution using discontinuous Galerkin method. We propose a regularized transport equation that allow us to derive rigorous convergence rates of the numerical method in terms of the order of the polynomial approximation as well as the regularization parameter. We finally provide numerical examples for the inversion assuming a lower regularity of the coefficient, and using synthetic data.     

Robust Solution to Fuzzy Identification Problem with Uncertain Data by Regularization

This study considers the robust identification of the parameters describing a Sugeno type fuzzy inference system with uncertain data. The objective is to minimize the worst-case residual error using a numerically efficient algorithm. The Sugeno type fuzzy systems are linear in consequent parameters but nonlinear in antecedent parameters. The robust consequent parameters identification problem can be formulated as second-order cone programming problem. The optimal solution of this second-order cone problem can be interpreted as solution of a Tikhonov regularization problem with a special choice of regularization parameter which is optimal for robustness (Ghaoui and Lebret (1997). SAIM Journal of Matrix Analysis and Applications 18, 1035–1064). The final regularized nonlinear optimization problem allowing simultaneous identification of antecedent and consequent parameters is solved iteratively using a generalized Gauss–Newton like method. To illustrate the approach, several simulation studies on numerical examples including the modelling of a spectral data function (one-dimensional benchmark example) is provided. The proposed robust fuzzy identification scheme has been applied to approximate the physical fitness of patients with a fuzzy expert system. The identified fuzzy expert system is shown to be capable of capturing the decisions (experiences) of a medical expert.     

Fractional-order regularization and wavelet approximation to the inverse estimation problem for random fields

The least-squares linear inverse estimation problem for random fields is studied in a fractional generalized framework. First, the second-order regularity properties of the random fields involved in this problem are analysed in terms of the fractional Sobolev norms. Second, the incorporation of prior information in the form of a fractional stochastic model, with covariance operator bicontinuous with respect to a certain fractional Sobolev norm, leads to a regularization of this problem. Third, a multiresolution approximation to the class of linear inverse problems considered is obtained from a wavelet-based orthogonal expansion of the input and output random models. The least-squares linear estimate of the input random field is then computed using these orthogonal wavelet decompositions. The results are applied to solving two important cases of linear inverse problems defined in terms of fractional integral operators.     

Optimality conditions for a class of inverse optimal control problems with partial differential equations

ABSTRACT

We consider bilevel optimization problems which can be interpreted as inverse optimal control problems. The lower-level problem is an optimal control problem with a parametrized objective function. The upper-level problem is used to identify the parameters of the lower-level problem. Our main focus is the derivation of first-order necessary optimality conditions. We prove C-stationarity of local solutions of the inverse optimal control problem and give a counterexample to show that strong stationarity might be violated at a local minimizer.     

The Legendre condition of the fractional calculus of variations

Fractional operators play an important role in modelling nonlocal phenomena and problems involving coarse-grained and fractal spaces. The fractional calculus of variations with functionals depending on derivatives and/or integrals of noninteger order is a rather recent subject that is currently in fast development due to its applications in physics and other sciences. In the last decade, several approaches to fractional variational calculus were proposed by using different notions of fractional derivatives and integrals. Although the literature of the fractional calculus of variations is already vast, much remains to be done in obtaining necessary and sufficient conditions for the optimization of fractional variational functionals, existence and regularity of solutions. Regarding necessary optimality conditions, all works available in the literature concern the derivation of first-order fractional conditions of Euler–Lagrange type. In this work, we obtain a Legendre second-order necessary optimality condition for weak extremizers of a variational functional that depends on fractional derivatives.     

Proximal type algorithms involving linesearch and inertial technique for split variational inclusion problem in hilbert spaces with applications

ABSTRACT

In convex optimization, numerous problems in applied sciences can be modelled as the split variational inclusion problem (SVIP). In this connection, we aim to design new and efficient proximal type algorithms which are based on the inertial technique and the linesearches terminology. We then discuss its convergence under some suitable conditions without the assumption on the operator norm. We also apply our main result to the split minimization problem, the split feasibility problem, the relaxed split feasibility problem and the linear inverse problem. Finally, we provide some numerical experiments and comparisons to these problems. The obtained result mainly improves the recent results investigated by Chuang.