$$\ell _p$$ Regularized low-rank approximation via iterative reweighted singular value minimization |
| |
Authors: | Zhaosong Lu Yong Zhang Jian Lu |
| |
Institution: | 1.Department of Mathematics,Simon Fraser University,Burnaby,Canada;2.Colin Artificial Intelligence Lab Ltd.,Richmond,Canada;3.College of Mathematics and Computational Science,Shenzhen University,Shenzhen,People’s Republic of China |
| |
Abstract: | In this paper we study the \(\ell _p\) (or Schatten-p quasi-norm) regularized low-rank approximation problems. In particular, we introduce a class of first-order stationary points for them and show that any local minimizer of these problems must be a first-order stationary point. In addition, we derive lower bounds for the nonzero singular values of the first-order stationary points and hence also of the local minimizers of these problems. The iterative reweighted singular value minimization (IRSVM) methods are then proposed to solve these problems, whose subproblems are shown to have a closed-form solution. Compared to the analogous methods for the \(\ell _p\) regularized vector minimization problems, the convergence analysis of these methods is significantly more challenging. We develop a novel approach to establishing the convergence of the IRSVM methods, which makes use of the expression of a specific solution of their subproblems and avoids the intricate issue of finding the explicit expression for the Clarke subdifferential of the objective of their subproblems. In particular, we show that any accumulation point of the sequence generated by the IRSVM methods is a first-order stationary point of the problems. Our computational results demonstrate that the IRSVM methods generally outperform the recently developed iterative reweighted least squares methods in terms of solution quality and/or speed. |
| |
Keywords: | |
本文献已被 SpringerLink 等数据库收录! |
|