A semidefinite algorithm for completely positive tensor decomposition

A symmetric tensor, which has a symmetric nonnegative decomposition, is called a completely positive tensor. In this paper, we characterize the completely positive tensor as a truncated moment sequence, and transform the problem of checking whether a tensor is completely positive to checking whether its corresponding truncated moment sequence admits a representing measure, then present a semidefinite algorithm to solve it. If a tensor is not completely positive, a certificate for it can be obtained; if it is completely positive, a nonnegative decomposition can be obtained.     

Completely positive tensor recovery with minimal nuclear value

In this paper, we introduce the CP-nuclear value of a completely positive (CP) tensor and study its properties. A semidefinite relaxation algorithm is proposed for solving the minimal CP-nuclear-value tensor recovery. If a partial tensor is CP-recoverable, the algorithm can give a CP tensor recovery with the minimal CP-nuclear value, as well as a CP-nuclear decomposition of the recovered CP tensor. If it is not CP-recoverable, the algorithm can always give a certificate for that, when it is regular. Some numerical experiments are also presented.     

On the tensor product of representations of semisimple Lie groups

The problem of the decomposition of the tensor product of finite and infinite representations of a complex semigroup of a Lie group is examined by using the theory of characters of completely irreducible representations. A theorem is proved which indicates that completely irreducible representations enter into the expansion of the tensor product of a finite and elementary representation.Translated from Matematicheskie Zametki, Vol. 16, No. 5. pp. 731–739, November, 1974.     

Nonnegative non-redundant tensor decomposition

Nonnegative tensor decomposition allows us to analyze data in their ‘native’ form and to present results in the form of the sum of rank-1 tensors that does not nullify any parts of the factors. In this paper, we propose the geometrical structure of a basis vector frame for sum-of-rank-1 type decomposition of real-valued nonnegative tensors. The decomposition we propose reinterprets the orthogonality property of the singularvectors of matrices as a geometric constraint on the rank-1 matrix bases which leads to a geometrically constrained singularvector frame. Relaxing the orthogonality requirement, we developed a set of structured-bases that can be utilized to decompose any tensor into a similar constrained sum-of-rank-1 decomposition. The proposed approach is essentially a reparametrization and gives us an upper bound of the rank for tensors. At first, we describe the general case of tensor decomposition and then extend it to its nonnegative form. At the end of this paper, we show numerical results which conform to the proposed tensor model and utilize it for nonnegative data decomposition.     

Tensor Approximation Approach to Calculation of Singular Values and Vectors for SVD Problem

A new method of calculation of singular values and left and right singular vectors of arbitrary nonsquare matrices is proposed. The method allows one to avoid solutions of high rank systems of linear equations of singular value decomposition problems, which makes it not sensitive to ill-conditioness of the decomposed matrix. On the base of the Eckart–Young theorem, it was shown that each second order r-rank tensor can be represented as a sum of the first rank r-order “coordinate” tensors. A new system of equations for “coordinate” tensor generator vectors was obtained. An iterative method of solution of the system was elaborated. Results of the method were compared with classical methods of solutions of singular value decomposition problems.     

Symmetric Hermitian decomposability criterion,decomposition, and its applications

The Hermitian tensor is an extension of Hermitian matrices and plays an important role in quantum information research. It is known that every symmetric tensor has a symmetric CP-decomposition. However, symmetric Hermitian tensor is not the case. In this paper, we obtain a necessary and sufficient condition for symmetric Hermitian decomposability of symmetric Hermitian tensors. When a symmetric Hermitian decomposable tensor space is regarded as a linear space over the real number field, we also obtain its dimension formula and basis. Moreover, if the tensor is symmetric Hermitian decomposable, then the symmetric Hermitian decomposition can be obtained by using the symmetric Hermitian basis. In the application of quantum information, the symmetric Hermitian decomposability condition can be used to determine the symmetry separability of symmetric quantum mixed states.     

Covariant derivative of the curvature tensor of pseudo-Kählerian manifolds

It is well known that the curvature tensor of a pseudo-Riemannian manifold can be decomposed with respect to the pseudo-orthogonal group into the sum of the Weyl conformal curvature tensor, the traceless part of the Ricci tensor and of the scalar curvature. A similar decomposition with respect to the pseudo-unitary group exists on a pseudo-Kählerian manifold; instead of the Weyl tensor one obtains the Bochner tensor. In the present paper, the known decomposition with respect to the pseudo-orthogonal group of the covariant derivative of the curvature tensor of a pseudo-Riemannian manifold is refined. A decomposition with respect to the pseudo-unitary group of the covariant derivative of the curvature tensor for pseudo-Kählerian manifolds is obtained. This defines natural classes of spaces generalizing locally symmetric spaces and Einstein spaces. It is shown that the values of the covariant derivative of the curvature tensor for a non-locally symmetric pseudo-Riemannian manifold with an irreducible connected holonomy group different from the pseudo-orthogonal and pseudo-unitary groups belong to an irreducible module of the holonomy group.     

Robust tensor completion using transformed tensor singular value decomposition

In this article, we study robust tensor completion by using transformed tensor singular value decomposition (SVD), which employs unitary transform matrices instead of discrete Fourier transform matrix that is used in the traditional tensor SVD. The main motivation is that a lower tubal rank tensor can be obtained by using other unitary transform matrices than that by using discrete Fourier transform matrix. This would be more effective for robust tensor completion. Experimental results for hyperspectral, video and face datasets have shown that the recovery performance for the robust tensor completion problem by using transformed tensor SVD is better in peak signal‐to‐noise ratio than that by using Fourier transform and other robust tensor completion methods.     

Rank-<Emphasis Type="Italic">r</Emphasis> decomposition of symmetric tensors

An algorithm is presented for decomposing a symmetric tensor into a sum of rank-1 symmetric tensors. For a given tensor, by using apolarity, catalecticant matrices and the condition that the mapping matrices are commutative, the rank of the tensor can be obtained by iteration. Then we can find the generating polynomials under a selected basis set. The decomposition can be constructed by the solutions of generating polynomials under the condition that the solutions are all distinct which can be guaranteed by the commutative property of the matrices. Numerical examples demonstrate the efficiency and accuracy of the proposed method.     

Generating Polynomials and Symmetric Tensor Decompositions

This paper studies symmetric tensor decompositions. For symmetric tensors, there exist linear relations of recursive patterns among their entries. Such a relation can be represented by a polynomial, which is called a generating polynomial. The homogenization of a generating polynomial belongs to the apolar ideal of the tensor. A symmetric tensor decomposition can be determined by a set of generating polynomials, which can be represented by a matrix. We call it a generating matrix. Generally, a symmetric tensor decomposition can be determined by a generating matrix satisfying certain conditions. We characterize the sets of such generating matrices and investigate their properties (e.g., the existence, dimensions, nondefectiveness). Using these properties, we propose methods for computing symmetric tensor decompositions. Extensive examples are shown to demonstrate the efficiency of proposed methods.     

Completely positive and completely positive semidefinite tensor relaxations for polynomial optimization

Completely positive (CP) tensors, which correspond to a generalization of CP matrices, allow to reformulate or approximate a general polynomial optimization problem (POP) with a conic optimization problem over the cone of CP tensors. Similarly, completely positive semidefinite (CPSD) tensors, which correspond to a generalization of positive semidefinite (PSD) matrices, can be used to approximate general POPs with a conic optimization problem over the cone of CPSD tensors. In this paper, we study CP and CPSD tensor relaxations for general POPs and compare them with the bounds obtained via a Lagrangian relaxation of the POPs. This shows that existing results in this direction for quadratic POPs extend to general POPs. Also, we provide some tractable approximation strategies for CP and CPSD tensor relaxations. These approximation strategies show that, with a similar computational effort, bounds obtained from them for general POPs can be tighter than bounds for these problems obtained by reformulating the POP as a quadratic POP, which subsequently can be approximated using CP and PSD matrices. To illustrate our results, we numerically compare the bounds obtained from these relaxation approaches on small scale fourth-order degree POPs.     

Tensor inversion and its application to the tensor equations with Einstein product

Recently, the inverse of an even-order square tensor has been put forward in [Brazell M, Li N, Navasca C, Tamon C. Solving multilinear systems via tensor inversion. SIAM J Matrix Anal Appl. 2013;34(2):542–570] by means of the tensor group consisting of even-order square tensors equipped with the Einstein product. In this paper, several necessary and sufficient conditions for the invertibility of a tensor are obtained, and some approaches for calculating the inverse (if it exists) are proposed. Furthermore, the Cramer's rule and the elimination method for solving the tensor equations with the Einstein product are derived. In addition, the tensor eigenvalue problem mentioned in [Qi L-Q. Theory of tensors (hypermatrices). Hong Kong: Department of Applied Mathematics, The Hong Kong Polytechnic University; 2014] can also be addressed by using the elimination method mentioned above. By the way, the LU decomposition and the Schur decomposition of matrices are extended to tensor case. Numerical examples are provided to illustrate the main results.     

Symmetry of eigenvalues of Sylvester matrices and tensors

In this article, the index of imprimitivity of an irreducible nonnegative matrix in the famous PerronFrobenius theorem is studied within a more general framework, both in a more general tensor setting and in a more natural spectral symmetry perspective. A k-th order tensor has symmetric spectrum if the set of eigenvalues is symmetric under a group action with the group being a subgroup of the multiplicative group of k-th roots of unity. A sufficient condition, in terms of linear equations over the quotient ring, for a tensor possessing symmetric spectrum is given, which becomes also necessary when the tensor is nonnegative, symmetric and weakly irreducible, or an irreducible nonnegative matrix. Moreover, it is shown that for a weakly irreducible nonnegative tensor, the spectral symmetries are the same when either counting or ignoring multiplicities of the eigenvalues. In particular, the spectral symmetry(index of imprimitivity) of an irreducible nonnegative Sylvester matrix is completely resolved via characterizations with the indices of its positive entries. It is shown that the spectrum of an irreducible nonnegative Sylvester matrix can only be 1-symmetric or 2-symmetric, and the exact situations are fully described. With this at hand, the spectral symmetry of a nonnegative two-dimensional symmetric tensor with arbitrary order is also completely characterized.     

The rank of a 2 × 2 × 2 tensor

As computing power increases, many more problems in engineering and data analysis involve computation with tensors, or multi-way data arrays. Most applications involve computing a decomposition of a tensor into a linear combination of rank-1 tensors. Ideally, the decomposition involves a minimal number of terms, i.e. computation of the rank of the tensor. Tensor rank is not a straight-forward extension of matrix rank. A constructive proof based on an eigenvalue criterion is provided that shows when a 2?×?2?×?2 tensor over ? is rank-3 and when it is rank-2. The results are extended to show that n?×?n?×?2 tensors over ? have maximum possible rank n?+?k where k is the number of complex conjugate eigenvalue pairs of the matrices forming the two faces of the tensor cube.     

Linear operators and positive semidefiniteness of symmetric tensor spaces

We study symmetric tensor spaces and cones arising from polynomial optimization and physical sciences.We prove a decomposition invariance theorem for linear operators over the symmetric tensor space,which leads to several other interesting properties in symmetric tensor spaces.We then consider the positive semidefiniteness of linear operators which deduces the convexity of the Frobenius norm function of a symmetric tensor.Furthermore,we characterize the symmetric positive semidefinite tensor(SDT)cone by employing the properties of linear operators,design some face structures of its dual cone,and analyze its relationship to many other tensor cones.In particular,we show that the cone is self-dual if and only if the polynomial is quadratic,give specific characterizations of tensors that are in the primal cone but not in the dual for higher order cases,and develop a complete relationship map among the tensor cones appeared in the literature.     

Tensor Networks and Hierarchical Tensors for the Solution of High-Dimensional Partial Differential Equations

Hierarchical tensors can be regarded as a generalisation, preserving many crucial features, of the singular value decomposition to higher-order tensors. For a given tensor product space, a recursive decomposition of the set of coordinates into a dimension tree gives a hierarchy of nested subspaces and corresponding nested bases. The dimensions of these subspaces yield a notion of multilinear rank. This rank tuple, as well as quasi-optimal low-rank approximations by rank truncation, can be obtained by a hierarchical singular value decomposition. For fixed multilinear ranks, the storage and operation complexity of these hierarchical representations scale only linearly in the order of the tensor. As in the matrix case, the set of hierarchical tensors of a given multilinear rank is not a convex set, but forms an open smooth manifold. A number of techniques for the computation of hierarchical low-rank approximations have been developed, including local optimisation techniques on Riemannian manifolds as well as truncated iteration methods, which can be applied for solving high-dimensional partial differential equations. This article gives a survey of these developments. We also discuss applications to problems in uncertainty quantification, to the solution of the electronic Schrödinger equation in the strongly correlated regime, and to the computation of metastable states in molecular dynamics.     

A unitary joint diagonalization algorithm for nonsymmetric higher‐order tensors based on Givens‐like rotations

Based on Givens‐like rotations, we present a unitary joint diagonalization algorithm for a set of nonsymmetric higher‐order tensors. Each unitary rotation matrix only depends on one unknown parameter which can be analytically obtained in an independent way following a reasonable assumption and a complex derivative technique. It can serve for the canonical polyadic decomposition of a higher‐order tensor with orthogonal factors. Furthermore, based on cross‐high‐order cumulants of observed signals, we show that the proposed algorithm can be applied to solve the joint blind source separation problem. The simulation results reveal that the proposed algorithm has a competitive performance compared with those of several existing related methods.     

On a horizontal conformal Killing tensor of degreep in a sasakian space

Summary We deal with a horizontal conformal Killing tensor of degree p in a Sasakian space. After some preparations we prove that a horizontal conformal Killing tensor of odd degree is necessarily Killing. Moreover, we consider horizontal conformal Killing tensor of even degree. The form of the associated tensor is determined completely and a decomposition theorem is proved. Then we give the examples of a conformal Killing tensor of even degree and a special Killing tensor of odd degree with constant l. Entrata in Redazione il 17 luglio 1971.     

Digital watermarking scheme for colour remote sensing image based on quaternion wavelet transform and tensor decomposition

Digital watermarking is important for protecting the intellectual property of remote sensing images. Unlike watermarking in ordinary colour images, in colour remote sensing images, watermarking has an important requirement: robustness. In this paper, a robust nonblind watermarking scheme for colour remote sensing images, which considers both frequency and statistical pattern features, is constructed based on the quaternion wavelet transform (QWT) and tensor decomposition. Using the QWT, not only the abundant phase information can be used to preserve detailed host image features to improve the imperceptibility of the watermark, but also the frequency coefficients of the host image can provide a stable position to embed the watermark. To further strengthen the robustness, the global statistical feature structure acquired through the tensor Tucker decomposition is employed to distribute the watermark's energy among different colour bands. Because both the QWT frequency coefficients and the tensor decomposition global statistical feature structure are highly stable against external distortion, their integration yields the proposed scheme, which is robust to many image manipulations. A simulation experiment shows that our method can balance the trade‐off between imperceptibility and robustness and that it is more robust than the traditional QWT and discrete wavelet transform (DWT) methods under many different types of image manipulations.     

Biquadratic tensors,biquadratic decompositions,and norms of biquadratic tensors

Biquadratic tensors play a central role in many areas of science.Examples include elastic tensor and Eshelby tensor in solid mechanics,and Riemannian curvature tensor in relativity theory.The singular values and spectral norm of a general third order tensor are the square roots of the M-eigenvalues and spectral norm of a biquadratic tensor,respectively.The tensor product operation is closed for biquadratic tensors.All of these motivate us to study biquadratic tensors,biquadratic decomposition,and norms of biquadratic tensors.We show that the spectral norm and nuclear norm for a biquadratic tensor may be computed by using its biquadratic structure.Then,either the number of variables is reduced,or the feasible region can be reduced.We show constructively that for a biquadratic tensor,a biquadratic rank-one decomposition always exists,and show that the biquadratic rank of a biquadratic tensor is preserved under an independent biquadratic Tucker decomposition.We present a lower bound and an upper bound of the nuclear norm of a biquadratic tensor.Finally,we define invertible biquadratic tensors,and present a lower bound for the product of the nuclear norms of an invertible biquadratic tensor and its inverse,and a lower bound for the product of the nuclear norm of an invertible biquadratic tensor,and the spectral norm of its inverse.