Generalized inverses of tensors via a general product of tensors

We define the {i}-inverse (i = 1, 2, 5) and group inverse of tensors based on a general product of tensors. We explore properties of the generalized inverses of tensors on solving tensor equations and computing formulas of block tensors. We use the {1}-inverse of tensors to give the solutions of a multilinear system represented by tensors. The representations for the {1}-inverse and group inverse of some block tensors are established.     

High-order sum-of-squares structured tensors:theory and applications

Tensor decomposition is an important research area with numerous applications in data mining and computational neuroscience.An important class of tensor decomposition is sum-of-squares(SOS)tensor decomposition.SOS tensor decomposition has a close connection with SOS polynomials,and SOS polynomials are very important in polynomial theory and polynomial optimization.In this paper,we give a detailed survey on recent advances of high-order SOS tensors and their applications.It first shows that several classes of symmetric structured tensors available in the literature have SOS decomposition in the even order symmetric case.Then,the SOS-rank for tensors with SOS decomposition and the SOS-width for SOS tensor cones are established.Further,a sharper explicit upper bound of the SOS-rank for tensors with bounded exponent is provided,and the exact SOS-width for the cone consists of all such tensors with SOS decomposition is identified.Some potential research directions in the future are also listed in this paper.     

两个基于不同张量乘法的四阶张量分解

提出了两个基于不同张量乘法的四阶张量分解. 首先, 在矩阵乘法的基础上, 定义第一种四阶张量乘法(F-乘), 基于F-乘提出了第一种四阶张量分解(F-TD). 其次, 基于三阶张量t-product给出了第二种四阶张量乘法(B-乘)和分解(FT-SVD). 同时, 利用两种分解方法, 分别给出两个张量逼近定理. 最后, 三个数值算例阐明提出的两种分解方法的准确性和可行性.     

Strictly nonnegative tensors and nonnegative tensor partition

We introduce a new class of nonnegative tensors—strictly nonnegative tensors.A weakly irreducible nonnegative tensor is a strictly nonnegative tensor but not vice versa.We show that the spectral radius of a strictly nonnegative tensor is always positive.We give some necessary and su?cient conditions for the six wellconditional classes of nonnegative tensors,introduced in the literature,and a full relationship picture about strictly nonnegative tensors with these six classes of nonnegative tensors.We then establish global R-linear convergence of a power method for finding the spectral radius of a nonnegative tensor under the condition of weak irreducibility.We show that for a nonnegative tensor T,there always exists a partition of the index set such that every tensor induced by the partition is weakly irreducible;and the spectral radius of T can be obtained from those spectral radii of the induced tensors.In this way,we develop a convergent algorithm for finding the spectral radius of a general nonnegative tensor without any additional assumption.Some preliminary numerical results show the feasibility and effectiveness of the algorithm.     

Nonnegative tensors revisited: plane stochastic tensors

In this paper, we develop and enrich the theory of nonnegative tensors. We define the sign nonsingular tensors and establish the relationship between the combinatorial determinant and the permanent of nonnegative tensors. We generalize the results from doubly stochastic matrices to totally plane stochastic tensors and obtain a probabilistic algorithm for locating a positive diagonal in a nonnegative tensor under certain conditions. We form a normalization algorithm to convert some nonnegative tensors to plane stochastic tensors. We obtain a lower bound for the minimum of the axial N-index assignment problem by means of the set of plane stochastic tensors.     

Column sufficient tensors and tensor complementarity problems

Stimulated by the study of sufficient matrices in linear complementarity problems, we study column sufficient tensors and tensor complementarity problems. Column sufficient tensors constitute a wide range of tensors that include positive semi-definite tensors as special cases. The inheritance property and invariant property of column sufficient tensors are presented. Then, various spectral properties of symmetric column sufficient tensors are given. It is proved that all H-eigenvalues of an even-order symmetric column sufficient tensor are nonnegative, and all its Z-eigenvalues are nonnegative even in the odd order case. After that, a new subclass of column sufficient tensors and the handicap of tensors are defined. We prove that a tensor belongs to the subclass if and only if its handicap is a finite number. Moreover, several optimization models that are equivalent with the handicap of tensors are presented. Finally, as an application of column sufficient tensors, several results on tensor complementarity problems are established.     

Nonnegative non-redundant tensor decomposition

Nonnegative tensor decomposition allows us to analyze data in their ‘native’ form and to present results in the form of the sum of rank-1 tensors that does not nullify any parts of the factors. In this paper, we propose the geometrical structure of a basis vector frame for sum-of-rank-1 type decomposition of real-valued nonnegative tensors. The decomposition we propose reinterprets the orthogonality property of the singularvectors of matrices as a geometric constraint on the rank-1 matrix bases which leads to a geometrically constrained singularvector frame. Relaxing the orthogonality requirement, we developed a set of structured-bases that can be utilized to decompose any tensor into a similar constrained sum-of-rank-1 decomposition. The proposed approach is essentially a reparametrization and gives us an upper bound of the rank for tensors. At first, we describe the general case of tensor decomposition and then extend it to its nonnegative form. At the end of this paper, we show numerical results which conform to the proposed tensor model and utilize it for nonnegative data decomposition.     

A constructive arbitrary‐degree Kronecker product decomposition of tensors

We generalize the matrix Kronecker product to tensors and propose the tensor Kronecker product singular value decomposition that decomposes a real k‐way tensor into a linear combination of tensor Kronecker products with an arbitrary number of d factors. We show how to construct , where each factor is also a k‐way tensor, thus including matrices (k=2) as a special case. This problem is readily solved by reshaping and permuting into a d‐way tensor, followed by a orthogonal polyadic decomposition. Moreover, we introduce the new notion of general symmetric tensors (encompassing symmetric, persymmetric, centrosymmetric, Toeplitz and Hankel tensors, etc.) and prove that when is structured then its factors will also inherit this structure.     

Decomposing tensors into frames

A symmetric tensor of small rank decomposes into a configuration of only few vectors. We study the variety of tensors for which this configuration is a unit norm tight frame.     

New eigenvalue inclusion sets for tensors

Two new eigenvalue inclusion sets for tensors are established. It is proved that the new eigenvalue inclusion sets are tighter than that in Qi's paper “Eigenvalues of a real supersymmetric tensor”. As applications, upper bounds for the spectral radius of a nonnegative tensor are obtained, and it is proved that these upper bounds are sharper than that in Yang's paper “Further results for Perron–Frobenius theorem for nonnegative tensors”. And some sufficient conditions of the positive definiteness for an even‐order real supersymmetric tensor are given. Copyright © 2012 John Wiley & Sons, Ltd.     

Fourier matrices and Fourier tensors

The Fourier matrix is fundamental in discrete Fourier transforms and fast Fourier transforms. We generalize the Fourier matrix, extend the concept of Fourier matrix to higher order Fourier tensor, present the spectrum of the Fourier tensors, and use the Fourier tensor to simplify the high order Fourier analysis.     

Geometric simplicity of spectral radius of nonnegative irreducible tensors

We study the real and complex geometric simplicity of nonnegative irreducible tensors. First, we prove some basic conclusions. Based on the conclusions, the real geometric simplicity of the spectral radius of an evenorder nonnegative irreducible tensor is proved. For an odd-order nonnegative irreducible tensor, sufficient conditions are investigated to ensure the spectral radius to be real geometrically simple. Furthermore, the complex geometric simplicity of nonnegative irreducible tensors is also studied.     

On the Nuclear Norm and the Singular Value Decomposition of Tensors

Finding the rank of a tensor is a problem that has many applications. Unfortunately, it is often very difficult to determine the rank of a given tensor. Inspired by the heuristics of convex relaxation, we consider the nuclear norm instead of the rank of a tensor. We determine the nuclear norm of various tensors of interest. Along the way, we also do a systematic study various measures of orthogonality in tensor product spaces and we give a new generalization of the singular value decomposition to higher-order tensors.     

Recovering orthogonal tensors under arbitrarily strong,but locally correlated,noise

We consider the problem of recovering an orthogonally decomposable tensor with a subset of elements distorted by noise with arbitrarily large magnitude. We focus on the particular case where each mode in the decomposition is corrupted by noise vectors with components that are correlated locally, that is, with nearby components. We show that this deterministic tensor completion problem has the unusual property that it can be solved in polynomial time if the rank of the tensor is sufficiently large. This is the polar opposite of the low-rank assumptions of typical low-rank tensor and matrix completion settings. We show that our problem can be solved through a system of coupled Sylvester-like equations and show how to accelerate their solution by an alternating solver. This enables recovery even with a substantial number of missing entries, for instance for $n$-dimensional tensors of rank $n$ with up to $40\%$ missing entries.     

Bi-block positive semidefiniteness of bi-block symmetric tensors

The positive definiteness of elasticity tensors plays an important role in the elasticity theory.In this paper,we consider the bi-block symmetric tensors,which contain elasticity tensors as a subclass.First,we define the bi-block M-eigenvalue of a bi-block symmetric tensor,and show that a bi-block symmetric tensor is bi-block positive(semi)definite if and only if its smallest bi-block M-eigenvalue is(nonnegative)positive.Then,we discuss the distribution of bi-block M-eigenvalues,by which we get a sufficient condition for judging bi-block positive(semi)definiteness of the bi-block symmetric tensor involved.Particularly,we show that several classes of bi-block symmetric tensors are bi-block positive definite or bi-block positive semidefinite,including bi-block(strictly)diagonally dominant symmetric tensors and bi-block symmetric(B)B0-tensors.These give easily checkable sufficient conditions for judging bi-block positive(semi)definiteness of a bi-block symmetric tensor.As a byproduct,we also obtain two easily checkable sufficient conditions for the strong ellipticity of elasticity tensors.     

Upper bounds for eigenvalues of Cauchy-Hankel tensors

We present upper bounds of eigenvalues for finite and infinite dimensional Cauchy-Hankel tensors. It is proved that an m-order infinite dimensional Cauchy-Hankel tensor defines a bounded and positively (m－1)-homogeneous operator from l¹ into l^p (1<p<∞); and two upper bounds of corresponding positively homogeneous operator norms are given. Moreover, for a fourth-order real partially symmetric Cauchy-Hankel tensor, suffcient and necessary conditions of M-positive definiteness are obtained, and an upper bound of M-eigenvalue is also shown.     

Factorization strategies for third-order tensors

Operations with tensors, or multiway arrays, have become increasingly prevalent in recent years. Traditionally, tensors are represented or decomposed as a sum of rank-1 outer products using either the CANDECOMP/PARAFAC (CP) or the Tucker models, or some variation thereof. Such decompositions are motivated by specific applications where the goal is to find an approximate such representation for a given multiway array. The specifics of the approximate representation (such as how many terms to use in the sum, orthogonality constraints, etc.) depend on the application.In this paper, we explore an alternate representation of tensors which shows promise with respect to the tensor approximation problem. Reminiscent of matrix factorizations, we present a new factorization of a tensor as a product of tensors. To derive the new factorization, we define a closed multiplication operation between tensors. A major motivation for considering this new type of tensor multiplication is to devise new types of factorizations for tensors which can then be used in applications.Specifically, this new multiplication allows us to introduce concepts such as tensor transpose, inverse, and identity, which lead to the notion of an orthogonal tensor. The multiplication also gives rise to a linear operator, and the null space of the resulting operator is identified. We extend the concept of outer products of vectors to outer products of matrices. All derivations are presented for third-order tensors. However, they can be easily extended to the order-p(p>3) case. We conclude with an application in image deblurring.     

Weighted Moore-Penrose inverses and fundamental theorem of even-order tensors with Einstein product

We treat even-order tensors with Einstein product as linear operators from tensor space to tensor space, define the null spaces and the ranges of tensors, and study their relationship. We extend the fundamental theorem of linear algebra for matrix spaces to tensor spaces. Using the new relationship, we characterize the least-squares (?) solutions to a multilinear system and establish the relationship between the minimum-norm (N) least-squares (?) solution of a multilinear system and the weighted Moore-Penrose inverse of its coefficient tensor. We also investigate a class of even-order tensors induced by matrices and obtain some interesting properties.     

Probabilistic inference with noisy-threshold models based on a CP tensor decomposition

The specification of conditional probability tables (CPTs) is a difficult task in the construction of probabilistic graphical models. Several types of canonical models have been proposed to ease that difficulty. Noisy-threshold models generalize the two most popular canonical models: the noisy-or and the noisy-and. When using the standard inference techniques the inference complexity is exponential with respect to the number of parents of a variable. More efficient inference techniques can be employed for CPTs that take a special form. CPTs can be viewed as tensors. Tensors can be decomposed into linear combinations of rank-one tensors, where a rank-one tensor is an outer product of vectors. Such decomposition is referred to as Canonical Polyadic (CP) or CANDECOMP-PARAFAC (CP) decomposition. The tensor decomposition offers a compact representation of CPTs which can be efficiently utilized in probabilistic inference. In this paper we propose a CP decomposition of tensors corresponding to CPTs of threshold functions, exactly ℓ-out-of-k functions, and their noisy counterparts. We prove results about the symmetric rank of these tensors in the real and complex domains. The proofs are constructive and provide methods for CP decomposition of these tensors. An analytical and experimental comparison with the parent-divorcing method (which also has a polynomial complexity) shows superiority of the CP decomposition-based method. The experiments were performed on subnetworks of the well-known QMRT-DT network generalized by replacing noisy-or by noisy-threshold models.