Canonical correlation analysis based on information theory

In this article, we propose a new canonical correlation method based on information theory. This method examines potential nonlinear relationships between p×1 vector Y-set and q×1 vector X-set. It finds canonical coefficient vectors a and b by maximizing a more general measure, the mutual information, between a^TX and b^TY. We use a permutation test to determine the pairs of the new canonical correlation variates, which requires no specific distributions for X and Y as long as one can estimate the densities of a^TX and b^TY nonparametrically. Examples illustrating the new method are presented.