A matrix Kronecker lemma

We show that a standard tool of probability theory, the Kronecker lemma, has matrix generalizations, but that one of these matrix generalizations is unsatisfactory, to the extent that unless certain extra conditions are placed on the matrix sequence appearing in the lemma statement, the lemma may fail to be true.