The main result of this note, Theorem 1.3, is the following: a Borel measure on the space of infinite Hermitian matrices, that is invariant and ergodic under the action of the infinite unitary group and that admits well-defined projections onto the quotient space of “corners" of finite size, must be finite. A similar result, Theorem 1.1, is also established for unitarily invariant measures on the space of all infinite complex matrices. These results imply that the infinite Hua-Pickrell measures...