Multi-variate correlation and mixtures of product measures
Total correlation (‘TC’) and dual total correlation (‘DTC’) are two classical ways to quantify the correlation among an -tuple of random variables. They both reduce to mutual information when . The first part of this paper sets up the theory of TC and DTC for general random variables, not necessarily finite-valued. This generality has not been exposed in the literature before. The second part considers the structural implications when a joint distribution has small TC or DTC. If , then is...