Comparison of two methods for approximation of probability distributions with prescribed marginals

Pérez, Albert, and Studený, Milan. "Comparison of two methods for approximation of probability distributions with prescribed marginals." Kybernetika 43.5 (2007): 591-618. <http://eudml.org/doc/33883>.

@article{Pérez2007,
abstract = {Let $P$ be a discrete multidimensional probability distribution over a finite set of variables $N$ which is only partially specified by the requirement that it has prescribed given marginals $\lbrace P_\{A\};\ A\in \{\mathcal \{S\}\} \rbrace $, where $\{\mathcal \{S\}\}$ is a class of subsets of $N$ with $\bigcup \{\mathcal \{S\}\} = N$. The paper deals with the problem of approximating $P$ on the basis of those given marginals. The divergence of an approximation $\hat\{P\}$ from $P$ is measured by the relative entropy $H(P|\hat\{P\})$. Two methods for approximating $P$ are compared. One of them uses formerly introduced concept of dependence structure simplification (see Perez [Per79]). The other one is based on an explicit expression, which has to be normalized. We give examples showing that neither of these two methods is universally better than the other. If one of the considered approximations $\hat\{P\}$ really has the prescribed marginals then it appears to be the distribution $P$ with minimal possible multiinformation. A simple condition on the class $\{\mathcal \{S\}\}$ implying the existence of an approximation $\hat\{P\}$ with prescribed marginals is recalled. If the condition holds then both methods for approximating $P$ give the same result.},
author = {Pérez, Albert, Studený, Milan},
journal = {Kybernetika},
keywords = {marginal problem; relative entropy; dependence structure simplification; explicit expression approximation; multiinformation; decomposable model; asteroid; marginal problem; relative entropy; multiinformation; decomposable model},
language = {eng},
number = {5},
pages = {591-618},
publisher = {Institute of Information Theory and Automation AS CR},
title = {Comparison of two methods for approximation of probability distributions with prescribed marginals},
url = {http://eudml.org/doc/33883},
volume = {43},
year = {2007},
}

TY - JOUR
AU - Pérez, Albert
AU - Studený, Milan
TI - Comparison of two methods for approximation of probability distributions with prescribed marginals
JO - Kybernetika
PY - 2007
PB - Institute of Information Theory and Automation AS CR
VL - 43
IS - 5
SP - 591
EP - 618
AB - Let $P$ be a discrete multidimensional probability distribution over a finite set of variables $N$ which is only partially specified by the requirement that it has prescribed given marginals $\lbrace P_{A};\ A\in {\mathcal {S}} \rbrace $, where ${\mathcal {S}}$ is a class of subsets of $N$ with $\bigcup {\mathcal {S}} = N$. The paper deals with the problem of approximating $P$ on the basis of those given marginals. The divergence of an approximation $\hat{P}$ from $P$ is measured by the relative entropy $H(P|\hat{P})$. Two methods for approximating $P$ are compared. One of them uses formerly introduced concept of dependence structure simplification (see Perez [Per79]). The other one is based on an explicit expression, which has to be normalized. We give examples showing that neither of these two methods is universally better than the other. If one of the considered approximations $\hat{P}$ really has the prescribed marginals then it appears to be the distribution $P$ with minimal possible multiinformation. A simple condition on the class ${\mathcal {S}}$ implying the existence of an approximation $\hat{P}$ with prescribed marginals is recalled. If the condition holds then both methods for approximating $P$ give the same result.
LA - eng
KW - marginal problem; relative entropy; dependence structure simplification; explicit expression approximation; multiinformation; decomposable model; asteroid; marginal problem; relative entropy; multiinformation; decomposable model
UR - http://eudml.org/doc/33883
ER -