Displaying similar documents to “A summary on entropy statistics”

A general class of entropy statistics

María Dolores Esteban (1997)

Applications of Mathematics

Similarity:

To study the asymptotic properties of entropy estimates, we use a unified expression, called the H h , v ϕ 1 , ϕ 2 -entropy. Asymptotic distributions for these statistics are given in several cases when maximum likelihood estimators are considered, so they can be used to construct confidence intervals and to test statistical hypotheses based on one or more samples. These results can also be applied to multinomial populations.

A new approach to mutual information

Fumio Hiai, Dénes Petz (2007)

Banach Center Publications

Similarity:

A new expression as a certain asymptotic limit via "discrete micro-states" of permutations is provided for the mutual information of both continuous and discrete random variables.

A note on the interval-valued marginal problem and its maximum entropy solution

Jiřina Vejnarová (1998)

Kybernetika

Similarity:

This contribution introduces the marginal problem, where marginals are not given precisely, but belong to some convex sets given by systems of intervals. Conditions, under which the maximum entropy solution of this problem can be obtained via classical methods using maximum entropy representatives of these convex sets, are presented. Two counterexamples illustrate the fact, that this property is not generally satisfied. Some ideas of an alternative approach are presented at the end of...