Displaying similar documents to “Convexity inequalities for estimating generalized conditional entropies from below”

Entropy-like functionals: conceptual background and some results

Miroslav Katětov (1992)

Commentationes Mathematicae Universitatis Carolinae

Similarity:

We describe a conceptual approach which provides a unified view of various entropy-like functionals on the class of semimetric spaces, endowed with a bounded measure. The entropy E considered in the author’s previous articles is modified so as to assume finite values for a fairly wide class of spaces which fail to be totally bounded.

Generalized information criteria for Bayes decisions

Domingo Morales, Igor Vajda (2012)

Kybernetika

Similarity:

This paper deals with Bayesian models given by statistical experiments and standard loss functions. Bayes probability of error and Bayes risk are estimated by means of classical and generalized information criteria applicable to the experiment. The accuracy of the estimation is studied. Among the information criteria studied in the paper is the class of posterior power entropies which include the Shannon entropy as special case for the power α = 1 . It is shown that the most accurate estimate...

Universally typical sets for ergodic sources of multidimensional data

Tyll Krüger, Guido F. Montúfar, Ruedi Seiler, Rainer Siegmund-Schultze (2013)

Kybernetika

Similarity:

We lift important results about universally typical sets, typically sampled sets, and empirical entropy estimation in the theory of samplings of discrete ergodic information sources from the usual one-dimensional discrete-time setting to a multidimensional lattice setting. We use techniques of packings and coverings with multidimensional windows to construct sequences of multidimensional array sets which in the limit build the generated samples of any ergodic source of entropy rate below...