Displaying similar documents to “Extended Shannon entropies. II”

A new approach to mutual information

Fumio Hiai, Dénes Petz (2007)

Banach Center Publications

Similarity:

A new expression as a certain asymptotic limit via "discrete micro-states" of permutations is provided for the mutual information of both continuous and discrete random variables.

A new approach to mutual information. II

Fumio Hiai, Takuho Miyamoto (2010)

Banach Center Publications

Similarity:

A new concept of mutual pressure is introduced for potential functions on both continuous and discrete compound spaces via discrete micro-states of permutations, and its relations with the usual pressure and the mutual information are established. This paper is a continuation of the paper of Hiai and Petz in Banach Center Publications, Vol. 78.

A note on how Rényi entropy can create a spectrum of probabilistic merging operators

Martin Adamčík (2019)

Kybernetika

Similarity:

In this paper we present a result that relates merging of closed convex sets of discrete probability functions respectively by the squared Euclidean distance and the Kullback-Leibler divergence, using an inspiration from the Rényi entropy. While selecting the probability function with the highest Shannon entropy appears to be a convincingly justified way of representing a closed convex set of probability functions, the discussion on how to represent several closed convex sets of probability...

Maličky-Riečan's entropy as a version of operator entropy

Bartosz Frej (2006)

Fundamenta Mathematicae

Similarity:

The paper deals with the notion of entropy for doubly stochastic operators. It is shown that the entropy defined by Maličky and Riečan in [MR] is equal to the operator entropy proposed in [DF]. Moreover, some continuity properties of the [MR] entropy are established.