On some functional equations from additive and nonadditive measures. IV.
On some functional equations of Jessen, Karpf, and Thorup.
On some new measures of uncertainty, inaccuracy and information and their characterizations
On specificity and entropy measures.
On symmetry and reversible symmetry concerning generalized directed divergence
On the amount of information resulting from empirical and theoretical knowledge.
We present a mathematical model allowing formally define the concepts of empirical and theoretical knowledge. The model consists of a finite set P of predicates and a probability space (Ω, S, P) over a finite set Ω called ontology which consists of objects ω for which the predicates π ∈ P are either valid (π(ω) = 1) or not valid (π(ω) = 0). Since this is a first step in this area, our approach is as simple as possible, but still nontrivial, as it is demonstrated by examples. More realistic approach...
On the branching property of entropy
On the computation of covert channel capacity
We address the problem of computing the capacity of a covert channel, modeled as a nondeterministic transducer. We give three possible statements of the notion of “covert channel capacity” and relate the different definitions. We then provide several methods allowing the computation of lower and upper bounds for the capacity of a channel. We show that, in some cases, including the case of input-deterministic channels, the capacity of the channel can be computed exactly (e.g. in the form...
On the differential and residual entropy
On the error exponent for ergodic Markov source
On the -entropy and its Hudetz correction
The Hudetz correction of the fuzzy entropy is applied to the -entropy. The new invariant is expressed by the Hudetz correction of fuzzy entropy.
On the general solution of a functional equation connected to sum form information measures on open domain. III.
On the Jensen-Shannon divergence and the variation distance for categorical probability distributions
We establish a decomposition of the Jensen-Shannon divergence into a linear combination of a scaled Jeffreys' divergence and a reversed Jensen-Shannon divergence. Upper and lower bounds for the Jensen-Shannon divergence are then found in terms of the squared (total) variation distance. The derivations rely upon the Pinsker inequality and the reverse Pinsker inequality. We use these bounds to prove the asymptotic equivalence of the maximum likelihood estimate and minimum Jensen-Shannon divergence...
On the Largest Solution of a Functional Equation Connected to sum Form Information Measures on Open Domain-i
On the mean and the variance of estimates of Kullback information and relative “useful” information measures
In this paper the mean and the variance of the Maximum Likelihood Estimator (MLE) of Kullback information measure and measure of relative "useful" information are obtained.
On the modified entropy equation.
On the Rényi dimension
On Two Conditional Entropies without Probability.
On weighted entropy of type and its generalizations
Belis and Guiasu studied a generalization of Shannon entropy as weighted or useful entropy. In this paper, the weighted entropy of type is defined and characterized and some if its properties are studied. Further generalizations involving more parameters of weighted entropy are also specified.
On Weighted Parametric Information Measure