On Shannon-McMillan's limit theorem for pairs of stationary random processes
We investigate solution sets of a special kind of linear inequality systems. In particular, we derive characterizations of these sets in terms of minimal solution sets. The studied inequalities emerge as information inequalities in the context of Bayesian networks. This allows to deduce structural properties of Bayesian networks, which is important within causal inference.
In this series, this paper is devoted to the study of two related functional equations primarily connected with weighted entropy and weighted entropy of degree beta (which are weighted additive and weighted beta additive respectively) which include as special cases Shannon's entropy, inaccuracy (additive measures) and the entropy of degree beta (nonadditive) respectively. These functional equations which arise mainly from the representation and these 'additive' properties are solved for fixed m...
The irregularity coefficient is one of the numerical characteristics of the spectral bandwith of a stationary random process. Its basic properties are investigated and the application to the dichotomic classification of a process into narrow-band and wide-band ones is given. Further, its behaviour is analyzed for sufficiently wide classes of stationary processes whose spectral densities frequently appear both in theory and applications.
To have accuracy in the extracted information is the goal of the reliability theory investigation. In information theory, varentropy has recently been proposed to describe and measure the degree of information dispersion around entropy. Theoretical investigation on varentropy of past life has been initiated, however details on its stochastic properties are yet to be discovered. In this paper, we propose a novel stochastic order and introduce new classes of life distributions based on past varentropy....