On a characterization of the Shannon entropy
It is known that the class of factorizing codes, i.e., codes satisfying the factorization conjecture formulated by Schützenberger, is closed under two operations: the classical composition of codes and substitution of codes. A natural question which arises is whether a finite set of operations exists such that each factorizing code can be obtained by using the operations in and starting with prefix or suffix codes. is named here a complete set of operations (for factorizing codes). We show...
It is known that the class of factorizing codes, i.e., codes satisfying the factorization conjecture formulated by Schützenberger, is closed under two operations: the classical composition of codes and substitution of codes. A natural question which arises is whether a finite set O of operations exists such that each factorizing code can be obtained by using the operations in O and starting with prefix or suffix codes. O is named here a complete set of operations (for factorizing codes). We show...
This is a part of a recent program by a number of authors to study information measures on open domain. In this series, this paper is devoted to the study of the functional equation (2) on an open domain. This functional equation is connected to the weighted entropy and weighted entropy of degree a.
The Shannon entropy has the sum form ∑f(pi) with f(x) = -x logx (x belonging to [0,1]). This together with the property of additivity leads to the 'sum' functional equation...